plexus.data package

The Plexus data packages are for loading and caching data for use in training and evaluating scores. The abstract base class DataCache defines the interface for the various data cache implementations. Each should override the parameters to define whatever parameters it needs, and then implement the load_data method to load a dataframe from the cache.

Submodules

• plexus.data.AWSDataLakeCache module
  • AWSDataLakeCache
    • AWSDataLakeCache.Parameters
      • AWSDataLakeCache.Parameters.local_cache_directory
      • AWSDataLakeCache.Parameters.model_config
    • AWSDataLakeCache.__init__()
    • AWSDataLakeCache.download_content_item()
    • AWSDataLakeCache.execute_athena_query()
    • AWSDataLakeCache.execute_batch_athena_queries()
    • AWSDataLakeCache.get_query_results()
    • AWSDataLakeCache.load_dataframe()
    • AWSDataLakeCache.process_content_item()
    • AWSDataLakeCache.split_into_batches()
• plexus.data.DataCache module
  • DataCache
    • DataCache.Parameters
      • DataCache.Parameters.class_name
      • DataCache.Parameters.model_config
    • DataCache.__init__()
    • DataCache.debug_dataframe()
    • DataCache.format_value_for_display()
    • DataCache.load_dataframe()
    • DataCache.log_validation_errors()
    • DataCache.upsert_item_for_dataset_row()
• plexus.data.FeedbackItems module
  • FeedbackItems
    • FeedbackItems.Parameters
      • FeedbackItems.Parameters.backfill_cells
      • FeedbackItems.Parameters.cache_file
      • FeedbackItems.Parameters.column_mappings
      • FeedbackItems.Parameters.days
      • FeedbackItems.Parameters.days_must_be_positive()
      • FeedbackItems.Parameters.feedback_id
      • FeedbackItems.Parameters.final_value
      • FeedbackItems.Parameters.identifier_extractor
      • FeedbackItems.Parameters.initial_value
      • FeedbackItems.Parameters.limit
      • FeedbackItems.Parameters.limit_must_be_positive()
      • FeedbackItems.Parameters.limit_per_cell
      • FeedbackItems.Parameters.limit_per_cell_must_be_positive()
      • FeedbackItems.Parameters.local_cache_directory
      • FeedbackItems.Parameters.model_config
      • FeedbackItems.Parameters.score
      • FeedbackItems.Parameters.scorecard
    • FeedbackItems.__init__()
    • FeedbackItems.load_dataframe()
• plexus.data.HuggingFaceDataCache module
  • HuggingFaceDataCache
    • HuggingFaceDataCache.Parameters
      • HuggingFaceDataCache.Parameters.model_config
      • HuggingFaceDataCache.Parameters.name
    • HuggingFaceDataCache.__init__()
    • HuggingFaceDataCache.analyze_dataset()
    • HuggingFaceDataCache.load_dataframe()
    • HuggingFaceDataCache.verify_dataset()
• plexus.data.TestDataCache module
  • TestDataCache
    • TestDataCache.Parameters
      • TestDataCache.Parameters.columns
      • TestDataCache.Parameters.model_config
      • TestDataCache.Parameters.num_rows
    • TestDataCache.__init__()
    • TestDataCache.load_dataframe()
• plexus.data.session_manager module
  • SessionManager
    • SessionManager.__init__()
    • SessionManager.get_session()
    • SessionManager.renew_session()
• plexus.data.test_feedback_items module
  • test_cache_identifier_with_filter_values()
  • test_cache_methods()
  • test_case_insensitive_normalization()
  • test_column_mappings_applied_to_dataset()
  • test_column_mappings_case_sensitivity()
  • test_column_mappings_parameter()
  • test_column_mappings_with_empty_dataset()
  • test_create_dataset_rows_comment_logic()
  • test_create_dataset_rows_handles_missing_edit_comment()
  • test_create_dataset_rows_structure()
  • test_create_dataset_rows_with_data()
  • test_initial_value_and_final_value_parameters()
  • test_parameter_defaults()
  • test_parameter_validation()
• plexus.data.test_feedback_sampling module
  • MockFeedbackItem
    • MockFeedbackItem.__init__()
  • MockFeedbackItems
  • TestFeedbackItemsSampling
    • TestFeedbackItemsSampling.setUp()
    • TestFeedbackItemsSampling.test_edge_case_empty_items()
    • TestFeedbackItemsSampling.test_edge_case_limit_zero()
    • TestFeedbackItemsSampling.test_scenario_1_fewer_items_than_limit()
    • TestFeedbackItemsSampling.test_scenario_2_prioritize_edit_comments_with_room_for_others()
    • TestFeedbackItemsSampling.test_scenario_3_more_items_with_comments_than_limit()
    • TestFeedbackItemsSampling.test_scenario_4_no_items_with_comments()
    • TestFeedbackItemsSampling.test_scenario_5_all_items_have_comments()
  • main()