primus package
Primus: Orchestration for AI/ML classification at scale.
This package exposes many submodules. To keep imports lightweight and avoid
optional heavy dependencies during package import, top‑level symbols are
resolved lazily via __getattr__ when accessed.
Subpackages
- primus.agentic package
- primus.analysis package
AccuracyGwetAC1PrecisionRecall- Subpackages
- Submodules
- primus.analysis.embedding_cache module
- primus.analysis.feedback_analyzer module
- primus.analysis.memory_weights module
- primus.analysis.metrics package
- primus.analysis.qdrant_vector_store module
- primus.analysis.s3vectors_client module
- primus.analysis.topic_clusterer module
- primus.analysis.vector_store_factory module
- primus.attribution package
- primus.auth package
- Submodules
- primus.auth.cognito module
- primus.auth.test_cognito module
config()test_access_token_is_cached_in_memory_until_near_expiry()test_access_token_is_refreshed_from_keychain()test_access_token_is_refreshed_when_it_is_within_the_pre_expiry_window()test_configuration_discovers_hosted_authorization_from_amplify_output()test_configuration_discovery_uses_the_hosted_domain_client_and_region()test_configuration_explains_when_amplify_has_no_hosted_authorization_output()test_configuration_rejects_any_unregistered_loopback_callback()test_confirmed_invalid_grant_removes_refresh_credential_and_requires_login()test_environment_configuration_overrides_amplify_output()test_exchange_stores_only_refresh_token()test_invalid_grant_raised_directly_by_post_removes_refresh_credential()test_keyring_store_only_suppresses_the_keyring_not_found_error()test_keyring_store_reports_a_real_delete_failure()test_keyring_store_uses_the_os_keychain()test_login_binds_loopback_listener_before_opening_browser()test_login_keeps_listener_open_when_browser_does_not_launch()test_login_url_uses_state_and_s256_pkce()test_loopback_callback_does_not_wait_for_reverse_dns()test_loopback_callback_rejects_missing_or_mismatched_state()test_loopback_callback_rejects_provider_errors()test_loopback_callback_reports_an_occupied_registered_port()test_missing_refresh_credential_requires_login_without_a_network_refresh()test_repeated_transient_refresh_failures_stop_after_the_bounded_retry()test_token_exchange_failure_returns_actionable_login_guidance()test_transient_refresh_failure_is_retried_before_the_command_fails()test_typed_refresh_failures_remain_compatible_with_authentication_callers()test_unproven_refresh_rejections_preserve_credential()test_whoami_uses_non_sensitive_identity_from_current_token()
- Submodules
- primus.chat package
- primus.cli package
- Subpackages
- primus.cli.analyze package
- primus.cli.auth package
- primus.cli.batch package
- primus.cli.bertopic package
- primus.cli.chat package
- primus.cli.cost package
- primus.cli.data package
- primus.cli.data_lake package
- primus.cli.dataset package
- primus.cli.evaluation package
- primus.cli.execute package
- primus.cli.feedback package
- primus.cli.item package
- primus.cli.metrics package
- primus.cli.optimization package
- primus.cli.prediction package
- primus.cli.procedure package
- primus.cli.record_count package
- primus.cli.report package
- primus.cli.result package
- primus.cli.rubric_memory package
- primus.cli.score package
- primus.cli.score_chat package
- primus.cli.scorecard package
- primus.cli.shared package
- primus.cli.task package
- primus.cli.training package
- primus.cli.tuning package
- Submodules
- Subpackages
- primus.command_worker package
AuditEventAuditEventTypeAuditSinkAuthenticatedCommandContextAuthorizationDecisionAuthorizationDeniedCancellationRequestedErrorCancellationResultClaimClaimStatusClockCommandAuthorizerCommandEnvelopeCommandEnvelope.CURRENT_SCHEMA_VERSIONCommandEnvelope.__init__()CommandEnvelope.command_idCommandEnvelope.created_atCommandEnvelope.from_message()CommandEnvelope.idempotency_keyCommandEnvelope.payloadCommandEnvelope.schema_versionCommandEnvelope.targetCommandEnvelope.tenant_idCommandEnvelope.to_message()
CommandIdGeneratorCommandLimitsCommandNotFoundCommandRecordCommandRecord.__init__()CommandRecord.command_idCommandRecord.created_atCommandRecord.envelopeCommandRecord.idempotency_keyCommandRecord.idempotency_namespaceCommandRecord.payloadCommandRecord.request_digestCommandRecord.statusCommandRecord.submitted_byCommandRecord.targetCommandRecord.tenant_idCommandRecord.updated_at
CommandRepositoryCommandRequestCommandServiceCommandStatusCommandWorkerCommandWorkerServiceDeliveryDrainSignalEventDrainSignalExecutionContextExecutorHeartbeatHandleHeartbeatSchedulerIdempotencyConflictInMemoryCommandRepositoryLeaseLostErrorLifecycleStoreProcessOutcomeProgressUpdateRequestDigestServiceOutcomeServiceReceiveErrorServiceStopReasonSubmissionDispositionSubmissionResultThreadHeartbeatSchedulerTransportUUIDCommandIdGeneratorrequest_digest()- Subpackages
- Submodules
- primus.command_worker.application module
- primus.command_worker.models module
AnnouncementDispositionAnnouncementResultAuditEventAuditEventTypeAuthenticatedCommandContextAuthorizationDecisionCancellationResultClaimCommandEnvelopeCommandLimitsCommandRecordCommandRequestCommandStatusProgressUpdateRequestDigestSubmissionDispositionSubmissionResultfreeze_json()request_digest()
- primus.command_worker.ports module
- primus.command_worker.repository module
- primus.command_worker.scheduler module
- primus.command_worker.service module
- primus.command_worker.smoke module
- primus.command_worker.worker module
- primus.config package
- primus.console package
- Submodules
- primus.console.chat_runtime module
ConsoleMessagebuild_response_owner()claim_message()console_async_tasks_available()fetch_assistant_chat_messages_between()fetch_chat_session()fetch_first_assistant_chunk_details()fetch_first_assistant_chunk_timestamp()fetch_latest_report_task()fetch_latest_score_edit_audit()fetch_message()fetch_recent_user_chat_turns()fetch_session_history()mark_message_completed()mark_message_failed()maybe_auto_title_session()normalize_response_target()parse_chat_message()process_console_message()process_pending_local_messages()resolve_console_tool_access_mode()run_console_chat_response()run_console_chat_response_async()should_handle_message()update_chat_session_title()utc_now()warm_console_runtime()
- primus.console.local_worker module
- primus.console.test_chat_runtime module
FakeClientFakeHistoryClientFakePendingClientFakeRaisingClaimClientFakeSessionMetadataClientFakeSessionTitleClienttest_claim_message_uses_conditional_pending_to_running_update()test_console_async_tasks_available_respects_explicit_false()test_console_message_metadata_snapshots_tool_mode_and_private()test_console_tool_mode_message_snapshot_overrides_session()test_console_tool_mode_uses_session_metadata_when_message_has_no_snapshot()test_duplicate_claim_exception_returns_false()test_duplicate_claim_returns_false_without_running_response()test_fetch_first_assistant_chunk_details_includes_model_and_tokens()test_fetch_session_history_excludes_private_messages_from_public_context()test_fetch_session_history_filters_and_sorts_messages()test_fetch_session_history_includes_same_owner_private_context()test_fetch_session_history_limits_to_recent_messages_and_clips_content()test_fetch_session_history_retains_short_evidence_reply_for_immediate_followup()test_generate_session_title_with_llm_prefers_names_over_ids()test_maybe_auto_title_session_ignores_private_user_turns()test_maybe_auto_title_session_replaces_title_on_second_user_turn()test_maybe_auto_title_session_respects_manual_title_lock()test_maybe_auto_title_session_sets_title_on_first_user_turn()test_maybe_auto_title_session_skips_third_and_later_turns()test_model_ids_match_ignores_provider_prefix()test_parse_chat_message_defaults_missing_response_target_to_cloud()test_parse_chat_message_extracts_private_owner_and_span_metadata()test_parse_chat_message_extracts_selected_model_from_metadata()test_parse_chat_message_ignores_non_object_metadata()test_process_console_message_falls_back_to_trigger_created_at()test_process_console_message_ignores_auto_title_failures()test_process_console_message_ignores_local_target_for_cloud_worker()test_process_console_message_logs_latency_summary()test_process_console_message_marks_completed_before_auto_title()test_process_console_message_marks_failed_when_harness_raises()test_process_console_message_reuses_directly_fetched_trigger_message()test_process_console_message_runs_harness_and_marks_completed()test_process_pending_local_messages_paginates_until_limit()test_process_pending_local_messages_uses_response_status_sort_key()test_run_console_chat_response_passes_console_context_to_builtin()test_run_console_chat_response_passes_durable_unpromoted_edit_state()test_run_console_chat_response_passes_selected_model_override()test_run_console_chat_response_passes_session_score_scope_to_builtin()test_run_console_chat_response_skips_empty_followup_state_on_first_turn()test_run_console_chat_response_uses_session_scope_fetched_with_direct_message()test_score_edit_audit_from_metadata_reads_persisted_audit()test_should_handle_only_matching_pending_user_chat_message()test_should_handle_rejects_non_chat_message_shapes()test_warm_console_runtime_prepares_mcp_server_and_prewarms_default_agent()
- primus.console.test_local_worker module
- primus.console.chat_runtime module
- Submodules
- primus.core package
- primus.dashboard package
- primus.data package
- Submodules
- primus.data.AWSDataLakeCache module
- primus.data.DataCache module
- primus.data.FeedbackItems module
- primus.data.HuggingFaceDataCache module
- primus.data.ScorecardExampleReferenceItems module
- primus.data.TestDataCache module
- primus.data.session_manager module
- primus.data.test_data_cache_logging module
- primus.data.test_feedback_items module
test_cache_directory_uses_runtime_environment()test_cache_identifier_with_filter_values()test_cache_methods()test_case_insensitive_normalization()test_column_mappings_applied_to_dataset()test_column_mappings_case_sensitivity()test_column_mappings_parameter()test_column_mappings_with_empty_dataset()test_create_dataset_rows_comment_logic()test_create_dataset_rows_fails_when_item_metadata_missing()test_create_dataset_rows_handles_missing_edit_comment()test_create_dataset_rows_skips_unresolved_labels_and_reports_ids()test_create_dataset_rows_structure()test_create_dataset_rows_with_data()test_exact_feedback_item_ids_are_unique_and_preserve_requested_order()test_exact_feedback_item_ids_fail_closed_when_membership_cannot_be_materialized()test_fetch_feedback_items_for_scores_excludes_invalid_items()test_initial_value_and_final_value_parameters()test_parameter_defaults()test_parameter_validation()test_reference_label_resolution_imported_and_unresolved()test_reference_label_resolution_priority()
- primus.data.test_feedback_sampling module
- Submodules
- primus.documentation package
- primus.guidelines package
- primus.infrastructure package
- Subpackages
- primus.infrastructure.constructs package
- primus.infrastructure.scoring_service package
ScheduledWorkerConfigValueScheduledWorkerDefinitionScheduledWorkerSecretValueScoringServiceAsyncScoringStackScoringServiceContainerRepositoryStackScoringServiceIntegrationStackScoringServiceMonitoringStackScoringServiceNetworkStackScoringServiceOperationsStackScoringServiceRepositoryStackScoringServiceScheduledWorkersStack- Submodules
- primus.infrastructure.service_network package
- Subpackages
- primus.input_sources package
- primus.linting package
ConfidenceConfigurationRuleLintMessageLintResultProcessorValidationRuleRuleEngineSchemaValidatorValidationRuleYamlLinter- Submodules
- primus.logging package
- primus.metrics package
- primus.optimization package
OptimizationDecisionPacketOptimizationDecisionPacket.__init__()OptimizationDecisionPacket.account_idOptimizationDecisionPacket.blockersOptimizationDecisionPacket.champion_versionOptimizationDecisionPacket.evidenceOptimizationDecisionPacket.evidence_fingerprintOptimizationDecisionPacket.evidence_idsOptimizationDecisionPacket.feedback_watermarkOptimizationDecisionPacket.policy_versionOptimizationDecisionPacket.primary_next_actionOptimizationDecisionPacket.rationaleOptimizationDecisionPacket.scopeOptimizationDecisionPacket.secondary_actionsOptimizationDecisionPacket.stakeholder_questionsOptimizationDecisionPacket.statesOptimizationDecisionPacket.to_dict()OptimizationDecisionPacket.window
assess_investment()dispatch_optimization_operation()evaluate_score_activity()normalize_diagnosis()normalize_structural_state()rank_opportunities()review_optimizer_result()summarize_packets()validate_approved_batch()validate_run_limits()- Submodules
- primus.optimization.agent_handoff module
- primus.optimization.decision module
OptimizationDecisionPacketassess_investment()bounded_diagnostic_assessment_failure()classify_post_run_review()dispatch_optimization_operation()evaluate_score_activity()evidence_fingerprint()frozen_utc_window()normalize_diagnosis()normalize_execution_candidate_policy()normalize_guideline_state()normalize_rank_scope()normalize_structural_state()rank_opportunities()rank_portfolio()rank_scope_matches()review_optimizer_result()run_operation()summarize_packets()validate_approved_batch()validate_public_run_dispatch()validate_run_limits()weekly_buckets()wilson_interval()
- primus.optimization.operator_identity module
- primus.optimization.optimizer_dispatch module
- primus.optimization.optimizer_dispatch_backend module
- primus.optimization.orchestration module
- primus.optimization.persistence module
- primus.optimization.portfolio_run module
- primus.optimization.report_actions module
- primus.optimization.run_report module
OptimizationRunIntegrityErrorOptimizationRunPublicationErrorOptimizationRunReportServiceOptimizationRunReportStateOptimizationRunRetryablePublicationErrorPublishedRevisionWorkbookArtifactbuild_scorecard_artifacts()build_stakeholder_presentation()build_stakeholder_workbook()dashboard_base_url_from_account_settings()optimization_run_key()
- primus.optimization.semantic_authority module
- primus.optimization.semantic_budget module
- primus.primus_logging package
- primus.processors package
- Submodules
- primus.processors.AddEnumeratedSpeakerIdentifiersTranscriptFilter module
- primus.processors.AddUnknownSpeakerIdentifiersTranscriptFilter module
- primus.processors.ByColumnValueDatasetFilter module
- primus.processors.ColumnDatasetFilter module
- primus.processors.DataframeProcessor module
- primus.processors.DeepgramFormatProcessor module
- primus.processors.DeepgramTimeSliceProcessor module
- primus.processors.DownsampleClassDatasetFilter module
- primus.processors.ExpandContractionsProcessor module
- primus.processors.FilterCustomerOnlyProcessor module
- primus.processors.MergeColumnsDatasetFilter module
- primus.processors.ProcessorFactory module
- primus.processors.RelevantWindowsTranscriptFilter module
- primus.processors.RemoveSpeakerIdentifiersTranscriptFilter module
- primus.processors.RemoveStopWordsTranscriptFilter module
- Submodules
- primus.reports package
- Subpackages
- primus.reports.blocks package
AcceptanceRateAcceptanceRateTimelineActionItemsBaseReportBlockCorrectionRateCostAnalysisExplanationAnalysisFeedbackAlignmentFeedbackAlignmentTimelineFeedbackAnalysisFeedbackContradictionsFeedbackVolumeTimelineRecentFeedbackScoreChampionVersionTimelineScoreInfoScoreResultsReportScorecardHistoryTopicAnalysisVectorTopicMemory- Submodules
- primus.reports.blocks package
- Submodules
- primus.reports.action_items_utils module
- primus.reports.parameter_utils module
- primus.reports.s3_utils module
- primus.reports.service module
- primus.reports.test_basic_integration module
- primus.reports.test_programmatic_report_tasks module
test_generate_report_core_stops_before_work_when_task_cancelled()test_run_block_cached_background_dedupes_inflight_task()test_run_block_cached_background_queues_durable_task()test_run_block_cached_foreground_waits_for_existing_task()test_run_programmatic_block_and_persist_treats_error_payload_as_failure()test_run_programmatic_block_and_persist_uses_concise_failure_message()test_wait_for_programmatic_task_result_surfaces_failure()test_wait_for_programmatic_task_result_surfaces_persisted_report_failure()
- primus.reports.test_service_integration module
- Subpackages
- primus.rubric_memory package
BiblicusRubricEvidenceRetrieverConfidenceInputsConfidenceInputs.chronological_evidence_countConfidenceInputs.conflicting_or_stale_evidence_countConfidenceInputs.high_authority_evidence_countConfidenceInputs.low_authority_evidence_countConfidenceInputs.model_configConfidenceInputs.prefix_scope_evidence_countConfidenceInputs.score_scope_evidence_countConfidenceInputs.score_version_idConfidenceInputs.scorecard_scope_evidence_countConfidenceInputs.suggested_confidenceConfidenceInputs.total_evidence_countConfidenceInputs.unknown_scope_evidence_count
ConfidenceLevelEvidenceClassificationEvidenceSnippetEvidenceSnippet.authorEvidenceSnippet.authority_levelEvidenceSnippet.evidence_classificationEvidenceSnippet.model_configEvidenceSnippet.policy_conceptsEvidenceSnippet.retrieval_scoreEvidenceSnippet.scope_levelEvidenceSnippet.snippet_textEvidenceSnippet.source_timestampEvidenceSnippet.source_typeEvidenceSnippet.source_uri
LocalRubricMemoryCorpusPathsLocalRubricMemoryCorpusResolverLocalRubricMemorySourcePreparedRubricMemoryCorpusPreparedRubricMemoryCorpus.__init__()PreparedRubricMemoryCorpus.corpus_rootPreparedRubricMemoryCorpus.fingerprintPreparedRubricMemoryCorpus.manifest_pathPreparedRubricMemoryCorpus.prepared_rootPreparedRubricMemoryCorpus.retriever_idPreparedRubricMemoryCorpus.source_file_countPreparedRubricMemoryCorpus.sourcesPreparedRubricMemoryCorpus.status
RubricAuthorityRubricAuthorityErrorRubricAuthorityResolverRubricEvidencePackRubricEvidencePack.confidenceRubricEvidencePack.confidence_inputsRubricEvidencePack.conflicting_evidenceRubricEvidencePack.evidence_classificationRubricEvidencePack.history_of_changeRubricEvidencePack.likely_reason_for_disagreementRubricEvidencePack.model_configRubricEvidencePack.open_questionsRubricEvidencePack.rubric_readingRubricEvidencePack.score_version_idRubricEvidencePack.supporting_evidence
RubricEvidencePackContextFormatterRubricEvidencePackRequestRubricEvidencePackRequest.feedback_commentRubricEvidencePackRequest.feedback_valueRubricEvidencePackRequest.model_configRubricEvidencePackRequest.model_explanationRubricEvidencePackRequest.model_valueRubricEvidencePackRequest.rubric_textRubricEvidencePackRequest.score_codeRubricEvidencePackRequest.score_identifierRubricEvidencePackRequest.score_version_idRubricEvidencePackRequest.scorecard_identifierRubricEvidencePackRequest.topic_hintRubricEvidencePackRequest.transcript_text
RubricEvidencePackServiceRubricEvidenceRetrieverRubricEvidenceSynthesizerRubricHistoryEventRubricMemoryCitationRubricMemoryCitation.authority_levelRubricMemoryCitation.evidence_classificationRubricMemoryCitation.excerptRubricMemoryCitation.idRubricMemoryCitation.kindRubricMemoryCitation.model_configRubricMemoryCitation.scope_levelRubricMemoryCitation.score_version_idRubricMemoryCitation.source_timestampRubricMemoryCitation.source_uri
RubricMemoryCitationContextRubricMemoryCitationFormatterRubricMemoryCitationValidationRubricMemoryCitationValidation.missing_idsRubricMemoryCitationValidation.model_configRubricMemoryCitationValidation.omitted_citationsRubricMemoryCitationValidation.supplied_idsRubricMemoryCitationValidation.unused_idsRubricMemoryCitationValidation.valid_idsRubricMemoryCitationValidation.warnings
RubricMemoryContextProviderRubricMemoryContextProvider.__init__()RubricMemoryContextProvider.generate_for_request()RubricMemoryContextProvider.generate_for_score_item()RubricMemoryContextProvider.local_corpus_status()RubricMemoryContextProvider.retrieve_for_score_item()RubricMemoryContextProvider.retrieve_for_score_items()
RubricMemoryGatedSMEQuestionRubricMemoryGatedSMEQuestion.actionRubricMemoryGatedSMEQuestion.answer_statusRubricMemoryGatedSMEQuestion.citation_idsRubricMemoryGatedSMEQuestion.citation_validationRubricMemoryGatedSMEQuestion.final_textRubricMemoryGatedSMEQuestion.idRubricMemoryGatedSMEQuestion.model_configRubricMemoryGatedSMEQuestion.original_textRubricMemoryGatedSMEQuestion.rationale
RubricMemoryPreparedCorpusManagerRubricMemoryQueryPlanRubricMemoryQueryPlannerRubricMemoryRecentBriefingProviderRubricMemorySMEQuestionRubricMemorySMEQuestionGateRequestRubricMemorySMEQuestionGateRequest.candidate_agenda_itemsRubricMemorySMEQuestionGateRequest.model_configRubricMemorySMEQuestionGateRequest.optimizer_contextRubricMemorySMEQuestionGateRequest.rubric_memory_contextRubricMemorySMEQuestionGateRequest.score_identifierRubricMemorySMEQuestionGateRequest.score_version_idRubricMemorySMEQuestionGateRequest.scorecard_identifier
RubricMemorySMEQuestionGateResultRubricMemorySMEQuestionGateResult.citation_diagnosticsRubricMemorySMEQuestionGateResult.final_agenda_markdownRubricMemorySMEQuestionGateResult.final_itemsRubricMemorySMEQuestionGateResult.kept_itemsRubricMemorySMEQuestionGateResult.model_configRubricMemorySMEQuestionGateResult.score_version_idRubricMemorySMEQuestionGateResult.summary_countsRubricMemorySMEQuestionGateResult.suppressed_itemsRubricMemorySMEQuestionGateResult.transformed_items
RubricMemorySMEQuestionGateServiceS3RubricMemoryCorpusPathsS3RubricMemoryCorpusPaths.__init__()S3RubricMemoryCorpusPaths.bucket_nameS3RubricMemoryCorpusPaths.prefix_knowledge_base_prefixesS3RubricMemoryCorpusPaths.score_knowledge_base_prefixS3RubricMemoryCorpusPaths.scorecard_knowledge_base_prefixS3RubricMemoryCorpusPaths.scorecard_prefixS3RubricMemoryCorpusPaths.sources
S3RubricMemoryCorpusResolverS3RubricMemoryObjectS3RubricMemorySourceSMEQuestionAnswerStatusSMEQuestionGateActionTactusRubricEvidenceSynthesizerTactusRubricMemorySMEQuestionGateSynthesizercandidate_agenda_items_from_markdown()format_gated_sme_agenda()validate_rubric_memory_citations()- Submodules
- primus.rubric_memory.authority module
- primus.rubric_memory.citations module
- primus.rubric_memory.context_formatter module
- primus.rubric_memory.local_corpus module
- primus.rubric_memory.models module
- primus.rubric_memory.preparation module
- primus.rubric_memory.provider module
- primus.rubric_memory.query_planner module
- primus.rubric_memory.recent module
- primus.rubric_memory.retrieval module
- primus.rubric_memory.s3_corpus module
- primus.rubric_memory.service module
- primus.rubric_memory.sme_question_gate module
RubricMemoryGatedSMEQuestionRubricMemorySMEQuestionRubricMemorySMEQuestionGateRequestRubricMemorySMEQuestionGateResultRubricMemorySMEQuestionGateServiceRubricMemorySMEQuestionGateSynthesizerSMEQuestionAnswerStatusSMEQuestionGateActionTactusRubricMemorySMEQuestionGateSynthesizercandidate_agenda_items_from_markdown()format_gated_sme_agenda()
- primus.rubric_memory.synthesis module
- primus.runtime package
- primus.scores package
AWSComprehendEntityExtractorAWSComprehendEntityExtractor.ResultAWSComprehendEntityExtractor.__init__()AWSComprehendEntityExtractor.extract_first_person_entity()AWSComprehendEntityExtractor.extract_quotes_that_include_first_person_entity()AWSComprehendEntityExtractor.predict()AWSComprehendEntityExtractor.predict_validation()AWSComprehendEntityExtractor.register_model()AWSComprehendEntityExtractor.save_model()AWSComprehendEntityExtractor.train_model()
AWSComprehendSentimentScoreAWSComprehendSentimentScore.ResultAWSComprehendSentimentScore.__init__()AWSComprehendSentimentScore.create()AWSComprehendSentimentScore.predict()AWSComprehendSentimentScore.predict_validation()AWSComprehendSentimentScore.register_model()AWSComprehendSentimentScore.save_model()AWSComprehendSentimentScore.train_model()
AgenticExtractorAgenticValidatorExplainableClassifierExplainableClassifier.ParametersExplainableClassifier.Parameters.decision_thresholdExplainableClassifier.Parameters.include_explanationsExplainableClassifier.Parameters.keywordsExplainableClassifier.Parameters.leaderboard_n_featuresExplainableClassifier.Parameters.model_configExplainableClassifier.Parameters.ngram_rangeExplainableClassifier.Parameters.scale_pos_weight_indexExplainableClassifier.Parameters.target_score_nameExplainableClassifier.Parameters.target_score_valueExplainableClassifier.Parameters.top_n_features
ExplainableClassifier.ResultExplainableClassifier.__init__()ExplainableClassifier.evaluate_model()ExplainableClassifier.explain_model()ExplainableClassifier.predict()ExplainableClassifier.predict_validation()ExplainableClassifier.preprocess_text()ExplainableClassifier.register_model()ExplainableClassifier.save_model()ExplainableClassifier.train_model()ExplainableClassifier.vectorize_transcript()
FastTextClassifierFastTextClassifier.ParametersFastTextClassifier.Parameters.bucket_sizeFastTextClassifier.Parameters.dimensionFastTextClassifier.Parameters.learning_rateFastTextClassifier.Parameters.learning_rate_update_rateFastTextClassifier.Parameters.loss_functionFastTextClassifier.Parameters.maximum_character_ngram_lengthFastTextClassifier.Parameters.minimum_character_ngram_lengthFastTextClassifier.Parameters.minimum_label_countFastTextClassifier.Parameters.minimum_word_countFastTextClassifier.Parameters.model_configFastTextClassifier.Parameters.number_of_epochsFastTextClassifier.Parameters.number_of_negative_samplesFastTextClassifier.Parameters.number_of_threadsFastTextClassifier.Parameters.sampling_thresholdFastTextClassifier.Parameters.window_sizeFastTextClassifier.Parameters.word_ngram_count
FastTextClassifier.__init__()FastTextClassifier.data_filename()FastTextClassifier.get_model_artifact_path()FastTextClassifier.load_context()FastTextClassifier.load_model()FastTextClassifier.predict()FastTextClassifier.predict_validation()FastTextClassifier.process_data()FastTextClassifier.register_model()FastTextClassifier.save_model()FastTextClassifier.save_model_binary()FastTextClassifier.train_model()
OpenAIEmbeddingsClassifierOpenAIEmbeddingsClassifier.ParametersOpenAIEmbeddingsClassifier.Parameters.batch_sizeOpenAIEmbeddingsClassifier.Parameters.dropout_rateOpenAIEmbeddingsClassifier.Parameters.early_stop_patienceOpenAIEmbeddingsClassifier.Parameters.embeddings_modelOpenAIEmbeddingsClassifier.Parameters.embeddings_model_trainable_layersOpenAIEmbeddingsClassifier.Parameters.l2_regularization_strengthOpenAIEmbeddingsClassifier.Parameters.learning_rate_decayOpenAIEmbeddingsClassifier.Parameters.maximum_tokens_per_windowOpenAIEmbeddingsClassifier.Parameters.maximum_windowsOpenAIEmbeddingsClassifier.Parameters.model_configOpenAIEmbeddingsClassifier.Parameters.multiple_windowsOpenAIEmbeddingsClassifier.Parameters.number_of_epochsOpenAIEmbeddingsClassifier.Parameters.number_of_plateau_epochsOpenAIEmbeddingsClassifier.Parameters.number_of_warmup_epochsOpenAIEmbeddingsClassifier.Parameters.plateau_learning_rateOpenAIEmbeddingsClassifier.Parameters.start_from_endOpenAIEmbeddingsClassifier.Parameters.warmup_learning_rate
OpenAIEmbeddingsClassifier.__init__()OpenAIEmbeddingsClassifier.evaluate_model()OpenAIEmbeddingsClassifier.predict()OpenAIEmbeddingsClassifier.predict_validation()OpenAIEmbeddingsClassifier.process_data()OpenAIEmbeddingsClassifier.train_model()
ScoreScore.FieldValidationScore.InputScore.ParametersScore.Parameters.convert_data_percentage()Score.Parameters.dataScore.Parameters.dependenciesScore.Parameters.idScore.Parameters.keyScore.Parameters.label_fieldScore.Parameters.label_score_nameScore.Parameters.model_configScore.Parameters.nameScore.Parameters.number_of_classesScore.Parameters.scorecard_nameScore.Parameters.validation
Score.ResultScore.Result.codeScore.Result.confidenceScore.Result.confidence_from_metadataScore.Result.end_time_secondsScore.Result.errorScore.Result.explanationScore.Result.explanation_from_metadataScore.Result.is_no()Score.Result.is_yes()Score.Result.metadataScore.Result.model_configScore.Result.parametersScore.Result.start_time_secondsScore.Result.validate()Score.Result.value
Score.SkippedScoreExceptionScore.ValidationConfigScore.ValidationErrorScore.__init__()Score.analyze_dataset()Score.apply_processors()Score.apply_processors_to_text()Score.evaluate_model()Score.from_name()Score.get_accumulated_costs()Score.get_label_score_name()Score.is_multi_classScore.is_relevant()Score.load()Score.load_data()Score.log_validation_errors()Score.model_directory_path()Score.number_of_classesScore.predict()Score.predict_validation()Score.record_configuration()Score.register_model()Score.report_directory_path()Score.report_file_name()Score.save_model()Score.setup_label_map()Score.train_model()
SubjectIdentityScoreSubjectSpanOverlapScoreTactusScoreTactusScore.ParametersTactusScore.Parameters.base_model_nameTactusScore.Parameters.codeTactusScore.Parameters.handle_tactus_code_fallback()TactusScore.Parameters.logprobsTactusScore.Parameters.max_tokensTactusScore.Parameters.model_configTactusScore.Parameters.model_nameTactusScore.Parameters.model_providerTactusScore.Parameters.model_regionTactusScore.Parameters.outputTactusScore.Parameters.parse_from_startTactusScore.Parameters.reasoning_effortTactusScore.Parameters.temperatureTactusScore.Parameters.top_logprobsTactusScore.Parameters.top_pTactusScore.Parameters.valid_classesTactusScore.Parameters.verbosity
TactusScore.__init__()TactusScore.create()TactusScore.predict()
resolve_score_class()- Subpackages
- Submodules
- primus.scores.AWSComprehendEntityExtractor module
- primus.scores.AWSComprehendSentimentScore module
- primus.scores.AgenticExtractor module
- primus.scores.AgenticValidator module
- primus.scores.CompositeScore module
- primus.scores.DeepLearningOneStepSemanticClassifier module
- primus.scores.DeepLearningSemanticClassifier module
- primus.scores.DeepLearningSlidingWindowSemanticClassifier module
- primus.scores.ExplainableClassifier module
- primus.scores.FastTextClassifier module
- primus.scores.KeywordClassifier module
- primus.scores.LLMGenerator module
- primus.scores.LangGraphScore module
- primus.scores.OpenAIEmbeddingsClassifier module
- primus.scores.SVMClassifier module
- primus.scores.Score module
- primus.scores.SourceSpanOverlapScore module
- primus.scores.SubjectIdentityScore module
- primus.scores.SubjectSpanOverlapScore module
- primus.scores.TactusScore module
- primus.scores.prompt_trace module
- primus.scores.test_lang_graph_cost_calculator module
- primus.scores.test_langgraph_cost_components module
- primus.scores.test_langgraphscore_routing module
- primus.scores.test_lazy_class_resolution module
- primus.scores.test_prompt_trace module
- primus.scores.test_tactus_score_runtime_controls module
test_tactus_score_can_reuse_runtime_when_explicitly_enabled()test_tactus_score_enriches_explanation_with_real_runtime_from_attachment()test_tactus_score_enriches_explanation_with_recorded_deepgram_attachment_key()test_tactus_score_enriches_explanation_with_timestamps_when_deepgram_present()test_tactus_score_enrichment_fails_gracefully_on_error()test_tactus_score_enrichment_handles_nested_metadata_deepgram()test_tactus_score_enrichment_skipped_when_no_explanation()test_tactus_score_parallel_predictions_with_blocking_runtime_execute()test_tactus_score_passes_runtime_gpt5_controls_to_prediction_runtime()test_tactus_score_preserves_structured_runtime_failure()test_tactus_score_runtime_pool_allows_parallel_predictions()test_tactus_score_skips_enrichment_when_no_deepgram_data()test_tactus_score_uses_fresh_runtime_per_prediction_by_default()
- primus.scoring package
- primus.skills package
- primus.storage package
- Submodules
- primus.storage.FileStorageBackend module
- primus.storage.StorageBackend module
- primus.storage.graphql_artifact_store module
- primus.storage.test_graphql_artifact_store module
FakeCAHTTPSessionFakeExecutorFakeHTTPSessionFakeResponseread_request()test_authorization_failure_does_not_request_a_replacement_ticket()test_configured_local_ca_bundle_is_used_for_https_verification()test_decodes_required_headers_returned_as_graphql_awsjson()test_download_batch_requests_all_tickets_once_and_verifies_each_payload()test_download_checksum_failure_fails_closed_without_retries()test_expired_signed_url_reissues_one_ticket_and_retries_once()test_missing_configured_local_ca_bundle_fails_closed()test_non_retryable_upload_client_status_fails_closed_without_fresh_ticket()test_requests_batched_tickets_with_frozen_contract_fields()test_retryable_download_failure_does_not_request_a_fresh_ticket()test_retryable_upload_request_exception_gets_one_fresh_ticket_for_identical_bytes()test_retryable_upload_status_gets_one_fresh_ticket_for_identical_bytes()test_second_retryable_upload_failure_fails_closed_without_a_third_ticket()test_standard_s3_expiry_message_reissues_one_ticket_and_retries_once()test_ticket_requires_an_https_host()test_upload_batch_requests_all_tickets_once_before_uploading_each_verified_artifact()test_upload_omits_only_a_redundant_unsigned_checksum_header_already_bound_in_the_url()test_upload_preserves_checksum_header_when_query_binding_is_absent_inconsistent_or_signed()test_upload_rejects_mismatched_declared_bytes_before_requesting_ticket()test_upload_transfers_verified_bytes_before_returning_metadata_without_s3()ticket()write_request()
- Submodules
- primus.utils package
batch_find_items_by_identifiers()capture_request_logs()check_if_score_is_disabled()check_s3_bucket_access()create_identifiers_for_item()create_score_result()create_scorecard_instance_for_single_score()download_score_result_log_file()download_score_result_trace_file()enqueue_downstream_recompute_jobs()find_item_by_identifier()find_item_by_typed_identifier()find_items_by_identifier_type()get_existing_score_result()get_external_id_from_item()get_item_identifiers()get_metadata_from_item()get_primus_client()get_text_from_item()resolve_score_id()resolve_scorecard_id()sanitize_metadata_for_graphql()send_message_to_standard_scoring_request_queue()truncate_dict_strings()truncate_dict_strings_inner()upload_score_result_log_file()upload_score_result_trace_file()- Submodules
- primus.utils.deepgram_attachments module
- primus.utils.dependency_snapshots module
DependencySnapshotcheck_score_result_dependency_snapshot_current()dependency_configs_from_snapshot()dependency_entry_from_result()dependency_snapshot_from_score_result()excerpt()extract_dependency_snapshot()fetch_persisted_dependency_snapshot()get_dependency_names()get_score_config()get_target_dependencies()isoformat()json_object()merge_snapshot_into_trace()result_from_persisted_score_result()score_version_id()snapshot_from_in_memory_results()stable_hash()unwrap_result_entry()
- primus.utils.dict_utils module
- primus.utils.feedback_selection module
- primus.utils.identifier_search module
- primus.utils.quote_normalization module
- primus.utils.request_log_capture module
- primus.utils.score_result_s3_utils module
- primus.utils.score_result_timestamps module
- primus.utils.scoring module
SingleScoreExecutionOutcomecheck_if_score_is_disabled()create_score_result()create_scorecard_instance_for_single_score()enqueue_downstream_recompute_jobs()ensure_persisted_dependencies()get_existing_score_result()get_external_id_from_item()get_metadata_from_item()get_primus_client()get_text_from_item()resolve_score_id()resolve_scorecard_id()sanitize_metadata_for_graphql()score_single_target_with_dependencies()send_message_to_standard_scoring_request_queue()
- primus.utils.text_template module
Submodules
- primus.CustomLogging module
- primus.Evaluation module
AccuracyEvaluationConsistencyEvaluationEvaluationEvaluation.__init__()Evaluation.build_cost_details_from_expenses()Evaluation.calculate_metrics()Evaluation.cleanup()Evaluation.continuous_metrics_computation()Evaluation.create_performance_visualization()Evaluation.generate_and_log_confusion_matrix()Evaluation.generate_csv_scorecard_report()Evaluation.generate_excel_report()Evaluation.generate_metrics_json()Evaluation.generate_report()Evaluation.get_evaluation_info()Evaluation.get_latest_evaluation()Evaluation.log_parameters()Evaluation.log_to_dashboard()Evaluation.maybe_start_metrics_task()Evaluation.run()Evaluation.score_all_texts()Evaluation.score_all_texts_for_score()Evaluation.score_names()Evaluation.score_names_to_process()Evaluation.score_text()Evaluation.start_mlflow_run()Evaluation.time_execution()
FeedbackEvaluation
- primus.LangChainUser module
LangChainUserLangChainUser.MAX_RETRY_ATTEMPTSLangChainUser.ParametersLangChainUser.Parameters.base_model_nameLangChainUser.Parameters.logprobsLangChainUser.Parameters.max_tokensLangChainUser.Parameters.model_configLangChainUser.Parameters.model_nameLangChainUser.Parameters.model_providerLangChainUser.Parameters.model_regionLangChainUser.Parameters.reasoning_effortLangChainUser.Parameters.temperatureLangChainUser.Parameters.top_logprobsLangChainUser.Parameters.top_pLangChainUser.Parameters.verbosity
LangChainUser.__init__()LangChainUser.cleanup()LangChainUser.extract_reasoning_content()LangChainUser.get_azure_credential()LangChainUser.get_token_usage()LangChainUser.is_gpt_oss_model()LangChainUser.normalize_response_text()
- primus.PromptTemplateLoader module
PromptTemplateLoaderPromptTemplateLoader.__init__()PromptTemplateLoader.get_template()PromptTemplateLoader.load_decision_tree()PromptTemplateLoader.load_preprocessing_steps()PromptTemplateLoader.parse_markdown_sections()PromptTemplateLoader.process_decision_tree()PromptTemplateLoader.process_keyword()PromptTemplateLoader.process_preprocessing_steps()
- primus.Registries module
- primus.Scorecard module
ScorecardScorecard.__init__()Scorecard.build_dependency_graph()Scorecard.check_dependency_conditions()Scorecard.create_from_yaml()Scorecard.create_instance_from_api_data()Scorecard.get_accumulated_costs()Scorecard.get_model_name()Scorecard.get_score_names()Scorecard.get_score_result()Scorecard.initialize_from_api_data()Scorecard.initialize_registry()Scorecard.load_and_register_scorecards()Scorecard.name()Scorecard.normalize_score_name()Scorecard.score_entire_text()Scorecard.score_names()Scorecard.score_names_to_process()Scorecard.score_registry
- primus.ScorecardResults module
- primus.ScorecardResultsAnalysis module
ScorecardResultsAnalysisScorecardResultsAnalysis.__init__()ScorecardResultsAnalysis.calculate_overall_accuracy()ScorecardResultsAnalysis.calculate_row_accuracy()ScorecardResultsAnalysis.calculate_total_cost()ScorecardResultsAnalysis.generate_csv_scorecard_report()ScorecardResultsAnalysis.generate_html_report()ScorecardResultsAnalysis.generate_question_accuracy_csv()ScorecardResultsAnalysis.plot_accuracy_heatmap()ScorecardResultsAnalysis.plot_scorecard_costs()ScorecardResultsAnalysis.visualize_decision_path()
- primus.bedrock_models module
- primus.confidence_calibration module
apply_calibration_from_serialized()apply_temperature_scaling()compute_isotonic_regression_calibration()compute_two_stage_calibration()detect_confidence_feature_enabled()expected_calibration_error()extract_confidence_accuracy_pairs()find_optimal_temperature()generate_calibration_report()plot_reliability_diagram()serialize_calibration_model()
- primus.feedback_analysis_preflight module
FeedbackAnalysisPreflightErrorFeedbackAnalysisPreflightError.__init__()FeedbackAnalysisPreflightError.diagnosticsFeedbackAnalysisPreflightError.error_codeFeedbackAnalysisPreflightError.root_causeFeedbackAnalysisPreflightError.score_idFeedbackAnalysisPreflightError.score_version_idFeedbackAnalysisPreflightError.scorecard_id
FeedbackAnalysisPreflightResultvalidate_feedback_analysis_preflight()
- primus.feedback_integrity module
- primus.feedback_item_explanations module
FeedbackItemExplanationTimeoutErrorFeedbackItemExplanationTimeoutError.__init__()FeedbackItemExplanationTimeoutError.attempt_countFeedbackItemExplanationTimeoutError.diagnosticsFeedbackItemExplanationTimeoutError.elapsed_secondsFeedbackItemExplanationTimeoutError.feedback_item_idFeedbackItemExplanationTimeoutError.last_error_messageFeedbackItemExplanationTimeoutError.last_error_typeFeedbackItemExplanationTimeoutError.modelFeedbackItemExplanationTimeoutError.provider
get_or_generate_feedback_item_explanation()hydrate_feedback_item_explanations()
- primus.primus_logging package
- primus.rca_analysis module
analyze_score_result()build_feedback_context()build_misclassification_analysis_summary()build_misclassification_classification_contract()build_misclassification_item_context()build_rca_analysis_failure_classification()build_rca_analysis_failure_details()classify_misclassification_item()explain_misclassification_item_classification()extract_misclassification_evidence_flags()get_misclassification_classifier_output_contract()get_misclassification_explainer_output_contract()get_misclassification_item_context_contract()get_misclassification_item_scope_evidence_contract()normalize_best_evidence_source()resolve_final_output_classes_from_yaml_text()rubric_memory_state_from_item_context()
- primus.runtime_budget module
- primus.score_rubric_consistency module
ScoreRubricConsistencyRequestScoreRubricConsistencyRequest.__init__()ScoreRubricConsistencyRequest.item_textScoreRubricConsistencyRequest.rubric_textScoreRubricConsistencyRequest.score_codeScoreRubricConsistencyRequest.score_identifierScoreRubricConsistencyRequest.score_version_idScoreRubricConsistencyRequest.scorecard_identifier
ScoreRubricConsistencyResultScoreRubricConsistencyResult.__init__()ScoreRubricConsistencyResult.checked_atScoreRubricConsistencyResult.diagnosticsScoreRubricConsistencyResult.modelScoreRubricConsistencyResult.paragraphScoreRubricConsistencyResult.score_identifierScoreRubricConsistencyResult.score_version_idScoreRubricConsistencyResult.scorecard_identifierScoreRubricConsistencyResult.statusScoreRubricConsistencyResult.to_parameters_payload()
ScoreRubricConsistencyServiceScoreRubricConsistencyService.DEFAULT_MODELScoreRubricConsistencyService.MAX_ATTEMPTSScoreRubricConsistencyService.MAX_INPUT_TOKENSScoreRubricConsistencyService.MAX_OUTPUT_TOKENSScoreRubricConsistencyService.VALID_STATUSESScoreRubricConsistencyService.__init__()ScoreRubricConsistencyService.generate()ScoreRubricConsistencyService.generate_from_api()
fetch_score_version_for_consistency()merge_consistency_result_into_parameters()
- primus.test_evaluation_cost_details module
test_accuracy_evaluation_keeps_persisted_parameters_for_completion()test_build_cost_details_from_expenses_multi_model()test_build_cost_details_from_expenses_single_model()test_create_score_result_persists_attached_cost()test_update_variables_preserves_notes_and_baselines_when_adding_cost_details()test_update_variables_writes_cost_details_without_existing_parameters()
- primus.test_evaluation_metrics module
MockScorecardTestAccuracyEvaluationRunTestConfusionMatrixBuildingTestDistributionCalculationsTestErrorHandlingTestLabelStandardizationTestMetricsCalculationTestMultiScoreHandlingTestScoreTextProcessingTestScoreTextProcessing.test_score_text_prefers_top_level_linkage_fields()TestScoreTextProcessing.test_score_text_prefers_top_level_metadata_for_feedback_rows()TestScoreTextProcessing.test_score_text_raises_when_score_returns_error_result()TestScoreTextProcessing.test_score_text_resolves_item_id_from_report_identifier()TestScoreTextProcessing.test_score_text_times_out_and_returns_error_result()
create_mock_evaluation_results()create_mock_score_result()mock_evaluation()
- primus.test_prediction_commands module
- primus.test_score module
ConcreteScoreTestScoreEdgeCasesTestScoreFromNameTestScoreInitializationTestScoreInputTestScoreParametersTestScoreParameters.test_basic_parameters_creation()TestScoreParameters.test_parameters_with_all_optional_fields()TestScoreParameters.test_parameters_with_data_percentage_conversion()TestScoreParameters.test_parameters_with_dependencies()TestScoreParameters.test_parameters_with_numeric_percentage()TestScoreParameters.test_parameters_with_string_percentage_variations()TestScoreParameters.test_parameters_without_percentage_gets_default()
TestScoreResultTestScoreResult.sample_parameters()TestScoreResult.test_basic_result_creation()TestScoreResult.test_result_backwards_compatibility_properties()TestScoreResult.test_result_backwards_compatibility_with_empty_metadata()TestScoreResult.test_result_equality_with_other_result()TestScoreResult.test_result_equality_with_string()TestScoreResult.test_result_is_no_method()TestScoreResult.test_result_is_yes_method()TestScoreResult.test_result_with_boolean_value()TestScoreResult.test_result_with_error()TestScoreResult.test_result_with_metadata()
TestScoreUtilityMethodsTestScoreUtilityMethods.test_api_scorecard_provenance_overrides_stale_or_missing_config()TestScoreUtilityMethods.test_api_scorecard_provenance_requires_canonical_name()TestScoreUtilityMethods.test_get_accumulated_costs_default()TestScoreUtilityMethods.test_get_label_score_name_basic()TestScoreUtilityMethods.test_get_label_score_name_with_both_custom_and_field()TestScoreUtilityMethods.test_get_label_score_name_with_custom_label()TestScoreUtilityMethods.test_get_label_score_name_with_label_field()TestScoreUtilityMethods.test_model_directory_path()TestScoreUtilityMethods.test_report_directory_path()
- primus.training_data_lake module