primus.cli.procedure.test_feedback_alignment_optimizer_config module
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_feedback_investment_policy_keeps_weekly_volume_non_blocking()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_accepts_exact_feedback_cohort_in_a_different_order()
Feature: frozen feedback cohort validation
- Scenario: Evaluation service returns the frozen cohort in another order
Given a baseline cohort with unique feedback item IDs When a candidate evaluation contains exactly those IDs in a different order Then cohort validation succeeds
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_baseline_feedback_runs_score_rubric_consistency_check()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_cli_computes_frozen_feedback_window()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_contradictions_analysis_honors_requested_sample_cap()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_contradictions_reports_use_active_score_version_cache_key()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_creative_cookbook_is_isolated_to_creative_lane()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_disqualifies_single_class_predictions_on_multiclass_cohort()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_does_not_treat_elapsed_or_inactive_time_as_evaluation_failure()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_normal_cookbook_emphasizes_rubric_policy_before_mechanics()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_preserves_terminal_failed_evaluation_as_candidate_rejection_evidence()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_recovers_exact_terminal_evaluation_when_handle_payload_omits_id()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_rejects_feedback_cohort_membership_or_duplicate_changes()
Feature: frozen feedback cohort validation
- Scenario: Candidate cohort is not the exact frozen membership
Given a baseline cohort with unique feedback item IDs When a candidate has a missing, extra, or duplicate ID Then cohort validation fails with a cohort-difference diagnostic
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_rejects_terminally_failed_candidate_without_marking_evidence_missing()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_requires_a_balanced_regression_dataset()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_requires_balanced_regression_cohort_without_unbalanced_fallback()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_resume_reuses_regression_baseline_dataset_provenance()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_review_gate_uses_prediction_mode_collapse_as_disqualifier()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_skill_documents_three_phase_rubric_memory_sop()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_skill_preserves_complete_runs_and_one_cohort_selection_path()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_sme_gate_refreshes_rubric_memory_for_active_version()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_startup_requests_recent_rubric_memory()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_startup_requests_retrieval_only_rubric_memory()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_structural_cookbook_includes_late_prompt_shape_lane()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_synthesis_is_fail_closed_against_the_current_cycle_leader()
Feature: synthesis safety
- Scenario: a synthesis candidate loses either frozen cohort to the current cycle leader
Given the current cycle leader was evaluated on the frozen recent and regression cohorts When a synthesis candidate has a negative delta on either cohort against that leader Then the candidate is not selected or carried forward And the reviewer receives the leader, its cohort identity, and leader-relative deltas
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_synthesis_pins_model_without_reviewed_justification()
Feature: synthesis safety
- Scenario: synthesis changes a score model without review
Given the cycle leader has a pinned model configuration When synthesis submits a version with a different model configuration Then the version is rejected before selection unless an explicit reviewed justification is supplied
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_waits_for_a_terminal_evaluation_state_without_a_time_deadline()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_adds_creative_hypothesis_after_third_cycle()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_adds_plateau_lanes_on_top_of_protected_lanes()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_adds_report_phase_markers_for_context_capture()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_avoids_double_counting_after_cycle_record_and_formats_cycle_prompt_with_cycle_number()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_bounds_parallel_evaluation_processes()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_bounds_report_context_and_output_shapes()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_builds_agent_recurrence_context_with_emerging_items()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_declares_persisted_cost_ledger_output()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_declares_the_winning_version_in_its_persisted_output()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_deduplicates_submitted_candidate_records()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_defines_dedicated_reporting_agents()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_defines_safe_encode_for_score_test_failure_details()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_does_not_retry_cannot_improve_as_a_fallback()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_escalates_plateaus_instead_of_stopping_or_shrinking()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_fails_fast_on_infrastructure_submit_errors()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_final_reports_do_not_block_optimizer_completion()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_flags_repeated_strongly_harmful_hypothesis_territory_without_erasing_lane()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_freezes_feedback_window_instead_of_stopping_on_new_feedback()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_freezes_fresh_regression_dataset_for_all_candidate_evaluations()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_gates_sme_questions_with_rubric_memory()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_handles_semantically_unchanged_submit_errors()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_hypotheses_must_account_for_recurrence_targets()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_ignores_code_editor_prose_after_terminal_tools()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_injects_agent_recurrence_context_into_reasoning_paths()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_is_valid_lua_after_exact_cohort_wiring()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_keeps_bold_lane_and_uses_escalation_advisor()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_logs_auditable_recurrence_context_fingerprint()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_marks_one_cycle_runs_as_verification_only()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_marks_report_failures_as_terminal_without_losing_cycle_state()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_never_promotes_champion_and_reports_manual_follow_up()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_passes_code_editor_context_inline_without_history_injection()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_persists_configured_max_iterations_for_reporting()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_persists_no_feedback_terminal_summary()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_persists_structured_already_good_result_before_early_return()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_preprocessing_guidance_starts_with_broad_relevant_windows()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_protects_mechanically_clean_prompt_lines_after_repair()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_protects_structural_lane_from_rubric_candidate_cap()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_rebaselines_continuations_when_feedback_target_advanced()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_records_recurrence_for_failed_no_synthesis_cycles()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_records_sample_size_diagnostics()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_records_visible_synthesis_decision_when_no_version_is_evaluated()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_rejects_aggregate_gains_that_regress_protected_recall()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_rejects_incomplete_candidate_evaluation_batches()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_rejects_non_completed_evaluation_handles()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_replays_and_verifies_exact_recent_feedback_cohort()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_requires_requested_rows_for_cached_regression_dataset()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_routes_report_generation_to_reporting_agents()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_routes_unresolved_placeholders_to_mechanical_repair_lane()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_runs_contradictions_directly_without_background_dispatch()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_runs_diagnostic_synthesis_when_no_hypothesis_has_positive_signal()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_skips_invalid_synthesis_strategy_selection()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_skips_scores_with_no_recent_feedback_baseline()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_strategy_b_uses_clean_starting_point_when_baseline_is_mechanically_dirty()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_treats_cycle_errors_as_terminal_and_does_not_extend_iteration_cap()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_treats_interruption_as_terminal_not_retryable()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_uses_canonical_runtime_documentation_and_stages()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_uses_central_agent_steering_not_mailbox_polling()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_uses_dedicated_hypothesis_planner_and_agent_model_overrides()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_uses_lane_specific_cookbooks()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_uses_required_report_phase_helper_for_all_report_llm_calls()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_uses_safe_tool_call_arg_helper_instead_of_direct_args_dereferences()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_uses_utf8_safe_truncation_without_byte_slicing()
- primus.cli.procedure.test_feedback_alignment_optimizer_config.test_optimizer_yaml_writes_planning_context_to_platform_tmp_directory()