Skip to content

ISSUE #3 Reduce runtime latency without degrading deliberation qualit…#4

Merged
fdidonato merged 1 commit intomainfrom
3-reduce-runtime-latency-without-degrading-deliberation-quality-and-add-first-class-observability-for-schedulingruntime-decisions
Apr 2, 2026
Merged

ISSUE #3 Reduce runtime latency without degrading deliberation qualit…#4
fdidonato merged 1 commit intomainfrom
3-reduce-runtime-latency-without-degrading-deliberation-quality-and-add-first-class-observability-for-schedulingruntime-decisions

Conversation

@fdidonato
Copy link
Copy Markdown
Owner

…y, and add first-class observability for scheduling/runtime decisions

Reduce end-to-end latency while preserving deliberation quality via parallel scheduling, speculative overlap with risk-aware joining, conservative cycle-1 early convergence, and request-scoped reuse (e.g. principle retrieval).

Observability:

  • Stable orchestration event taxonomy and trace stage metadata
  • Persistence extensions (orchestration_events, richer llm_calls metadata)
  • Reports/markdown export and UI request view updates for runtime decisions

Supporting changes:

  • Shared llm_parse_contract for structured LLM output parsing metadata
  • Risk estimator pooling/caching and constitution retriever improvements
  • ConversationGovernanceState foundation and guidance/convergence plumbing
  • Env/docs/README/INSTALL alignment; benchmark script hooks

Tests: controller speculative lazy path, conversation readiness, cycle-1 convergence, domain prefilter cache, parallel scheduler, request analysis reuse, runtime observability/pooling, simulator gate, speculative overlap, orchestrator updates, llm_parse_contract; add guidance_builder coverage.

…y, and add first-class observability for scheduling/runtime decisions

Reduce end-to-end latency while preserving deliberation quality via parallel
scheduling, speculative overlap with risk-aware joining, conservative cycle-1
early convergence, and request-scoped reuse (e.g. principle retrieval).

Observability:
- Stable orchestration event taxonomy and trace stage metadata
- Persistence extensions (orchestration_events, richer llm_calls metadata)
- Reports/markdown export and UI request view updates for runtime decisions

Supporting changes:
- Shared llm_parse_contract for structured LLM output parsing metadata
- Risk estimator pooling/caching and constitution retriever improvements
- ConversationGovernanceState foundation and guidance/convergence plumbing
- Env/docs/README/INSTALL alignment; benchmark script hooks

Tests: controller speculative lazy path, conversation readiness, cycle-1
convergence, domain prefilter cache, parallel scheduler, request analysis
reuse, runtime observability/pooling, simulator gate, speculative overlap,
orchestrator updates, llm_parse_contract; add guidance_builder coverage.
@fdidonato fdidonato merged commit 6fae80e into main Apr 2, 2026
0 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Reduce runtime latency without degrading deliberation quality, and add first-class observability for scheduling/runtime decisions

1 participant