Skip to content

SP-TRACE-CFR: remaining work blocked on external resources (live key, prod emitters, doctrine docs) #315

Description

@mdheller

The SP-TRACE-CFR narration-fidelity verifier is built, tested (270 tests), and merged to main — two-engine recovery, the sp-run narration-gate / attest-run surface, signed run attestations, a live reference runtime, and a real Claude ModelPolicy (PRs #311, #312, #313, #314; sourceos-spec #131). What remains is blocked on resources not available in the build environment.

1. Live end-to-end smoke against a real Anthropic key ⛔ needs ANTHROPIC_API_KEY / ant auth

ModelPolicy (tools/model_policy.py) drives the runtime via a dependency-injected Anthropic client; tests use a scripted fake (no live API). We have not run it against a real model turn.

  • default_client() + AgentRuntime.run_react on a real task; confirm control-flow events emerge from a genuine claude-opus-4-8 turn
  • confirm attest() gates the model's real narration (truthful → PASS, induced mismatch → FAIL)
  • Everything from model turn → recovery → verdict is already wired; this is an observation run, not new code.

2. Wire production emitters to emit control-flow ReasoningEvents ⛔ other repos / possibly other lane

sourceos-spec #131 added the controlFlow vocabulary. The real surfaces (TurtleTerm / Noetica / BearBrowser / the governed runner) don't emit these events yet.

  • emit reasoning.tool.called / decision.branched / subrun.spawned|joined / run.completed from at least one real emitter
  • Consumer side is done (trace_cfr_reasoning_bridge.py); once an emitter produces the events, gating runs on real runs with zero further change.

3. Deploy hardening ⛔ needs a real secret + CI decision

  • harness signing key from a deployment secret instead of the dev default (--key-seed / env)
  • CI hook so every governed run gets attest-run

4. Mellumwork + CBES doctrine grounding ⛔ needs source docs from @mdheller

tools/mellumwork.py grounds the T1/T2 tiering we actually use, but the named external frameworks weren't locatable. CBES's 7 axioms were never provided (not fabricated).

  • point at where Mellumwork / CBES live (Documents estate?) or confirm the in-code grounding is canonical

5. Composition primitives blocked on other infra

  • §10 AttributionIR — needs a replay-job runtime
  • §12 CINormIR — needs Policy Fabric / OPA integration

Doable here without any of the above (not blocked; separate follow-ups if wanted): ReceiptIR base fold additive edit; R_PI 3rd engine; eval strata S2/S3/S6; conformal anytime-valid/PASC.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions