-
Notifications
You must be signed in to change notification settings - Fork 235
follow-up(#795): fact-checker counter-hypothesis grounding #832
Description
Follow-up from PR #795 (merged)
PR #795 added the built-in fact-checker agent role. The implementation is strong — clear methodology, confidence ratings, 8 new tests.
Recommended Enhancement
Add one sentence to \act-checker-charter.md\ under Verification Methodology → Counter-Hypothesis section:
Counter-hypotheses must be testable with available tools (grep, glob, web search). Do not generate hypothetical counter-arguments you cannot verify with evidence.
Why
LLMs can hallucinate confident-but-false counter-arguments. The existing confidence rating system (✅ = confirmed via source) already enforces evidence implicitly, but making it explicit in the counter-hypothesis section eliminates ambiguity and reduces risk of the fact-checker hallucinating plausible rebuttals.
Priority: Low — implicit safeguards already exist.