Skip to content

[ARI-36] Validate AC-05 β€” Confidence band shown in 100% of notificationsΒ #15

@bjridicodes

Description

@bjridicodes

Linear: ARI-36

Type: πŸ”΅ User Story | Sprint: 7 | Points: 2 | AC: AC-05

As an on-call engineer, I want every single ARIA notification to show a confidence band so that I never receive a finding without knowing how much to trust it.

Acceptance Criteria

Given 10 test incidents are processed
When each Slack notification is inspected
Then 10 of 10 contain a visible confidence band (high / medium / low) β€” AC-05 requires 100%

Given any notification with LOW confidence
When it is inspected
Then it contains explicit language indicating uncertainty (e.g. "low confidence β€” treat as unverified")
And it does NOT contain unqualified statements like "root cause is X"

Given 1 incident where Agent 3 fails entirely
When the notification is sent
Then it still shows "confidence: unknown β€” classification failed" rather than omitting the field

Metadata

Metadata

Assignees

No one assigned

    Labels

    phase-1Phase 1 β€” POC notify-only

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions