Skip to content

Add trace scorers#25

Merged
Stephen Belanger (Qard) merged 4 commits intomainfrom
trace-scorers
Mar 23, 2026
Merged

Add trace scorers#25
Stephen Belanger (Qard) merged 4 commits intomainfrom
trace-scorers

Conversation

@Qard
Copy link
Copy Markdown
Contributor

No description provided.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Copy link
Copy Markdown
Contributor

@kevingosse Kevin Gosse (kevingosse) left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly NITs + a couple of important changes.

Comment thread examples/TraceScoring/Program.cs Outdated
Comment thread examples/TraceScoring/Program.cs Outdated
Comment thread src/Braintrust.Sdk/Api/Internal/IBtqlClient.cs Outdated
Comment thread src/Braintrust.Sdk/Api/Internal/BtqlClient.cs Outdated
Comment thread src/Braintrust.Sdk/Api/Internal/BtqlClient.cs Outdated
Comment thread src/Braintrust.Sdk/Eval/Eval.cs Outdated
Comment thread src/Braintrust.Sdk/Eval/EvalTrace.cs
Comment thread src/Braintrust.Sdk/Eval/ITracedScorer.cs Outdated
Stephen Belanger (Qard) and others added 2 commits March 23, 2026 23:31
- IBtqlClient: extend IDisposable
- BtqlClient: return [] literal; use .Cast<> instead of explicit cast in Select
- Eval: use OfType<> instead of Any(s => s is)
- ITracedScorer: rename ScoreAsync -> Score (overload of IScorer.Score)
- EvalTrace: add GetThreadAsync tests
- Program.cs: use DatasetCase.Of type inference

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Copy link
Copy Markdown
Contributor

@kevingosse Kevin Gosse (kevingosse) left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@Qard Stephen Belanger (Qard) merged commit 91a3706 into main Mar 23, 2026
1 check passed
@Qard Stephen Belanger (Qard) deleted the trace-scorers branch March 23, 2026 21:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants