Skip to content

Add metadata from scorer result#120

Merged
David Elner (delner) merged 1 commit intomainfrom
feature/scorer_result_metadata
Mar 17, 2026
Merged

Add metadata from scorer result#120
David Elner (delner) merged 1 commit intomainfrom
feature/scorer_result_metadata

Conversation

@delner
Copy link
Collaborator

Addresses #115

This pull request allows users to return a Hash as a result with :metadata; this field will be used as the metadata for the scorer span.

Example:

Braintrust::Scorer.new("translation") do |expected:, output:|
  common_words = output.downcase.split & expected.downcase.split
  overlap = common_words.size.to_f / expected.split.size
  {
    score: overlap,
    metadata: {word_overlap: common_words.size, missing_words: expected.downcase.split - output.downcase.split}
  }
end

@delner David Elner (delner) force-pushed the feature/scorer_result_metadata branch from 931bc21 to e4ba55b Compare March 17, 2026 20:04
@delner David Elner (delner) merged commit 85ee45c into main Mar 17, 2026
7 checks passed
@delner David Elner (delner) deleted the feature/scorer_result_metadata branch March 17, 2026 20:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants