JavaScript SDK v3.5.0

Changelog

Features

• Support Agent tool call tracing for AI SDK v5/v6 auto instrumentation (#1575)
• Attach saved parameters to experiments (#1550)
• Allow associating created prompts with environments (#1489)

Bug Fixes

• Resolve edge AsyncLocalStorage from runtime builtins (#1611)
• Re-throw any queue errors that occurred (#1583)
• Make param types that are forwarded backwards compatible with older open ai SDKs (#1602)
• Preserve .withResponse() on embeddings and moderations create (#1587)
• Make sure params get passed through for compiled prompt (#1558)
• Flush pass in evaluator state if it exists (#1581)
• Record tools in metadata for AI SDK and Google gen ai (#1570)
• Make AI SDK Agent span nodes use use type function (#1568)

Other Changes

• Handle arrays of images when building prompts (#1247)

Package: https://www.npmjs.com/package/braintrust/v/3.5.0

Full Changelog: js-sdk-v3.4.0...js-sdk-v3.5.0

JavaScript SDK v3.4.0

Changelog

Features

• Add model parameter support (#1504)
• Add internal logger (#1526)
• Allow setting tags for all function types (#1533)
• Allow setting tags via prompts.create() (#1531)
• Add sandbox registration and types (#1494)
• Add node test runner integration (#1481)

Bug Fixes

• Fix auto-instrumentation by preserving return semantics from tracePromise and adding isomorphic interface for diagnostics channels (#1501)
• Fix _internal_btql.limit and _internal_btql.cursor being silently overwritten (#1497)

Other Changes

• Update BTQL AST (#1385)
• Use diagnostic channels for OpenAI SDK wrapper (#1499)
• Add duplicate_treatment to btql ast in submodules (#1484)

Package: https://www.npmjs.com/package/braintrust/v/3.4.0

Full Changelog: js-sdk-v3.3.0...js-sdk-v3.4.0

js-sdk-v3.3.0

Changelog

• Add sandbox registration and types (#1337)
• test(ai-sdk): Ensure prompt gets linked with streamText (#1471)
• perf: Improve eval runtime performance (#1459)
• ref: Set @typescript-eslint/prefer-as-const lint rule from warn to error (#1458)

js-sdk-v3.2.0

Changelog

• vitest evals (#1232)
• meta: Remove Python related code from this repo (#1403)
• Auto-instrumentation for TypeScript (#1302)
• add typespec updates for sandboxes (#1392)

Full Changelog: js-sdk-v3.1.0...js-sdk-v3.2.0

js-sdk-v3.1.0

Changelog

• feat(eval): Allow for tags to be passed in at experiment creation time (#1389)
• fix(ai-sdk): Make sure tokens are not double counted between parent/child spans (#1379)

js-sdk-v3.0.0

Changelog

• Braintrust 3.0.0 version (#1274)
• nunjucks templating moved to a plugin registry package
• update ast with MatchingSpansFilter (#1362)

py-sdk-v0.5.6

Changelog

• bump version for deploy (#1366)
• Add public name property to Span interface (#1359)
• Get thread in python (#1358)
• Fix litellm wrapper passing booleans in metrics (#1360)
• Include root span id in update_span (#1353)
• add with_raw_response to responses.parse for OpenAI and AsyncOpenAI (#1351)

js-sdk-v2.2.2

Changelog

• Initialize parameter values to default values (#1363)
• Include root span id in update_span (#1353)

js-sdk-v2.2.1

Changelog

• bump js version (#1354)
• Add sub-agent nesting for Claude Agent SDK wrapper (#1352)
• Add review span type (#1308)
• Add AsyncIterable input support for claude agent sdk (#1336)
• Remove preprocessor code (#1334)
• Implement project.parameters.create and loadParameters APIs (#1298)
• Reintroduce preprocessor truncation (#1330)
• claude-agent-sdk: trace with hooks (#1325)
• Classifications field (#1326)
• Simplify row merging logic (#1316)
• Thread fetching in trace scorers (js) (#1282)
• Support overflowing payloads to S3 at upload time (#1284)

py-sdk-v0.5.5

Changelog

• Skip test temporarily until we figure out threading (#1345)
• Handle all span types for openai agents integration (#1338)
• Add review span type (#1308)