Skip to content

chore(evals): add claude-sonnet-5 pricing to braintrust UI publisher#2318

Open
miguelg719 wants to merge 1 commit into
mainfrom
miguelgonzalez/sonnet-5-eval-pricing
Open

chore(evals): add claude-sonnet-5 pricing to braintrust UI publisher#2318
miguelg719 wants to merge 1 commit into
mainfrom
miguelgonzalez/sonnet-5-eval-pricing

Conversation

@miguelg719

@miguelg719 miguelg719 commented Jul 6, 2026

Copy link
Copy Markdown
Collaborator

Why

Sonnet 5 eval runs published to the Braintrust UI had no pricing entry, so their cost metrics fell through as unknown.

What changed

Standard (non-introductory) Sonnet 5 rates — $3 input / $0.30 cached / $15 output per 1M — in the publisher's pricing map, prefixed and unprefixed forms per the map's convention.

Deliberate trade-off (noted in the code comment): introductory pricing ($2 / $0.20 / $10) applies through 2026-08-31, so costs published before then are overstated ~1.5×; standard rates keep the dashboard stable across the cutover instead of requiring a September flip.

Tests

Internal publish script; no behavior beyond the map entry. Typecheck green.


Summary by cubic

Add standard pricing for anthropic/claude-sonnet-5 and claude-sonnet-5 in the Braintrust UI publisher so eval runs get priced instead of showing as unknown. Uses $3 input / $0.30 cached input / $15 output per 1M tokens; this will overstate costs until 2026-08-31 while introductory rates are active, chosen to keep dashboards stable across the cutover.

Written for commit 557c354. Summary will update on new commits.

Review in cubic

Standard (non-introductory) Sonnet 5 rates so published eval cost
metrics price sonnet-5 runs instead of falling through as unknown.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@changeset-bot

changeset-bot Bot commented Jul 6, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 557c354

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 1 file

Confidence score: 5/5

  • Automated review surfaced no issues in the provided summaries.
  • No files require special attention.

Re-trigger cubic

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant