chore(evals): add claude-sonnet-5 pricing to braintrust UI publisher#2318
Open
miguelg719 wants to merge 1 commit into
Open
chore(evals): add claude-sonnet-5 pricing to braintrust UI publisher#2318miguelg719 wants to merge 1 commit into
miguelg719 wants to merge 1 commit into
Conversation
Standard (non-introductory) Sonnet 5 rates so published eval cost metrics price sonnet-5 runs instead of falling through as unknown. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
Sonnet 5 eval runs published to the Braintrust UI had no pricing entry, so their cost metrics fell through as unknown.
What changed
Standard (non-introductory) Sonnet 5 rates — $3 input / $0.30 cached / $15 output per 1M — in the publisher's pricing map, prefixed and unprefixed forms per the map's convention.
Deliberate trade-off (noted in the code comment): introductory pricing ($2 / $0.20 / $10) applies through 2026-08-31, so costs published before then are overstated ~1.5×; standard rates keep the dashboard stable across the cutover instead of requiring a September flip.
Tests
Internal publish script; no behavior beyond the map entry. Typecheck green.
Summary by cubic
Add standard pricing for
anthropic/claude-sonnet-5andclaude-sonnet-5in the Braintrust UI publisher so eval runs get priced instead of showing as unknown. Uses $3 input / $0.30 cached input / $15 output per 1M tokens; this will overstate costs until 2026-08-31 while introductory rates are active, chosen to keep dashboards stable across the cutover.Written for commit 557c354. Summary will update on new commits.