Skip to content

Pull requests: supabase/evals

New pull request New
26 Open 194 Closed
26 Open 194 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: eval the API keys guide in supabase.com/docs
#212 opened Aug 17, 2026 by czenko Contributor Loading…
1
fix(core): normalize Claude Code Agent tool
#210 opened Aug 16, 2026 by Faisal01011 Loading…
1
1
docs: cover example solutions and check design for scorers
#205 opened Aug 14, 2026 by czenko Contributor Loading…
1
chore(deps): bump @hono/node-server from 1.19.14 to 1.19.15 in the npm_and_yarn group across 1 directory dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code
#204 opened Aug 14, 2026 by dependabot Bot Loading…
1
feat: parallel eval attempts
#203 opened Aug 14, 2026 by Rodriguespn Contributor • Draft
1
feat: warm-boot snapshot for the Vercel Sandbox eval runner run-evals Add to a PR to refresh benchmark evals
#201 opened Aug 14, 2026 by Rodriguespn Contributor • Draft
1
docs: the local development loop
#197 opened Aug 13, 2026 by barryroodt Contributor • 4/4 Loading…
1
feat(framework): add docs:local content API loop
#196 opened Aug 13, 2026 by barryroodt Contributor • 3/4 Loading…
1
feat(framework): pnpm local compare against the published baseline
#195 opened Aug 13, 2026 by barryroodt Contributor Loading…
1
feat(eval): add strict local-run gates and provenance receipts
#194 opened Aug 13, 2026 by barryroodt Contributor • 2/4 Loading…
@barryroodt
20
feat: evals runner with vercel workflows, sandbox
#186 opened Aug 10, 2026 by mattrossman Collaborator • Draft
1
fix(evals): remove synthetic system prompt hints, install skills natively per harness (AI-1034)
#180 opened Aug 7, 2026 by claude Bot • Draft
1
chore(deps): bump the npm_and_yarn group across 2 directories with 1 update dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code
#170 opened Aug 5, 2026 by dependabot Bot Loading…
1
feat: promote build-rls-003-org-roles-permissions to benchmark suite run-evals-changed Add to a PR to refresh only the benchmark evals that have had changes
#162 opened Aug 3, 2026 by mattrossman Collaborator Loading…
11
feat(web): AgentPrism trace viewer for eval runs
#161 opened Aug 3, 2026 by JesseVent Loading…
2
chore: refresh codex-gpt-5.6 prometheus-metrics runs at medium reasoning
#160 opened Aug 3, 2026 by barryroodt Contributor Loading…
@barryroodt
2
fix(ci): support explicit refresh experiments
#154 opened Jul 31, 2026 by mattrossman Collaborator • Draft
1
feat(claude-code): capture subagent text and thinking in transcripts
#137 opened Jul 28, 2026 by Rodriguespn Contributor • Draft
2
refactor(framework): run framework tests through Vitest
#135 opened Jul 28, 2026 by barryroodt Contributor Loading…
@barryroodt
2
refactor(evals): split deleted-user-access into two scenarios run-evals-changed Add to a PR to refresh only the benchmark evals that have had changes
#134 opened Jul 28, 2026 by barryroodt Contributor Loading…
@barryroodt
2
feat: upload benchmark results to Braintrust
#101 opened Jul 21, 2026 by Rodriguespn Contributor • Draft
4
feat: add approved-profiles RLS regression eval
#95 opened Jul 16, 2026 by mattrossman Collaborator • Draft
2
chore: refresh eval results
#93 opened Jul 16, 2026 by supabase-evals-releaser Bot • Draft
1
feat(eval): add Cursor CLI agent harness
#76 opened Jul 2, 2026 by Rodriguespn Contributor • Draft
@Rodriguespn
2
feat(eval): add Gemini CLI agent harness
#57 opened Jun 24, 2026 by Rodriguespn Contributor • Draft
2
ProTip! What’s not been updated in a month: updated:<2026-07-23.