Skip to content

Pull requests: OpenHands/benchmarks

New pull request New
24 Open 405 Closed
24 Open 405 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Strengthen restriction against accessing installed package versions
#691 opened Apr 23, 2026 by juanmichelini Collaborator Loading…
fix(swebench): release disk during full image assembly
#690 opened Apr 23, 2026 by simonrosenberg Collaborator Loading…
4
eval: honor GPT-5 prompt when available
#686 opened Apr 21, 2026 by enyst Collaborator • Draft
DO_NOT_MERGE_FOR_TESTING_ONLY - Simulate eval_infer error
#680 opened Apr 20, 2026 by juanmichelini Collaborator • Draft
1
2
DO_NOT_MERGE_FOR_TESTING_ONLY - Simulate run_infer error
#679 opened Apr 20, 2026 by juanmichelini Collaborator • Draft
1
2
DO_NOT_MERGE_FOR_TESTING_ONLY - Simulate build images error
#678 opened Apr 20, 2026 by juanmichelini Collaborator • Draft
1
3
[DO NOT MERGE] ci(swtbench): revert to Blacksmith runner (fallback for #495)
#673 opened Apr 20, 2026 by simonrosenberg Collaborator • Draft
1
fix(swtbench): rmi after push + free runner disk (fixes evaluation#495)
#672 opened Apr 19, 2026 by simonrosenberg Collaborator Loading…
@simonrosenberg
11
fix(llm_config): disable reasoning_effort for Opus 4.7
#670 opened Apr 17, 2026 by juanmichelini Collaborator Loading…
3
Fix GAIA build target docs: binary-minimal -> binary
#667 opened Apr 15, 2026 by simonrosenberg Collaborator • Draft
1
Remove redundant 'Apply workflow_dispatch overrides' step from build workflows
#660 opened Apr 13, 2026 by simonrosenberg Collaborator • Draft
1
Remove binary diffs from agent patches in SWE-bench evaluation
#656 opened Apr 9, 2026 by juanmichelini Collaborator • Draft
1
11
ci: retire Blacksmith from all GitHub Actions workflows
#649 opened Apr 9, 2026 by raymyers • Draft
1
Filter SWE-Bench Multimodal image builds to curated subset
#644 opened Apr 6, 2026 by juanmichelini Collaborator Loading…
1
16
feat/add SkillsBench benchmark integration
#641 opened Apr 5, 2026 by AmyTao • Draft
12
Add agent-serving profiling benchmark
#633 opened Apr 4, 2026 by neubig Contributor • Draft
fix: reset BuildKit cache between retries for base/assembly builds
#631 opened Apr 4, 2026 by simonrosenberg Collaborator Loading…
3 tasks
Update Claude ACP package references
#629 opened Apr 3, 2026 by simonrosenberg Collaborator Loading…
3
build(deps): bump the version-all group across 1 directory with 21 updates dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code
#596 opened Mar 31, 2026 by dependabot Bot Loading…
Add benchmark-side Apptainer workspace support
#509 opened Mar 12, 2026 by neubig Contributor • Draft
2
build(deps): bump the version-all group across 1 directory with 5 updates dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#492 opened Mar 9, 2026 by dependabot Bot Loading…
NeMo Evaluator Integration
#455 opened Feb 26, 2026 by simonrosenberg Collaborator Loading…
1
@simonrosenberg
27
Add security benchmark with ASTRA
#361 opened Jan 26, 2026 by XZ-X • Draft
1
Agentic code search
#141 opened Dec 8, 2025 by adityasoni9998 Contributor Loading…
5
ProTip! Exclude everything labeled bug with -label:bug.