Skip to content

Stabilize automatic compute generation coverage - #84

Merged
dovvnloading merged 1 commit into
mainfrom
codex/stabilize-automatic-compute-test
Jul 30, 2026
Merged

Stabilize automatic compute generation coverage#84
dovvnloading merged 1 commit into
mainfrom
codex/stabilize-automatic-compute-test

Conversation

@dovvnloading

Copy link
Copy Markdown
Owner

What changed

  • Replace the timing-sensitive subprocess dependency in the generation-observation test with a deterministic scratch coordinator seam.
  • Keep the existing end-to-end local-profile test as coverage for the real isolated scratch worker.
  • Assert the generated observation receives the verified arithmetic result and the coordinator lifecycle completes.

Root cause

Automatic compute intentionally falls back to ordinary chat when an isolated worker does not complete within its 1.5-second request budget. The old test required the result on every run while launching a real Windows child process, so occasional startup delays produced a false CI failure despite the expected fallback behavior.

Validation

  • python -m ruff check .
  • python -m pytest -q tests/test_open_source_execution.py
  • python -m pytest -q (374 passed, 1 skipped)
  • The repaired regression passed 20 consecutive runs.

@dovvnloading
dovvnloading merged commit f72edc6 into main Jul 30, 2026
1 check passed
@dovvnloading
dovvnloading deleted the codex/stabilize-automatic-compute-test branch July 30, 2026 23:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant