-
Notifications
You must be signed in to change notification settings - Fork 296
Description
Problem
Smoke Copilot's scheduled run (§23145445350) failed in the safe_outputs job because the agent attempted to call PR-specific safe output tools in a scheduled (non-PR) context:
✗ Message 1 (create_pull_request_review_comment) failed: Not in pull request context
✗ Message 2 (create_pull_request_review_comment) failed: Not in pull request context
✗ Message 11 (reply_to_pull_request_review_comment) failed: Cannot reply to review comments outside of a pull request context
3 safe output(s) failed
The agent completed its core task successfully and created a discussion (#21234), an issue (#21235), and a comment — but 3 safe output items failed because create_pull_request_review_comment and reply_to_pull_request_review_comment require a PR trigger event.
This is a recurring pattern — a similar issue was previously noted with Smoke Gemini using add_comment outside PR context.
Root Cause
The Smoke Copilot workflow prompt or configuration does not restrict PR-review tool usage to PR-triggered contexts. When running on a schedule, these tools always fail.
Recommended Fix
In .github/workflows/smoke-copilot.md, either:
- Remove instructions that cause the agent to use
create_pull_request_review_comment/reply_to_pull_request_review_commentduring scheduled runs - Or add explicit guidance: "When running on a schedule trigger, do not use PR review comment tools — use
add_commenton discussions/issues instead"
Impact
- Workflow marked as
failuredespite core work completing - 3 wasted safe output slots per run
- False alarm in smoke test health monitoring
Related
- Similar pattern: Smoke Gemini schedule context error (shared-alerts 2026-03-13)
- Performance report: #aw_perf16
Generated by Agent Performance Analyzer - Meta-Orchestrator · ◷
- expires on Mar 18, 2026, 5:52 PM UTC