Skip to content

fix: Smoke Copilot uses PR-review tools in scheduled (non-PR) context #21268

@github-actions

Description

@github-actions

Problem

Smoke Copilot's scheduled run (§23145445350) failed in the safe_outputs job because the agent attempted to call PR-specific safe output tools in a scheduled (non-PR) context:

✗ Message 1 (create_pull_request_review_comment) failed: Not in pull request context
✗ Message 2 (create_pull_request_review_comment) failed: Not in pull request context
✗ Message 11 (reply_to_pull_request_review_comment) failed: Cannot reply to review comments outside of a pull request context
3 safe output(s) failed

The agent completed its core task successfully and created a discussion (#21234), an issue (#21235), and a comment — but 3 safe output items failed because create_pull_request_review_comment and reply_to_pull_request_review_comment require a PR trigger event.

This is a recurring pattern — a similar issue was previously noted with Smoke Gemini using add_comment outside PR context.

Root Cause

The Smoke Copilot workflow prompt or configuration does not restrict PR-review tool usage to PR-triggered contexts. When running on a schedule, these tools always fail.

Recommended Fix

In .github/workflows/smoke-copilot.md, either:

  1. Remove instructions that cause the agent to use create_pull_request_review_comment / reply_to_pull_request_review_comment during scheduled runs
  2. Or add explicit guidance: "When running on a schedule trigger, do not use PR review comment tools — use add_comment on discussions/issues instead"

Impact

  • Workflow marked as failure despite core work completing
  • 3 wasted safe output slots per run
  • False alarm in smoke test health monitoring

Related

  • Similar pattern: Smoke Gemini schedule context error (shared-alerts 2026-03-13)
  • Performance report: #aw_perf16

Generated by Agent Performance Analyzer - Meta-Orchestrator ·

  • expires on Mar 18, 2026, 5:52 PM UTC

Metadata

Metadata

Assignees

No one assigned

    Labels

    cookieIssue Monster Loves Cookies!

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions