[daily regulatory] Regulatory Report - 2026-03-16 #21282
Closed
Replies: 1 comment
-
|
This report has been superseded by a newer daily regulatory report for 2026-03-17. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Today's regulatory review analyzed 12 daily report discussions generated on 2026-03-16. Overall data quality is high — key metrics (lock file count: 172, workflow file count: 172) are consistent across all reports that reference them. No critical cross-report discrepancies were found. The most actionable findings are a recurring
lockdown_no_tokenfailure impacting Issue Monster and Daily Issues Report Generator (5 combined failures), a day-2 unresolveduntrusted_checkout_execpoutine error in smoke workflows, and declining overall workflow success rate (77.8% today vs expected >90%).Repository health indicators remain strong: code quality score 79/100, test-to-source ratio 2.27x, 100% workflow security coverage (redaction + permissions), and 0% unlabeled issues. Token consumption per run is trending upward (1.38M avg today), which warrants monitoring for cost implications.
📋 Full Regulatory Report
📊 Reports Reviewed
🔍 Data Consistency Analysis
Cross-Report Metrics Comparison
workflow_files)open_prs)merged_prs)issues_analyzed)open_issues)firewall_enabled_runs)Scope Notes:
issues_analyzed: Performance report covers last 1,000 issues; Auto-Triage covers open issues query — different scopes by design.open_issues: Performance report derives from 1,000-issue sample; Auto-Triage queries all open issues — expected difference.firewall_enabled_runs: Firewall Report (26 total across 7d) vs Observability Report (22 runs in partial window) — time windows differ; not a true discrepancy.Consistency Score
Critical Issues
lockdown_no_tokenFailures — Issue Monster + Daily Issues Reportworkflow_success_rateGH_AW_GITHUB_TOKENorGH_AW_GITHUB_MCP_SERVER_TOKENsecret present.activation.GH_AW_GITHUB_TOKENas a repository secret (seedocs/src/content/docs/reference/auth.mdx). This is a recurring issue (appeared in previous regulatory reports).Warnings
poutine
untrusted_checkout_execERROR — Day 2 Unresolvedsmoke-workflow-callandsmoke-workflow-call-with-inputshave 6 poutine ERROR-level supply chain findings for untrusted checkout execution, unchanged from yesterday (173→172 workflows, 18→18 poutine findings).Safe Output
add_commentFailure Rate — 40%add_commentexecutions failed in the early-day sample (Safe Output Health Safe Output Health Report - 2026-03-16 #21171). Root cause is context mismatch: smoke workflows usingtarget=triggeringrun on schedule without PR/issue context.Observability MCP Signal Gap — 1 Run
rpc-messages.jsonlpresent but 0 MCP entries — telemetry file exists but recorded no tool calls.Compiler Code Quality
compiler_yaml.goBelow Thresholdcompiler_yaml.goscored 70/100 (threshold: 75), driven by critically low comment density (2.4%) and oversized functions (generatePrompt: 228 lines,generateCreateAwInfo: 126 lines).YAML Workflow LOC Spike — +20.1% in One Day
Data Quality Notes
[daily issues]report found in today's discussions (it failed due tolockdown_no_token— confirmed by Daily Audit).📈 Trend Analysis
Notable Trends
add_commentsafe outputs (+4), removal ofcreate_issueusage (−1) suggests ongoing workflow refinement.lockdown_no_tokenrecurring failures, platform success rate improves to ~96%.📝 Per-Report Analysis
View Per-Report Details
[daily secrets] Daily Secrets Analysis
Source: #21281 | Time Period: 2026-03-16 snapshot | Quality: ✅ Valid
github.tokenreferences[daily performance] Daily Performance Summary
Source: #21278 | Time Period: Last 100 PRs / 1,000 issues | Quality: ✅ Valid
Notes: Open + closed + unmerged-closed = 2 + 910 + 15 = 927 ≠ 1000; note that issues and PRs are separate metrics — this is not a math error.
Daily Firewall Report
Source: #21147 | Time Period: 2026-03-09 to 2026-03-16 (7 days) | Quality: ✅ Valid
Math check: 515 + 22 = 537 ✅
Safe Output Health Report
Source: #21171 | Time Period: ~4.5 hours UTC midnight | Quality:⚠️ Partial
💡 Recommendations
Process Improvements
lockdown_no_tokenpermanently: ConfigureGH_AW_GITHUB_TOKENsecret — this has now caused failures across multiple days and is blocking Issue Monster and Daily Issues Report. High priority.untrusted_checkout_execin smoke workflows: This poutine ERROR has persisted for 2 days. Reviewsmoke-workflow-callandsmoke-workflow-call-with-inputsfor unsafe checkout patterns.compiler_yaml.go: Add comments (target ≥15% density) and extractgeneratePrompt(228 lines) into focused sub-functions to bring quality score above 75.Data Quality Actions
if: github.event_name != 'schedule'guards onadd_comment target=triggeringsteps in smoke workflows to reduce false failure noise.📊 Regulatory Metrics
References:
Beta Was this translation helpful? Give feedback.
All reactions