Skip to content

Enhance Copilot Review Analyst skill: v3 newsletter report + adoption-signal & fairness methodology, Fixes AB#3696013#449

Open
shahzaibj wants to merge 6 commits into
masterfrom
shjameel-microsoft-copilot-review-analysis
Open

Enhance Copilot Review Analyst skill: v3 newsletter report + adoption-signal & fairness methodology, Fixes AB#3696013#449
shahzaibj wants to merge 6 commits into
masterfrom
shjameel-microsoft-copilot-review-analysis

Conversation

@shahzaibj

@shahzaibj shahzaibj commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Summary

Bakes this cycle's learnings into the copilot-review-analyst skill (.github/skills/copilot-review-analyst). Two themes: a redesigned v3 newsletter report + hardened Outlook rendering, and a stronger, fairer classification methodology.

Fixes AB#3696013

Report / rendering

  • v3 newsletter Outlook report (assets/…-Outlook.html): 1200px hybrid-fluid shell, edge-to-edge newsletter masthead (inset hero + 1120px VML width), big-number KPI hero grid, single-row meta-chips, and a Methodology section. Committed as the anonymized sample, single-quoted (escaping-free).
  • Headline leads with adoption % (Helpful & adopted), not precision — precision is near-100% by construction once Declined/Unresolved are excluded, so leading with it overstates the story.
  • Outlook rendering learnings documented in references/report-formatting.md § v3 Newsletter Rendering:
    • Meta-chips must be one single-row table — separate inline-block tables stack vertically in classic Outlook.
    • Body prose needs line-height plus mso-line-height-rule:exactly or the Word engine collapses leading.
    • Edge-to-edge frame: whiten the outer canvas bgcolor and inline CSS (Word engine reads bgcolor).
    • Newsletter masthead: inset hero to the text column + VML fallback width = container − 2×gutter.
    • Delivery: Graph draft preferred, with an Outlook COM fallback when WorkIQ/Graph is unavailable.

Classification / methodology

  • Declined verdict + Copilot precision = Helpful / (Helpful + Incorrect); Declined is neutral and never counted against Copilot.
  • Force-push confound validation before scoring precision (a correct comment on a rewritten snapshot no longer looks like a false positive).
  • Engineer-intention nuance: correct-but-declined feedback is a judgment call, not a Copilot error.
  • New adoption signals: reaction + apply-suggestion detection (silent adoption), merged-only PR filter, Phase 0 preflight coverage audit, review-coverage split, self-consistency gate, and a PR triage table.

Notes

  • The standard .md/.html assets remain structural references (illustrative prior-run data — computed fresh each run).
  • No product code touched; skill/docs only. .gitignore adds sibling clone dirs so they're never committed.

…-signal & fairness methodology, Fixes AB#3696013

Report / rendering:
- v3 newsletter Outlook report: 1200px hybrid-fluid shell, edge-to-edge newsletter masthead (inset hero + 1120px VML), big-number KPI hero grid, single-row meta-chips, Methodology section
- Headline now leads with adoption % (Helpful & adopted), not precision
- Document Outlook rendering learnings in report-formatting.md: single-row chip table (not inline-block), mso-line-height-rule:exactly for prose, edge-to-edge frame (whiten bgcolor AND inline CSS), inset masthead + VML width, Graph-draft delivery with Outlook COM fallback

Classification / methodology:
- Declined verdict + Copilot precision (Helpful / (Helpful + Incorrect)); Declined is neutral
- Force-push confound validation before scoring precision
- Engineer-intention nuance: correct-but-declined feedback is not a Copilot error
- New adoption signals: reaction + apply-suggestion detection, merged-only PR filter, Phase 0 preflight coverage audit, review-coverage split, self-consistency gate, PR triage table

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
@shahzaibj
shahzaibj requested a review from a team as a code owner July 18, 2026 19:33
@github-actions github-actions Bot changed the title Enhance Copilot Review Analyst skill: v3 newsletter report + adoption-signal & fairness methodology Enhance Copilot Review Analyst skill: v3 newsletter report + adoption-signal & fairness methodology, Fixes AB#3696013 Jul 18, 2026
@github-actions

Copy link
Copy Markdown

✅ Work item link check complete. Description contains link AB#3696013 to an Azure Boards work item.

1 similar comment
@github-actions

Copy link
Copy Markdown

✅ Work item link check complete. Description contains link AB#3696013 to an Azure Boards work item.

shahzaibj and others added 5 commits July 18, 2026 13:30
…-signal & fairness methodology, Fixes AB#3696013

Report / rendering:
- v3 newsletter Outlook report: 1200px hybrid-fluid shell, edge-to-edge newsletter masthead (inset hero + 1120px VML), big-number KPI hero grid, single-row meta-chips, Methodology section
- Headline now leads with adoption % (Helpful & adopted), not precision
- Document Outlook rendering learnings in report-formatting.md: single-row chip table (not inline-block), mso-line-height-rule:exactly for prose, edge-to-edge frame (whiten bgcolor AND inline CSS), inset masthead + VML width, Graph-draft delivery with Outlook COM fallback

Classification / methodology:
- Declined verdict + Copilot precision (Helpful / (Helpful + Incorrect)); Declined is neutral
- Force-push confound validation before scoring precision
- Engineer-intention nuance: correct-but-declined feedback is not a Copilot error
- New adoption signals: reaction + apply-suggestion detection, merged-only PR filter, Phase 0 preflight coverage audit, review-coverage split, self-consistency gate, PR triage table

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
…-signal & fairness methodology, Fixes AB#3696013

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
Removes the AuthClientAndroidPipelines and telemetry-platform ignore
entries that were inadvertently carried over from earlier branch work;
they are not part of the copilot-review-analyst skill changes.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant