Skip to content

Add SQL test triage guide and focused test rerun make targets#56

Merged
seanwevans merged 2 commits into
mainfrom
codex/add-testing-triage-documentation-and-helpers
May 20, 2026
Merged

Add SQL test triage guide and focused test rerun make targets#56
seanwevans merged 2 commits into
mainfrom
codex/add-testing-triage-documentation-and-helpers

Conversation

@seanwevans
Copy link
Copy Markdown
Owner

Motivation

  • Provide a documented, repeatable workflow for capturing and triaging the first failing SQL test to reduce noise and speed root-cause analysis.
  • Make it easy to run a single SQL test file or print the ordered test list to shorten the local debug loop and avoid full-suite runs during investigation.
  • Enforce per-failure artifacts (root-cause note, fix commit, regression assertion) and a post-fix checklist to prevent cross-test state leakage and track recurring failure signatures until resolved.

Description

  • Added docs/test-triage.md with sections for capturing the first failing test, how to rerun a single SQL test file, failure classification (logic bug, migration drift, env/setup, nondeterminism), required artifacts per failure, a post-fix isolation checklist, and a small known-failures tracking table.
  • Updated makefile to add focused test helpers: test-one (run one SQL test via TEST=...), test-one-verbose (verbose single-file run), and test-list (print the ordered TESTS list), and expanded .PHONY accordingly while preserving the existing test target.
  • Fixed a makefile formatting/continuation issue encountered while inserting the new targets so the test-list recipe prints $(TESTS) correctly when invoked.

Testing

  • Validated makefile formatting iteratively (fixed an initial missing-separator/tab issue), and confirmed the test-list recipe is present and prints the TESTS list when the environment provides PGXS.
  • Ran make test-list in the current environment which failed because the host is missing the PostgreSQL PGXS include (/usr/lib/postgresql/16/lib/pgxs/src/makefiles/pgxs.mk), so full make invocation could not be executed here.
  • No automated SQL test-suite runs were performed in this environment because the required PostgreSQL build infrastructure was unavailable.

Codex Task

@seanwevans seanwevans merged commit e923e2c into main May 20, 2026
@seanwevans seanwevans deleted the codex/add-testing-triage-documentation-and-helpers branch May 20, 2026 15:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant