Skip to content

CI Fix - Athena CI Failing Sometimes #5971

Description

@cmgoffena13

AI Notes

Link: https://github.com/SQLMesh/sqlmesh/actions/runs/32524629055/job/96906313004

Failing test
tests/core/engine_adapter/integration/test_integration_athena.py::test_clear_partition_data

What’s Wrong
Test assumes the S3 folder starts empty. A earlier attempt already wrote files there (plan failed with src_table not found — typical Athena/Glue lag), Hive DROP TABLE does not delete S3 files, and the rerun hits leftover objects → assert 3 == 0. This is a flaky/cleanup test issue, not clear-partition logic itself.

Possible Fix
In test_integration_athena.py: clear the S3 prefix at the start (or on teardown/retry) instead of requiring it empty. Optionally wait/retry until src_table is visible after CTAS before planning.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions