Skip to content

Support local dataset file paths#1747

Merged
anth-volk merged 2 commits into
mainfrom
codex/support-local-h5-datasets
Jun 2, 2026
Merged

Support local dataset file paths#1747
anth-volk merged 2 commits into
mainfrom
codex/support-local-h5-datasets

Conversation

@anth-volk
Copy link
Copy Markdown
Collaborator

Fixes #1746

Summary

  • Route string and PathLike dataset sources through explicit dataset-source handling.
  • Preserve hf:// dataset URL behavior while allowing local dataset files to use existing UK H5 schema loading.
  • Add focused tests for local path routing, HF URL routing, unsupported remote URL errors, and local multi-year dataset loading.

Tests

  • uv run pytest policyengine_uk/tests/test_simulation_dataset_sources.py -q
  • uv run ruff check policyengine_uk/simulation.py policyengine_uk/tests/test_simulation_dataset_sources.py

@anth-volk anth-volk marked this pull request as ready for review June 2, 2026 14:10
@anth-volk anth-volk requested a review from vahid-ahmadi June 2, 2026 14:10
@anth-volk anth-volk merged commit d65109e into main Jun 2, 2026
9 checks passed
@anth-volk anth-volk deleted the codex/support-local-h5-datasets branch June 2, 2026 14:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support local dataset file paths in UK simulations

1 participant