Skip to content

Add meta-store routing for topsql deltalake sink#78

Open
zeminzhou wants to merge 1 commit into0.49from
codex/topsql-meta-store-path
Open

Add meta-store routing for topsql deltalake sink#78
zeminzhou wants to merge 1 commit into0.49from
codex/topsql-meta-store-path

Conversation

@zeminzhou
Copy link
Collaborator

Summary

  • add meta_store_addr to topsql_data_deltalake sink config
  • resolve keyspace metadata from meta-store and cache org and cluster routing info
  • write TopSQL DeltaLake data under org={org}/cluster={cluster} path segments when keyspace metadata is available
  • keep the existing path layout as fallback when keyspace metadata cannot be resolved

Testing

  • cargo check
  • cargo test --lib common::meta_store::tests::resolve_keyspace_uses_tenant_as_org_id_and_caches_result -- --exact
  • cargo test --lib build_table_path -- --nocapture

@pingcap-cla-assistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@ti-chi-bot ti-chi-bot bot added the size/XXL label Mar 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant