Skip to content

Support to read chain data split#387

Open
Weixin-Xu wants to merge 1 commit into
alibaba:mainfrom
Weixin-Xu:support_chain_table_oss
Open

Support to read chain data split#387
Weixin-Xu wants to merge 1 commit into
alibaba:mainfrom
Weixin-Xu:support_chain_table_oss

Conversation

@Weixin-Xu

Copy link
Copy Markdown

Purpose

Linked issue: close #385

Support deserializing and reading ChainDataSplit.

This change adds ChainDataSplit handling on top of DataSplit deserialization, including:

  • reading ChainDataSplit tail metadata after DataSplit bytes
  • supporting per-file bucket path mapping when building data file paths
  • preserving normal DataSplit / FallbackDataSplit behavior
  • supporting the observed version 7 DataSplit metadata layout needed by chain split bytes

Tests

  • Added ChainDataSplitTest
    • deserialize ChainDataSplit tail
    • deserialize version 7 split with original bucket path and chain tail
    • verify per-file bucket path resolution
    • verify external path is preserved
    • verify malformed ChainDataSplit tail returns contextual error

API and Format

Documentation

No user-facing documentation update.

Generative AI tooling

Generated-by: OpenAI Codex

@CLAassistant

CLAassistant commented Jun 29, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@Weixin-Xu Weixin-Xu changed the title Support chain data split Support to read chain data split Jun 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] Chain Table read failure

2 participants