[flink][spark] Support dry_run in compact_manifest procedure#8375

Open

XiaoHongbo-Hope wants to merge 13 commits into

apache:masterfrom

XiaoHongbo-Hope:manifest_compact_dryrun

Commits on Jun 28, 2026

[flink][spark] Support dry_run in compact_manifest procedure
XiaoHongbo-Hope
committed
[core][flink][spark] Extract dry_run logic, fix Spark output type compatibility, add test
XiaoHongbo-Hope
committed
[core] Make dry_run zero-IO: compute stats from manifest metadata only
XiaoHongbo-Hope
committed
[flink] Fix dry_run test assertion to match actual output format
XiaoHongbo-Hope
committed
[core] Align dry_run with tryFullCompaction trigger logic
XiaoHongbo-Hope
committed
[spark] Remove unnecessary Thread.sleep in dry_run test
XiaoHongbo-Hope
committed
[core] Remove wouldTrigger prediction, report only facts
XiaoHongbo-Hope
committed
[core][spark] Neutral dry_run wording, keep Spark OUTPUT_TYPE unchanged, add Spark test
XiaoHongbo-Hope
committed
[docs] Document dry_run parameter for compact_manifest procedure
XiaoHongbo-Hope
committed
[core] Rewrite oversized manifest files during full compaction
XiaoHongbo-Hope
committed
[core] Use Math.max(2 * targetSize, 16MB) as oversized threshold
XiaoHongbo-Hope
committed
Revert "[core] Use Math.max(2 * targetSize, 16MB) as oversized threshold"
XiaoHongbo-Hope
committed
Revert "[core] Rewrite oversized manifest files during full compaction"
XiaoHongbo-Hope
committed