Skip to content

chore: Python CUDA bridge: CI and buffer handoff ABI#8618

Merged
0ax1 merged 1 commit into
developfrom
ad/pycudf3
Jun 29, 2026
Merged

chore: Python CUDA bridge: CI and buffer handoff ABI#8618
0ax1 merged 1 commit into
developfrom
ad/pycudf3

Conversation

@0ax1

@0ax1 0ax1 commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

CI coverage for the Python CUDA bridge through the vortex-data[cuda] optional-extra path.

Extend the private metadata bridge to carry host buffer-export capsules instead of only a buffer count. The base Python package exports repr(C) VortexBufferExport descriptors, and vortex-python-cuda imports them into local BufferHandles before deserializing arrays through its own VortexSession.

Tests now cover primitive, nullable, bool, and struct arrays across the bridge, plus the existing CUDA Arrow Device smoke path.

@0ax1 0ax1 changed the title Add Python CUDA bridge CI and buffer handoff ABI chore: Add Python CUDA bridge CI and buffer handoff ABI Jun 29, 2026
@0ax1 0ax1 changed the title chore: Add Python CUDA bridge CI and buffer handoff ABI chore: Python CUDA bridge CI and buffer handoff ABI Jun 29, 2026
@0ax1 0ax1 added the changelog/chore A trivial change label Jun 29, 2026
@0ax1 0ax1 requested a review from AdamGS June 29, 2026 10:46
@0ax1 0ax1 changed the title chore: Python CUDA bridge CI and buffer handoff ABI chore: Python CUDA bridge: CI and buffer handoff ABI Jun 29, 2026
@codspeed-hq

codspeed-hq Bot commented Jun 29, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 4 improved benchmarks
❌ 1 regressed benchmark
✅ 1590 untouched benchmarks
⏩ 4 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_into_canonical[(1000, 10)] 169 µs 205.6 µs -17.79%
Simulation chunked_varbinview_canonical_into[(100, 100)] 259.4 µs 224.3 µs +15.65%
Simulation chunked_varbinview_into_canonical[(100, 100)] 306.7 µs 271.4 µs +13%
Simulation bitwise_not_vortex_buffer_mut[128] 273.6 ns 244.4 ns +11.93%
Simulation eq_i64_constant 319.3 µs 289.4 µs +10.32%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ad/pycudf3 (98966bf) with develop (2a15a9f)

Open in CodSpeed

Footnotes

  1. 4 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@0ax1 0ax1 force-pushed the ad/pycudf3 branch 2 times, most recently from ac4165b to 59fb909 Compare June 29, 2026 11:11
@0ax1 0ax1 marked this pull request as ready for review June 29, 2026 11:26
@0ax1 0ax1 requested review from a team and robert3005 June 29, 2026 11:26
@0ax1 0ax1 enabled auto-merge (squash) June 29, 2026 11:27
Comment thread .github/workflows/ci.yml Outdated
Comment thread .github/workflows/ci.yml
Comment thread vortex-python/src/arrays/mod.rs Outdated
Comment thread vortex-python-cuda/src/lib.rs Outdated
Comment thread vortex-python-cuda/src/lib.rs Outdated
@0ax1 0ax1 force-pushed the ad/pycudf3 branch 2 times, most recently from f2bb115 to f9cf177 Compare June 29, 2026 15:24
@0ax1

0ax1 commented Jun 29, 2026

Copy link
Copy Markdown
Contributor Author

@claude review in depth

@github-actions

Copy link
Copy Markdown
Contributor

Claude review automation is disabled for pull requests that modify .github/ files.

Why:

  • workflow and action files are part of the automation policy
  • this review workflow refuses to evaluate automation changes from the same PR

Ask a human reviewer to inspect workflow changes directly.

Add explicit GPU-runner CI coverage for the Python CUDA bridge through
the vortex-data[cuda] optional-extra path.

Extend the private metadata bridge to carry host buffer-export capsules
instead of only a buffer count. The base Python package exports repr(C)
VortexBufferExport descriptors, and vortex-python-cuda imports them into
local BufferHandles before deserializing arrays through its own
VortexSession.

Tests now cover primitive, nullable, bool, and struct arrays across the
bridge, plus the existing CUDA Arrow Device smoke path.

Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 requested review from AdamGS and robert3005 June 29, 2026 15:47
@0ax1 0ax1 merged commit 79c6b0f into develop Jun 29, 2026
72 checks passed
@0ax1 0ax1 deleted the ad/pycudf3 branch June 29, 2026 15:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants