feat(audio-cpp): add ROCm backend image - #11578
Open
localai-org-maint-bot wants to merge 4 commits into
Open
Conversation
localai-org-maint-bot
force-pushed
the
feat/audio-cpp-rocm
branch
from
August 19, 2026 09:05
7032d6c to
5bac8f9
Compare
The pinned audio.cpp revision supports HIP, but LocalAI neither builds a ROCm image nor accepts its backend option. AMD hosts therefore fall back to the CPU image. Build and publish the HIP variant, connect it to AMD capability selection, and accept both upstream HIP names. Assisted-by: Codex:gpt-5
The ROCm builder lacks the CMake package metadata that ggml requires. Install the development package only for hipBLAS builds. Assisted-by: Codex:gpt-5
audio.cpp forwards GPU_TARGETS to CMake as a semicolon-delimited list. The comma-delimited LocalAI value was treated as one invalid HIP architecture during configuration. Assisted-by: Codex:gpt-5.6-sol
localai-org-maint-bot
force-pushed
the
feat/audio-cpp-rocm
branch
from
August 19, 2026 15:04
5bac8f9 to
bcd5f57
Compare
The HIP build reaches ggml configuration and requires the rocBLAS CMake package. Install its development package with the existing hipBLAS dependency. Assisted-by: Codex:gpt-5
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This PR adds a Linux amd64 ROCm 7.2 image for the audio.cpp backend and connects AMD capability selection to it. The backend wrapper now accepts both
backend:hipand the upstreambackend:rocmalias.The pinned audio.cpp revision introduced HIP support, but LocalAI still documented and enforced the previous no-HIP state. The matrix, gallery metadata, runtime option mapping, and user documentation now describe the same supported variant.
Closes #11577
Notes for Reviewers
Verified with:
g++ -std=c++17 -Wall -Wextra -Ibackend/cpp/audio-cpp backend/cpp/audio-cpp/model_options_test.cpp ...go test ./core/gallery -run TestGallery -ginkgo.focus "audio.cpp ROCm image" -count=1node --test scripts/lib/backend-filter_test.mjs(41 passing)make -n -C backend/cpp/audio-cpp BUILD_TYPE=hipblas grpc-serverand assertions for the HIP flagsgit diff --checkI did not run the full ROCm Docker build locally. The backend matrix runs that long build in CI. The broad
make test-backend-cppharness could not fetch its nlohmann header because this environment blocked the external download; the changed standalone test was compiled and run directly.Signed commits