Skip to content

RFC for the MIOpen-hipDNN shim.#7388

Draft
NolanHannaAMD wants to merge 5 commits into
developfrom
users/nhanna/miopen-hipdnn-shim-rfc
Draft

RFC for the MIOpen-hipDNN shim.#7388
NolanHannaAMD wants to merge 5 commits into
developfrom
users/nhanna/miopen-hipdnn-shim-rfc

Conversation

@NolanHannaAMD
Copy link
Copy Markdown
Contributor

Motivation

Frameworks like PyTorch, TensorFlow, ONNX Runtime, and JAX/XLA already have substantial integration with MIOpen — call sites, tuning DBs, build infrastructure, CI coverage. There is external pushback against going all-in on a hipDNN backend at this juncture: the migration work for those framework teams is non-trivial, the timing is bad for several of them, and hipDNN is still maturing. At the same time, we want MIOpen consumers to start benefiting from hipDNN's engine ecosystem (performance work, fusion graphs, new architectures) without waiting for that migration. A forwarding wrapper lets us route selected calls through hipDNN behind the existing MIOpen API, decoupling the rollout of hipDNN-backed execution from any framework-side rework.

@NolanHannaAMD NolanHannaAMD self-assigned this May 12, 2026
@NolanHannaAMD NolanHannaAMD requested review from a team as code owners May 12, 2026 23:39
@NolanHannaAMD NolanHannaAMD marked this pull request as draft May 12, 2026 23:39
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md Outdated
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md Outdated
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md Outdated
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md Outdated
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md Outdated
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md Outdated
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md
Comment thread projects/miopen/docs/rfcs/0001_HipdnnForwardingWrapper.md

## 4. Proposed Design

### 4.1 Build-time feature flag
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would we want to consider a dynamic run-time flag for switching behaviours? This would probably allow for easier testing, and would allow the customer to revert back to the pre-shim behaviour just in case they hit an issue after we switched over to routing the MIOpen api to hipDNN.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, we have been discussing that and will likely modify the RFC to reflect this plan after investigations are complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants