Weight Processing Bugs for larger models (GPT OSS, Gemma3 Multimodal, Phi 3)#1224

Merged

jlarson4 merged 3 commits intodev-3.x-canaryfrom

weight-processing/large-model-bugs

Mar 30, 2026

Commits on Mar 27, 2026

Fix small flaws in the updated position embeddings attention, and bugs introduced into Hookedtransformer by transformers v5
jlarson4
committed
Gemma3 & base Gemma weight processing bug fixes
jlarson4
committed

Commits on Mar 30, 2026

Additional weight processing bug fixes for Mistral and Phi3
jlarson4
committed