Support multi-LoRA training with EP + FSDP2#236

Draft

EvineR666 wants to merge 26 commits into

modelscope:mainfrom

kevssim:ep_multilora

Commits on Jun 1, 2026

Commits on Jun 17, 2026

Merge branch 'modelscope:main' into ep_multilora
EvineR666
authored
fix: resolve LoRA parameter injection conflicts and meta-device model build issues
EvineR666
committed
fix: add missing exclude_modules field in PEFT-format LoRA config
EvineR666
committed

Commits on Jun 18, 2026

Commits on Jun 22, 2026

fix: align add_adapter device with base model to prevent distributed hangs
EvineR666
committed

Commits on Jun 25, 2026

perf: optimize EP sharding for target parameters
EvineR666
committed

Commits on Jun 30, 2026

Merge branch 'modelscope:main' into ep_multilora
EvineR666
authored

Commits on Jul 3, 2026