Glm 4.7 sft ms-swift

[pawalt]

This PR introduces a new example demonstrating Supervised Fine-Tuning (SFT) of the GLM-4.7 model using ms-swift on Modal. It mirrors the existing Megatron SFT example by utilizing the donmaclean/LongMIT-128K dataset and replicating its data preparation and prompt formatting logic.

Checklist

• Example is documented with comments throughout, in a Literate Programming style.
• Example does not require third-party dependencies to be installed locally
• Example follows the style guide
• Example pins its dependencies
  • Example pins container images to a stable tag, not a dynamic tag like latest
  • Example specifies a python_version for the base image, if it is used (via nvcr.io/nvidia/pytorch:23.10-py3)
  • Example pins all dependencies to at least minor version, ~=x.y.z or ==x.y
  • Example dependencies with version < 1 are pinned to patch version, ==0.y.z

(Modal's internal guide page for this repo is Multi-node examples guidance.)

Outside contributors

You're great! Thanks for your contribution.

---

 

[cursor]

Cursor Agent can help with this pull request. Just @cursor in comments and I'll start working on changes in this branch.
_{Learn more about Cursor Agents}