Skip to content

Add a Learning Path for teaching an SO-101 robot arm a pick-and-place task - #3536

Open
mitsunami wants to merge 3 commits into
ArmDeveloperEcosystem:mainfrom
mitsunami:lp-smolvla-lerobot
Open

Add a Learning Path for teaching an SO-101 robot arm a pick-and-place task#3536
mitsunami wants to merge 3 commits into
ArmDeveloperEcosystem:mainfrom
mitsunami:lp-smolvla-lerobot

Conversation

@mitsunami

Copy link
Copy Markdown
Contributor

Before submitting a pull request for a new Learning Path, please review Create a Learning Path

  • I have reviewed Create a Learning Path

Please do not include any confidential information in your contribution. This includes confidential microarchitecture details and unannounced product information.

  • I have checked my contribution for confidential information

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the Creative Commons Attribution 4.0 International License.


What this PR adds

This Learning Path shows developers how to:

  • Connect and calibrate an SO-101 robot arm and two cameras.
  • Record examples of a pick-and-place task with Hugging Face's LeRobot library.
  • Use those examples to train SmolVLA, a visual-language-action model from Hugging Face.
  • Run the trained model on the robot and evaluate the results.
  • These workflow is executed on DGX Spark

Unlike most software-only Learning Paths, completing this tutorial requires physical robot hardware.

This PR also removes a duplicate name from assets/contributors.csv.

I would appreciate a review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant