Skip to content

Add LeIsaac + Cosmos + IDM tutorial - #108

Merged
EverNorif merged 9 commits into
LightwheelAI:dev/cosmosfrom
chuchen0210:add-leisaac-cosmos-tutorial
Jan 13, 2026
Merged

EverNorif merged 9 commits into
LightwheelAI:dev/cosmosfrom
chuchen0210:add-leisaac-cosmos-tutorial

Conversation

@chuchen0210

Copy link
Copy Markdown
Contributor

This tutorial extends LeIsaac by integrating Cosmos-Predict2.5 and GR00T-Dreams IDM into a LeIsaac-native data generation loop. LeIsaac is used to collect teleoperated demonstrations (HDF5) and convert them into LeRobot datasets. Cosmos-Predict 2.5 is post-trained on these videos to synthesize additional rollout videos at scale, and IDM is fine-tuned on the same dataset to infer robot actions from the generated videos. Together, this produces a scalable pipeline for constructing synthetic, complete LeRobot datasets , which can be replayed and evaluated directly in LeIsaac.

@chuchen0210
chuchen0210 force-pushed the add-leisaac-cosmos-tutorial branch from f274359 to a21f53e Compare January 7, 2026 04:00
@EverNorif
EverNorif changed the base branch from main to dev/cosmos January 7, 2026 08:19
@EverNorif
EverNorif merged commit 168dc26 into LightwheelAI:dev/cosmos Jan 13, 2026
1 check passed
EverNorif added a commit that referenced this pull request Jan 13, 2026
* Add LeIsaac + Cosmos + IDM tutorial (#108)

* Add LeIsaac + Cosmos + IDM tutorial

* add tutorial doc.

* fix docs.

* Add lerobot2isaaclab converter(feature:cosmos+IDM)

* Update cosmos_tutorial.md

* Update Cosmos tutorial and merge utilities

* Refine lerobot2isaaclab converter and cosmos merge utility

* Apply isort import ordering

* Add LeIsaacXCosmos docs

---------

Co-authored-by: EverNorif <1320346985@qq.com>

* Replace video links in cosmos_tutorial.md

Updated video links in the Cosmos tutorial for accuracy.

---------

Co-authored-by: Yunze Li <167320956+chuchen0210@users.noreply.github.com>
harsh-mulodhia pushed a commit to harsh-mulodhia/leisaac that referenced this pull request Jun 24, 2026
* Add LeIsaac + Cosmos + IDM tutorial (LightwheelAI#108)

* Add LeIsaac + Cosmos + IDM tutorial

* add tutorial doc.

* fix docs.

* Add lerobot2isaaclab converter(feature:cosmos+IDM)

* Update cosmos_tutorial.md

* Update Cosmos tutorial and merge utilities

* Refine lerobot2isaaclab converter and cosmos merge utility

* Apply isort import ordering

* Add LeIsaacXCosmos docs

---------

Co-authored-by: EverNorif <1320346985@qq.com>

* Replace video links in cosmos_tutorial.md

Updated video links in the Cosmos tutorial for accuracy.

---------

Co-authored-by: Yunze Li <167320956+chuchen0210@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants