Skip to content

is keyboard teleop possible #53

Description

@rabhishek100
No description provided.

Activity

  1. PiotrBieszczad commented on Oct 5, 2025

    @PiotrBieszczad

    You can implement it by adding and correctly configuring DifferentialIKActionCfg inside action_process.py.

    Than you also need to change the mapping in se3_keyboard.py, so that you can send relative end-effector control commands.

    That allows you to have w/a/s/d as xy coordinates, q/e as z coordinate, and you can put gripper at e.g j/k. (For simplicity I only had fixed rotation).

    Good luck. If I have more time this week, I may help out some more.

  2. EverNorif commented on Oct 6, 2025

    @EverNorif
    Collaborator

    @rabhishek100 Yes, we provide a way to control lerobot with keyboard input. However, currently, only the mapping between keyboard keys and joint positions is supported. Do you mean that controlling with the keyboard is currently a bit difficult?

  3. rabhishek100 commented on Oct 6, 2025

    @rabhishek100
    Author

    I thought only leader arm teleop was possible. Will try it out and report back. Thanks!

  4. rabhishek100 commented on Oct 6, 2025

    @rabhishek100
    Author

    Tested it out, the keyboard teleop with the different keys for different joints is very unintuitive

  5. EverNorif commented on Oct 7, 2025

    @EverNorif
    Collaborator

    @rabhishek100 This is indeed a known problem. We recommend using so101-leader for teleoperation. However, we will also work on improving the keyboard-based teleoperation in the future.

  6. EverNorif commented on Nov 26, 2025

    @EverNorif
    Collaborator

    Hi @rabhishek100 , we have made some improvements to keyboard control. You can try it by following the instruction manual. Although it’s still somewhat challenging to operate, it’s much more intuitive than controlling each joint individually.

  7. rabhishek100 commented on Dec 1, 2025

    @rabhishek100
    Author

    Thanks! Will do!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions