Skip to content

feat: add PyRoKI differentiable IK backend - #484

Open
gonzalocasas wants to merge 2 commits into
docs/migrate-contributing-to-mkdocsfrom
feature/pyroki-backend
Open

feat: add PyRoKI differentiable IK backend#484
gonzalocasas wants to merge 2 commits into
docs/migrate-contributing-to-mkdocsfrom
feature/pyroki-backend

Conversation

@gonzalocasas

Copy link
Copy Markdown
Member

This is a bit experimental, but so far, seems to work very well.

Added a new backend for differentiable IK using PyRoki

The experimental part comes mostly from the fact that PyRoki hasn't published a proper pypi release yet (hopefully, we'll solve that soon)

What type of change is this?

  • Bug fix in a backwards-compatible manner.
  • New feature in a backwards-compatible manner.
  • Breaking change: bug fix or new feature that involve incompatible API changes.
  • Other (e.g. doc update, configuration, etc)

Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code.

  • I added a line to the CHANGELOG.md file in the Unreleased section under the most fitting heading (e.g. Added, Changed, Removed).
  • I ran all tests on my computer and it's all green (i.e. invoke test).
  • I ran lint on my computer and there are no errors (i.e. invoke lint).
  • I added new functions/classes and made them available on a second-level import, e.g. compas_fab.robots.CollisionMesh.
  • I have added tests that prove my fix is effective or that my feature works.
  • I have added necessary documentation (if appropriate)

Add collision-aware FrameTarget and PointAxisTarget IK with direct COMPAS model conversion, planning-group support, and warm problem caching. Package the pinned optional dependency, exercise it in Python 3.12 CI, add integration coverage and backend examples, and migrate the contributor guide into MkDocs.
@gonzalocasas

gonzalocasas commented Aug 27, 2026

Copy link
Copy Markdown
Member Author

Servoing a Panda robot model with the keyboard and streaming IK configs to Rhino/GH using compas_eve:

Screenshare.-.2026-08-27.3_24_05.PM.mp4

@gonzalocasas

Copy link
Copy Markdown
Member Author

A substantially more complex robot model:

diff-ik-chase-plane-rfl.mp4

@gonzalocasas
gonzalocasas requested a review from yijiangh August 28, 2026 06:43
@gonzalocasas

Copy link
Copy Markdown
Member Author

/cc @jf---

@yijiangh

Copy link
Copy Markdown
Contributor

A substantially more complex robot model:

diff-ik-chase-plane-rfl.mp4

Woah! Are you also streaming the gradient descent steps before converging, which explains the "motion" between the current conf and the target? Or it's just the IK is taking time to solve and lag behind?

Will review after I come back from ROBARCH!

@gonzalocasas

Copy link
Copy Markdown
Member Author

Woah! Are you also streaming the gradient descent steps before converging, which explains the "motion" between the current conf and the target? Or it's just the IK is taking time to solve and lag behind?

Will review after I come back from ROBARCH!

It's proper velocity chase, not IK lagging behind, IK for the full group (9DOF) is about 12ms on my machine, so a little background thread is constantly recomputing new solutions to approach/converge to the target. All in-process in Rhino 9 because PyRoki needs python >= 3.10

@jf---

jf--- commented Aug 28, 2026

Copy link
Copy Markdown

amazing how external axises and the manipulator work perfectly in tandem -- stellar, congrats @gonzalocasas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants