Is there a demo showing how to use OmniLensDistortionLutAPI to simulate a camera?

[0oook]

How to use OmniLensDistortionLutAPI to simulate a camera?

[identity-wael]

NVIDIA has a texture-generation example in the OmniLensDistortionLutAPI section of the renderer camera docs. It describes the two floating-point EXR lookup tables and includes a sample script:

• rayEnterDirectionTexture: image coordinates → camera-space ray direction (RGB).
• rayExitPositionTexture: octahedrally encoded direction → image coordinates (RG).

These are calibration lookup tables, so an ordinary image or a single distortion map is not sufficient.

Before implementing it, check your Isaac Sim version: the Isaac Sim 6.0 camera documentation explicitly warns that applying OmniLensDistortionLutAPI currently falls back to pinhole rendering in that release. It recommends the deprecated RTX Camera Projection Attributes for arbitrary distortion as a workaround. The renderer example alone therefore isn't confirmation that it works in a particular Isaac Sim build.

Which Isaac Sim version are you using, and do you need an arbitrary measured LUT, or would an OpenCV pinhole/fisheye calibration model cover your camera?

[hawkeyeking]

@0oook Does this answer your question, or do you need more help?

[hawkeyeking]

Hello!

We noticed that this topic hasn’t received any recent updates from anyone reporting this issue, so we are closing it for now to help keep the forum organized.

If you are still experiencing this issue or have related questions, please create a GitHub Discussion or Issue in the Isaac Sim repository and include a link to this topic along with updated details. Mentioning or linking to this original topic provides helpful context and makes it easier for others to assist you.

Thank you for being part of the NVIDIA Isaac Sim community.

Best regards,
The NVIDIA Isaac Sim Forum Team