Skip to content

Public Isaac Sim 6.0 missing isaacsim.kit.xr.teleop.bridge required by IsaacLab 3 / IsaacTeleop XR #623

@lylechan42

Description

@lylechan42

Description

Description

When running IsaacLab 3 / IsaacTeleop 1.x live XR teleoperation with public pip Isaac Sim 6.0, the required Kit extension isaacsim.kit.xr.teleop.bridge cannot be resolved from the installed extscache or public extension registries.

The app can initialize and the GR1T2 teleop environment can be created, but the IsaacTeleop XR session fails when trying to acquire OpenXR handles. isaaclab_teleop expects the bridge to polyfill missing omni.kit.xr.system.openxr APIs, including get_instance_proc_addr().

Steps to Reproduce

Environment:

isaacsim==6.0.0.0
isaacsim-extscache-kit==6.0.0.0
isaacsim-extscache-physics==6.0.0.0
IsaacLab commit cfdbe71e96a5bc0e2321b45c69319e38162bf277
isaaclab_teleop==0.3.6
isaacteleop==1.2.107rc1
Python 3.12
Ubuntu 24.04
NVIDIA RTX 4090
Driver 590.48.01
nvidia-smi CUDA version 13.1
PyTorch 2.10.0+cu128

Run:

cd ~/IsaacLab-cfdbe71
source env_isaaclab/bin/activate

./isaaclab.sh -p scripts/environments/teleoperation/teleop_se3_agent.py \
    --task Isaac-PickPlace-GR1T2-WaistEnabled-Abs-v0 \
    --visualizer kit \
    --device cuda:0 \
    --xr

Expected

The public Isaac Sim 6.0 package, extscache, or public extension registry should provide isaacsim.kit.xr.teleop.bridge, or the documentation should state which public Isaac Sim build/container/registry is required for IsaacLab 3 + IsaacTeleop 1.x live XR teleoperation.

Actual

The bridge extension cannot be resolved:

Failed to resolve extension dependencies. Failure hints:
  * No versions of isaacsim.kit.xr.teleop.bridge that satisfies: [enable list] depends on isaacsim.kit.xr.teleop.bridge version *
    - Available packages for isaacsim.kit.xr.teleop.bridge version *:
      (none found)

Then IsaacTeleop crashes:

AttributeError: module 'omni.kit.xr.system.openxr' has no attribute 'get_instance_proc_addr'

The relevant IsaacLab 3 kit file enables the bridge:

xr.openxr.components."isaacsim.kit.xr.teleop.bridge".enabled = true

isaaclab_teleop also enables it directly:

ext_manager.set_extension_enabled_immediate("isaacsim.kit.xr.teleop.bridge", True)

And session_lifecycle.py documents that importing the bridge performs the required OpenXR polyfill:

# Importing bridge also performs polyfill of missing omni.kit.xr.system.openxr functions.
import isaacsim.kit.xr.teleop.bridge as bridge

Related

Question

Is isaacsim.kit.xr.teleop.bridge planned for a public Isaac Sim 6.0.x release? If yes, when should users expect a public pip package, NGC container, or extension registry update that includes it? If it is not planned for public Isaac Sim 6.0.x, what is the supported public Isaac Sim distribution path and expected timeline for IsaacLab 3 + IsaacTeleop 1.x live XR teleoperation?

Isaac Sim version

6.0.0

Operating System (OS)

Ubuntu 24.04

GPU Name

RTX 4090

GPU Driver and CUDA versions

Driver: 590.48.01, CUDA: 12.8

Logs

No response

Additional information

No response

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions