CV mapping with Depth Camera

[kbabilinski]

Regarding the Pose:

When using the MLSDK APIs with OpenXR , you will need to set the App into Unbounded tracking space. As mentioned here : MLCamera | MagicLeap Developer Documentation

This is because the MLSDK returns a Pose in a diferent space which is the equivalent of OpenXR’s unbounded.

---

Regarding the Depth Camera API:

Please note, the MLSDK API (MLDepthCamera) has been deprecated in favor of the OpenXR Magic Leap Pixel Sensor API. This means that the API will not receive updates and is no longer supported. That said, here is an old post regarding the ML Depth Camera:

Processing the depth frames

Here is a script that sends an array of world points to a "point cloud renderer" . I have not included the point cloud renderer code but the script should be enough to demonstrate how to obtain the undistorted depth data. A few things to note. You may want to check if the depth point falls into the user's field of view and exclude any depth points that are not visible. This will ensure that the depth image aligns to the world more closely. Although, the point cloud is undistorted, some skewing …