# Setting up the MLDepthcamera on Unity SDK 2.0.0?

**URL:** <https://forum.magicleap.cloud/t/setting-up-the-mldepthcamera-on-unity-sdk-2-0-0/3161>\
**Category:** Unity Development\
**Tags:** unity, depth-camera\
**Created:** [February 9, 2024, 5:07pm UTC](https://forum.magicleap.cloud/t/setting-up-the-mldepthcamera-on-unity-sdk-2-0-0/3161 "2024-02-09T17:07:24Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![annabelgroenenberg](https://avatars.discourse-cdn.com/v4/letter/a/edb3f5/32.png) [@annabelgroenenberg](https://forum.magicleap.cloud/u/annabelgroenenberg)\
**Post date:** [February 9, 2024, 5:07pm UTC](https://forum.magicleap.cloud/t/setting-up-the-mldepthcamera-on-unity-sdk-2-0-0/3161/1 "2024-02-09T17:07:24Z")

</div>

Give us as much detail as possible regarding the issue you're experiencing:

**Unity Editor version** : 2022.3.17f1  
**ML2 OS version** :1.5.0  
**Unity SDK version** :2.0.0  
**Host OS** : Windows

Hi, I can't find any examples on how to enable the MLDepthCamera with the new Unity SDK. The documentation is quite limited on how to set the settings. How do I set the `CaptureFlags`, the `Framerate` and the list `StreamConfig[]`? Next to this, where do I find the appropriate timeout setting for the function `GetLatestDepthData?` Or do I just wing it? I currently have 'depthResult = MLDepthCamera.GetLatestDepthData(5000, out MLDepthCamera.Data DepthData); '

Thanks in advance!

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [February 9, 2024, 6:38pm UTC](https://forum.magicleap.cloud/t/setting-up-the-mldepthcamera-on-unity-sdk-2-0-0/3161/2 "2024-02-09T18:38:26Z")

</div>

I recommend downloading the 1.12.0 Unity SDK examples. This example project demonstrates how to access the depth camera. Note that if you want to get the depth point from the image returned by the Depth camera you will need to combine the distance image and the depth flags to get the depth pixel's validity.

You will also have to undistort the image (pin hole camera) using the intrinsic values and then convert the distance (range) pixel into a depth depth pixel using. Somthing like

```auto
point = normalize([(x-cx)/fx, (y-cy)/fy]) * distance

```

float fx = intrinsics.focal\_point\_x;  
float fy = intrinsics.focal\_point\_y;  
float cx = intrinsics.principal\_point\_x;  
float cy = intrinsics.principal\_point\_y;

---

<div class="post-metadata">

**Author:** ![annabelgroenenberg](https://avatars.discourse-cdn.com/v4/letter/a/edb3f5/32.png) [@annabelgroenenberg](https://forum.magicleap.cloud/u/annabelgroenenberg)\
**Post date:** [February 16, 2024, 1:11pm UTC](https://forum.magicleap.cloud/t/setting-up-the-mldepthcamera-on-unity-sdk-2-0-0/3161/3 "2024-02-16T13:11:17Z")

</div>

Thank you, I got it to work! Now I just have another question. I'd like to stream this or download the depth image to a desktop with Magicleap WebRTC. Th examples just show how to do that with the `MLCamera`. This does not seem to be applicable to the depth sensor, since the `connectContext` property does not exist for the `MLDepthCamera`, and neither does the `CreateAndConnectAsync()` function. Do you have any advice on how to set up a stream for the `MLDepthCamera`? Thanks!

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [February 19, 2024, 9:38pm UTC](https://forum.magicleap.cloud/t/setting-up-the-mldepthcamera-on-unity-sdk-2-0-0/3161/4 "2024-02-19T21:38:27Z")

</div>

I recommend using the Unity WebRTC plugin as the Magic Leap WebRTC APIs are deprecated and will be removed in a future version of the SDK. The Unity WebRTC plugin provides a more flexible API that allows you to stream custom images more easily. That said, the Unity Community or the Unity WebRTC Github page might be a better place to get details on how to stream a custom texture.