# Device Video Capture

**URL:** <https://forum.magicleap.cloud/t/device-video-capture/3199>\
**Category:** General\
**Tags:** mr-capture\
**Created:** [February 20, 2024, 10:59am UTC](https://forum.magicleap.cloud/t/device-video-capture/3199 "2024-02-20T10:59:58Z")\
**Posts on this page:** 14\
**Page:** 1

<div class="post-metadata">

**Author:** ![maks](https://avatars.discourse-cdn.com/v4/letter/m/96bed5/32.png) [@maks](https://forum.magicleap.cloud/u/maks)\
**Post date:** [February 20, 2024, 10:59am UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/1 "2024-02-20T10:59:58Z")

</div>

Hi there. I've been having this issue for a long time now and with the latest 1.5 update it didn't get fixed.  
When capturing video the virtual content isn't aligned with the reality as it is for the user. In provided video the blue outlines are shifted a lot from the square holes in the wall when for the user looking through the glasses the are perfectly aligned. Any fix for that?

[![](https://us1.discourse-cdn.com/flex019/uploads/magicleap1/original/2X/7/771f3f0939f5377f2f7ca644528b87955c562c34.jpeg "ML2 Capture misalignment") ](https://www.youtube.com/watch?v=i1v0nyCXUU4)

---

<div class="post-metadata">

**Author:** ![etucker](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/etucker/32/842_2.png) [@etucker](https://forum.magicleap.cloud/u/etucker)\
**Post date:** [February 20, 2024, 8:44pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/2 "2024-02-20T20:44:23Z")

</div>

Hi @maks,

Thank you for reaching out regarding this question. Check out [this solution](https://forum.magicleap.cloud/t/mixed-reality-camera-stream/1654/2). It may point you in the right direction.

Let me know if you have any further questions.

Best,

El

---

<div class="post-metadata">

**Author:** ![stradiot95](https://avatars.discourse-cdn.com/v4/letter/s/3be4f8/32.png) [@stradiot95](https://forum.magicleap.cloud/u/stradiot95)\
**Post date:** [February 22, 2024, 11:47am UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/3 "2024-02-22T11:47:01Z")

</div>

It is something which affects the device from the start. It is a common problem of various OST-HMD since generally is taken the image rendered for the left eye and super imposed to the RGB image from the RGB camera. This result obviously in misalignment, the solution would be an additional rendering pass which renders hologram for the RGB camera perspective. Hololens 2 has solved this issue but it is not clear how (to me), in the sense that i have to understand if the fix come from the MRTK, from OpenXR or from Vuforia Image Tracking. The latter i think can be excluded, but the first time it was solved was from a Vuforia Forum thread.  
It could be a useful feature the possibility to enable/disable this additional rendering pass for the RGB camera perspective. Obviously it will have some performance drawbacks, but i think that it could be possible for not so performance hungry applications. Moreover could be a nice feature even to integrate with Remote Rendering, since in that case the gpu performance issue should be limited.

---

<div class="post-metadata">

**Author:** ![maks](https://avatars.discourse-cdn.com/v4/letter/m/96bed5/32.png) [@maks](https://forum.magicleap.cloud/u/maks)\
**Post date:** [February 22, 2024, 1:51pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/4 "2024-02-22T13:51:26Z")

</div>

Yeah, I've tried this convergence point solution, but it didn't work for me and on top it introduced some instability to the virtual image — sometimes it just jumps.

Why you guys don't just shift it on your side if the shift amount is known? The system is using virtual content rendered for one of the eyes and overlaying it with the RGB camera image. So why not just shift it once and make every user happy?

---

<div class="post-metadata">

**Author:** ![etucker](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/etucker/32/842_2.png) [@etucker](https://forum.magicleap.cloud/u/etucker)\
**Post date:** [February 22, 2024, 10:04pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/5 "2024-02-22T22:04:14Z")

</div>

As @stradiot95 stated, the image is taken from the left eye and super imposed to the RGB image. Due to the different positions of the RGB camera and the left eye, the image is distorted. The focus point is then used to align the image as best as possible to the real world.  
That said, we will share your feedback with our voice of customer team.

> [@maks](#):
>
> but it didn't work for me

Could you elaborate more on what you mean by this?

Best,

El

---

<div class="post-metadata">

**Author:** ![maks](https://avatars.discourse-cdn.com/v4/letter/m/96bed5/32.png) [@maks](https://forum.magicleap.cloud/u/maks)\
**Post date:** [February 23, 2024, 2:36pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/6 "2024-02-23T14:36:39Z")

</div>

The shift wasn't gone. Still there.

---

<div class="post-metadata">

**Author:** ![etucker](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/etucker/32/842_2.png) [@etucker](https://forum.magicleap.cloud/u/etucker)\
**Post date:** [February 23, 2024, 9:55pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/7 "2024-02-23T21:55:48Z")

</div>

Thank you for your feedback. I will keep you updated as we learn more.

Best,

El

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [February 26, 2024, 6:20pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/8 "2024-02-26T18:20:51Z")

</div>

@maks Are you using the OpenXR workflow or the XR SDK ? When you set the object as the stereo convergence point on the Magic Leap Camera Component is the offset reduced? How far away is the object when the offset is still visible even when the object is set as the stereo convergence target?

---

<div class="post-metadata">

**Author:** ![maks](https://avatars.discourse-cdn.com/v4/letter/m/96bed5/32.png) [@maks](https://forum.magicleap.cloud/u/maks)\
**Post date:** [March 4, 2024, 8:25am UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/9 "2024-03-04T08:25:07Z")

</div>

@kbabilinski I'm using XR SDK.  
The horizontal offset is reduced, yes, but the vertical stays the same. The object is about 2 meters away.  
What I discovered playing with custom focus point of the Magic Leap Camera component is that adjusting X and Y coordinates of the custom focus point (empty game object) doesn't have any effect on the shift. Only changing Z coordinate makes the shift change. But it changes diagonally which helps to mitigate either horizontal or vertical shift separately but not together as the diagonal movement isn't aligned with the shift itself. Please see the video. It is taken in Simulator mode while changing Focus Point Z coordinate.  
It seems like if you just give the developers and users a possibility to either record XR video into two separate files (RGB camera background and Virtual content) so it is possible to combine it after with the eliminated shift, or just give more options to set the focus position not only with Z coordinate – could be a solution to this issue.

[![](https://us1.discourse-cdn.com/flex019/uploads/magicleap1/original/2X/0/04f8a35e8e0d9d1a0382e601f88043cbb084e4c0.jpeg "Simulator Focus Point Adjustment ML") ](https://www.youtube.com/watch?v=y13353T7Rc8)

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [March 6, 2024, 3:45pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/10 "2024-03-06T15:45:22Z")

</div>

Thank you for that information. You are correct. The focus point is only influenced by the distance from the user. Ideally, the point would be positioned directly at the distance of the virtual object.

Unfortunately, simply offsetting the content by a fixed amount would not make the content align properly. However, we are investigating ways to decrease the offset amount.

---

<div class="post-metadata">

**Author:** ![stradiot95](https://avatars.discourse-cdn.com/v4/letter/s/3be4f8/32.png) [@stradiot95](https://forum.magicleap.cloud/u/stradiot95)\
**Post date:** [June 5, 2024, 2:41pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/11 "2024-06-05T14:41:34Z")

</div>

[Secondary Views OpenXR Extension | MagicLeap Developer Documentation](https://developer-docs.magicleap.cloud/docs/guides/openxr/openxr-secondary-view/)

I'm trying to understand how to activate those features, but they are not present in the feature list. As i understand, those feature should be enabled maybe through code? Or maybe re-building the openxr package with that features enabled? Sorry but i can't find any explanation over the web.  
Thank you in advance for any suggestion!

---

<div class="post-metadata">

**Author:** ![stradiot95](https://avatars.discourse-cdn.com/v4/letter/s/3be4f8/32.png) [@stradiot95](https://forum.magicleap.cloud/u/stradiot95)\
**Post date:** [June 5, 2024, 3:08pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/12 "2024-06-05T15:08:21Z")

</div>

I've partially understood. The solution seems that works only for native development.  
Is there a way to implement the solution from openXR sample 1.7.0 in unity development?

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [June 5, 2024, 7:52pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/13 "2024-06-05T19:52:15Z")

</div>

This feature will become available in the next Unity SDK release, along with the 1.8.0 OS.

Note, secondary views impacts the performance of your application so developers may need to reduce the resolution or graphics quality of their app when the secondary view feature is active.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/magicleap1/original/1X/bd9b737a4d45ea243aa7eb177d60a773b806899a.svg) [@system](https://forum.magicleap.cloud/u/system)\
**Post date:** [July 17, 2024, 8:20pm UTC](https://forum.magicleap.cloud/t/device-video-capture/3199/14 "2024-07-17T20:20:48Z")

</div>

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.
