@sengelman I have a question about the Magic Leap 2's photo or video recording capabilities.
With Magic Leap 1, it was not possible to take a photo or shoot video while running an application that uses the camera function, such as Image Tracking.
I believe this limitation was due to the fact that Magic Leap 1 has only one camera.
Can't the Magic Leap 2 also take a picture or shoot a video while using a function that uses the camera within an application as described above? Or is it possible to take a picture or shoot a video while using the camera function within the application?
I have marker tracking and video capture using adb mlcapture working at the same time on ML2 using Unity + MRTK. There is a slight offset in the recorded video
To be clear and specific, there is one "RGB" camera accessible on ML2, but it has two "logical" interfaces — The Camera and the CVCamera. If the camera access is separated in this way, then yes, it is possible.
I have recently begun work on a Magic Leap project in Unity. It requires the use of the camera however we need to be able to record video of its functionality. How would you go about “separating the interfaces” so that the app can be recorded while working.
Can you explain how I would alter the example camera scripts found here : MLCamera Examples | MagicLeap Developer Documentation to achieve this? currently they do not allow recording while in use.
You can record and use the ML camera as long as you are accessing two separate streams. This limitation is common on other platforms such as Android. Since only one process can access the stream at a time. Using the CV camera you can obtain the RGB image while streaming/recording the Mixed Reality Stream provided by the main camera. Note that you cannot access the Mixed Reality Stream when targeting the ML Camera itself.
However, you can use tools like the Spectator Camera to stream a 3rd person perspective of your application. Note that using this package increases that amount of resources required to rendering your application since it renders another view from a separate camera.
If you have additional questions I recommend creating a new post since this one is quite old.