Give us as much detail as possible regarding the issue you're experiencing. Unity Editor version: 2022.2.21f1 ML2 OS version: 1.2.0 MLSDK version: 1.2.0 Host OS: (Windows/MacOS) both Hi, A scene has been setup with WebRTC and Meshing. Webrtc is transmitting the video and am trying to place gam…

Hi @T_ReKT , Welcome to the Magic Leap 2 Forums. We are so grateful to have you here engaging with us. [image] T_ReKT: place game objects remotely. Would you mind sharing a video? This will help me gain a better understanding of expected behavior. If not, would you mind sharing the reproduc…

Hi, Sure here is a video. We transmit the mouse click locations from webrtc video stream on a browser and place markers on device using above described method. What we are noticing is as we move more towards the corners of the screen, the offset becomes larger. Placing at the exact centre works o…

To make the clicks align to the real world, you will need to use the Camera's intrinsic and extrinsic values to convert pixel to world positions. Here is an example that can be used with the CV camera image example: [image] Localizing detected faces using ML2 transformation matrix? …

Hi, I tried this solution, it seems to work for the corners and the centre, but anywhere else and the markers are placed with an offset. This time the offset is towards the centre of the screen rather than away tho. new Untitled video.mp4 Google Drive file. …

I have not been able to reproduce that issue on my end. The points will appear to no be aligned properly if the depth value does not match the actual depth of the object you are recasting against. I would recommend changing the function and using a physics raycast that would cast on the mesh generat…

The brown arrows in video above are from physics raycast. using UnityEngine; using UnityEngine.XR.MagicLeap; public class SimpleCameraRaycast : MonoBehaviour { public Vector3 CastRayFromPixelToWorldPoint(int width, int height, Vector2 pixelPosition, MLCameraBase.IntrinsicCalibrationParam…

Another thing is, that the stream is from the Main camera, and pose is from the CV camera. Will that be causing issues? If so, don't think there is any way to capture mixed reality content in CV camera. Is it possible to get the transformation matrix of main camera? I could not find such api's in t…

@T_ReKT Yes, you can get the camera information from both main and CV streams: Intrinsic/Extrinsic Parameters | MagicLeap Developer Documentation This section includes details on reading the Intrinsic and Extrinsic parameters from the Magic Leap camera. These values can be queried usin…

I have filed a bug ticket regarding this issue. I have been able to reproduce the issue you mentioned when using Mixed Reality Capture.

ScreenPointToRay offset

Unity Development

kbabilinski September 4, 2023, 3:53pm 11

There seems to be an issue with the original script. I have updated the script in the previous post with the correct function. See the Camera Utility script that has been added:

Topic		Replies	Views
Cast Ray from ML MR camera to world General development , unity	14	244	June 27, 2025
Physical offset between world-facing camera and HMD origin on Magic Leap 2 Unity Development development , unity	6	270	June 17, 2025
MLWorldCameraFrame.camera_pose to Unity mapping Native Development unity	9	240	January 9, 2025
Objects instantiate with a major position offset from markers in marker tracking Unity Development unity	9	350	March 11, 2024
Getting ScreenSpace Coordinates from World Coordinates Unity Development unity , camera	22	917	April 23, 2024

ScreenPointToRay offset

Related topics