ScreenPointToRay offset

[kbabilinski]

To make the clicks align to the real world, you will need to use the Camera's intrinsic and extrinsic values to convert pixel to world positions.

Here is an example that can be used with the CV camera image example:

Localizing detected faces using ML2 transformation matrix?

Unfortunately, the Unity forum might be a better place for this type of question since it is not specific to Magic Leap and out of scope for this forum. You may want to consider using the CVCamear pose for the origin of the ray. You can obtain it using the MLCVCamera.GetFramePose function. For example private void OnCaptureRawVideoFrameAvailable(MLCamera.CameraOutput capturedFrame, MLCamera.ResultExtras resultExtras, MLCamera.Metadata metadataHandle) { if (MLCVCamera.Get…