Getting ScreenSpace Coordinates from World Coordinates

[kbabilinski]

@zhhqu0305 You will need to use the RGB Camera's intrinsic and extrinsic values to raycast from pixel to world point properly.

You can see a simple implementation here:

Localizing detected faces using ML2 transformation matrix?

Unfortunately, the Unity forum might be a better place for this type of question since it is not specific to Magic Leap and out of scope for this forum. You may want to consider using the CVCamear pose for the origin of the ray. You can obtain it using the MLCVCamera.GetFramePose function. For example private void OnCaptureRawVideoFrameAvailable(MLCamera.CameraOutput capturedFrame, MLCamera.ResultExtras resultExtras, MLCamera.Metadata metadataHandle) { if (MLCVCamera.Get…