Cannot get Marker Tracking to work (ArUco)

wiltabone · October 4, 2024, 3:20pm

Give us as much detail as possible regarding the issue you're experiencing:

Unity Editor version: 2022.3.38f1
ML2 OS version: 1.3.1
Unity SDK version: 2.4.0
MRTK3: 1.2.0
Host OS: (Windows)

Hi, I have been trying to map an entire scene and its assets to the position of an ArUco marker, and am working on the MRTK 3 starter template provided by ML2 team.

I have tried both the OpenXR and MLSDK approaches using the code provided.

With OpenXR, I get the following:

2024/10/04 11:24:44.736 28746 28766 Info Unity [MRTKLifecycleManager] Creating MagicLeap.MRTK.Input.MagicLeapKeywordRecognitionSubsystem
2024/10/04 11:24:44.750 28746 28766 Info Unity [MRTKLifecycleManager] Creating MagicLeap.MRTK.Input.MagicLeapXRSDKHandsSubsystem
2024/10/04 11:24:44.750 28746 28766 Info Unity [MRTKLifecycleManager] Creating MixedReality.Toolkit.Input.MRTKHandsAggregatorSubsystem
2024/10/04 11:24:44.750 28746 28766 Info Unity [MRTKLifecycleManager] Creating MixedReality.Toolkit.Input.SyntheticHandsSubsystem
2024/10/04 11:24:44.750 28746 28766 Info Unity [MRTKLifecycleManager] Starting MagicLeap.MRTK.Input.MagicLeapKeywordRecognitionSubsystem
2024/10/04 11:24:44.751 28746 28766 Info Unity [MRTKLifecycleManager] Starting MagicLeap.MRTK.Input.MagicLeapXRSDKHandsSubsystem
2024/10/04 11:24:44.753 28746 28766 Info Unity [MRTKLifecycleManager] Starting MixedReality.Toolkit.Input.MRTKHandsAggregatorSubsystem
2024/10/04 11:24:44.756 28746 28766 Info Unity [MRTKLifecycleManager] Starting MixedReality.Toolkit.Input.SyntheticHandsSubsystem
2024/10/04 11:24:44.821 28746 28766 Info Unity Permission Granted: android.permission.CAMERA
2024/10/04 11:24:44.823 28746 28766 Info Unity Permission Granted: com.magicleap.permission.EYE_TRACKING
2024/10/04 11:24:44.823 28746 28766 Info Unity Permission Granted: com.magicleap.permission.VOICE_INPUT
2024/10/04 11:24:44.824 28746 28766 Info Unity Permission Granted: com.magicleap.permission.SPATIAL_MAPPING
2024/10/04 11:24:44.833 28746 28766 Error Unity NullReferenceException: Object reference not set to an instance of an object.
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetector.CreateMarkerDetectorInternal () [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetector..ctor (MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetectorSettings settings, MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerUnderstandingNativeFunctions nativeFunctions, MagicLeap.OpenXR.Features.MarkerUnderstanding.MagicLeapMarkerUnderstandingFeature markerUnderstandingFeature) [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MagicLeap.OpenXR.Features.MarkerUnderstanding.MagicLeapMarkerUnderstandingFeature.CreateMarkerDetector (MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetectorSettings settings) [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MarkerTrackerExample.Start () [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity

While with the MLSDK approach, the debug outputs indicate that a listener was created, but then when I look at a marker, nothing happens.
I configured the marker size to be 0.1, and it is using the 5X5_100 dict.

Parts of the runtime output:

2024/10/04 11:39:32.600 8660 8680 Info Unity [MRTKLifecycleManager] Creating MagicLeap.MRTK.Input.MagicLeapKeywordRecognitionSubsystem
2024/10/04 11:39:32.614 8660 8680 Info Unity [MRTKLifecycleManager] Creating MagicLeap.MRTK.Input.MagicLeapXRSDKHandsSubsystem
2024/10/04 11:39:32.614 8660 8680 Info Unity [MRTKLifecycleManager] Creating MixedReality.Toolkit.Input.MRTKHandsAggregatorSubsystem
2024/10/04 11:39:32.615 8660 8680 Info Unity [MRTKLifecycleManager] Creating MixedReality.Toolkit.Input.SyntheticHandsSubsystem
2024/10/04 11:39:32.615 8660 8680 Info Unity [MRTKLifecycleManager] Starting MagicLeap.MRTK.Input.MagicLeapKeywordRecognitionSubsystem
2024/10/04 11:39:32.615 8660 8680 Info Unity [MRTKLifecycleManager] Starting MagicLeap.MRTK.Input.MagicLeapXRSDKHandsSubsystem
2024/10/04 11:39:32.618 8660 8680 Info Unity [MRTKLifecycleManager] Starting MixedReality.Toolkit.Input.MRTKHandsAggregatorSubsystem
2024/10/04 11:39:32.620 8660 8680 Info Unity [MRTKLifecycleManager] Starting MixedReality.Toolkit.Input.SyntheticHandsSubsystem
2024/10/04 11:39:32.639 8660 8680 Info Unity ROI TRACKERS ENABLED
2024/10/04 11:39:32.694 8660 8680 Info Unity Permission Granted: android.permission.CAMERA
2024/10/04 11:39:32.696 8660 8680 Info Unity Permission Granted: com.magicleap.permission.EYE_TRACKING
2024/10/04 11:39:32.696 8660 8680 Info Unity Permission Granted: com.magicleap.permission.VOICE_INPUT
2024/10/04 11:39:32.696 8660 8680 Info Unity Permission Granted: com.magicleap.permission.SPATIAL_MAPPING
2024/10/04 11:39:32.720 8660 8680 Info Unity ROI TRACKERS ON
2024/10/04 11:39:32.720 8660 8680 Info Unity MarkerTrackerExample:Start()
2024/10/04 11:39:32.720 8660 8680 Info Unity 
2024/10/04 11:39:33.464 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample leapcore/frameworks/perception/data_sources/include/pad/xpad_data_source.h(108) GetClosestTimestampedData():
2024/10/04 11:39:33.464 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample ERR:  exception: Data Not Found for timestamp: 2674538079us
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample leapcore/frameworks/perception/data_sources/include/pad/xpad_data_source.h(108) GetClosestTimestampedData():
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample ERR: [stack trace begin]
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #00 pc 0000000000019723  /system/lib64/libml_perception_gesture_classification.so (_ZNK2ml10perception11datasources14XPadDataSourceINS_3pil2ss25GestureClassificationDataEE25GetClosestTimestampedDataERKNSt3__16chrono8durationIxNS7_5ratioILl1ELl1000000000EEEEE+3315)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #01 pc 00000000000114aa  /system/lib64/libml_perception_gesture_classification.so (_ZN2ml10perception10components22gesture_classification21GestureClassification6UpdateERKNSt3__16chrono8durationIxNS4_5ratioILl1ELl1000000000EEEEE+250)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #02 pc 000000000000d4ad  /system/lib64/libml_perception_session.so (_ZN2ml10perception10components7session7Session16UpdateComponentsENSt3__16chrono8durationIxNS4_5ratioILl1ELl1000000000EEEEE+413)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #03 pc 000000000000dc2b  /system/lib64/libml_perception_session.so (ml::perception::components::session::Session::UpdateSnapshot(std::__1::unique_ptr<ml::perception::components::snapshot::Snapshot, std::__1::default_delete<ml::perception::components::snapshot::Snapshot>>&)+155)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #04 pc 000000000000d282  /system/lib64/libml_perception_session.so (_ZN2ml10perception10components7session7Session13GetSnapshotAtENSt3__16chrono8durationIxNS4_5ratioILl1ELl1000000000EEEEE+210)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #05 pc 000000000000d152  /system/lib64/libml_perception_session.so (ml::perception::components::session::Session::GetSnapshot()+162)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #06 pc 00000000000a0843  /system/lib64/libperception.magicleap.so (MLPerceptionGetSnapshot+179)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #07 pc 00000000001b2c8d  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libml_sdk_loader.so (_ZN9DelayCallI10perception32MLPerceptionGetSnapshotDelayCalliJPP10MLSnapshotEEclES4_+61)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #08 pc 00000000001b268b  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libml_sdk_loader.so (_Z27MLPerceptionGetSnapshotShimIJPP10MLSnapshotEEiDpT_+107)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #09 pc 00000000001b2614  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libml_sdk_loader.so (MLPerceptionGetSnapshot+20)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #10 pc 00000000000a3122  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libMagicLeapXrProvider.so (InputSubsystem::Tick(UnityXRInputUpdateType)+258)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #11 pc 00000000000abce2  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libMagicLeapXrProvider.so (_ZZN14InputSubsystem10InitializeEPvS0_ENK3$_0clES0_S0_22UnityXRInputUpdateType+34)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #12 pc 00000000000abcb2  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libMagicLeapXrProvider.so (_ZZN14InputSubsystem10InitializeEPvS0_EN3$_08__invokeES0_S0_22UnityXRInputUpdateType+34)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #13 pc 000000000095ab69  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #14 pc 0000000000953104  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #15 pc 00000000005465e0  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #16 pc 00000000005a00e4  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #17 pc 0000000000598a4b  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #18 pc 0000000000598a8f  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #19 pc 0000000000598d07  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #20 pc 00000000006ff77a  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #21 pc 00000000007142a1  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/lib/x86_64/libunity.so
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #22 pc 00000000000046ed  /data/app/org.MixedRealityToolkit.MRTK3Sample-pI-XXM2izPxZdgLZWoLerA==/oat/x86_64/base.odex (art_jni_trampoline+157)
2024/10/04 11:39:33.551 8660 8680 Error org.MixedRealityToolkit.MRTK3Sample #23 pc 000000000016ccd4  /apex/com.android.runtime/lib64/libart.so (art_quick_invoke_stub+756)

At this point I am uncertain what the issue is with both approaches. I have followed multiple examples and yet nothing seems to be working at this current time. I am not sure whether its an issue with the libraries, versions, or the markers themselves.

Any pointers would be appreciated Thanks

etucker · October 4, 2024, 3:25pm

Have you tried updating to the latest version of the Magic Leap OS. I notice that you are on version 1.3.0 which is quite old.

Have you been able to run the Marker Tracker Example Scene from the Unity Example project?

wiltabone · October 8, 2024, 2:59pm

Thanks for your reply. I did update to the latest firmware, and the marker system works in the Unity Example Project.

However, I still get the same issues when trying to run the OpenXR (Marker Understanding Example | MagicLeap Developer Documentation) approach.

2024/10/04 11:24:44.824 28746 28766 Info Unity Permission Granted: com.magicleap.permission.SPATIAL_MAPPING
2024/10/04 11:24:44.833 28746 28766 Error Unity NullReferenceException: Object reference not set to an instance of an object.
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetector.CreateMarkerDetectorInternal () [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetector..ctor (MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetectorSettings settings, MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerUnderstandingNativeFunctions nativeFunctions, MagicLeap.OpenXR.Features.MarkerUnderstanding.MagicLeapMarkerUnderstandingFeature markerUnderstandingFeature) [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MagicLeap.OpenXR.Features.MarkerUnderstanding.MagicLeapMarkerUnderstandingFeature.CreateMarkerDetector (MagicLeap.OpenXR.Features.MarkerUnderstanding.MarkerDetectorSettings settings) [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity   at MarkerTrackerExample.Start () [0x00000] in <00000000000000000000000000000000>:0 
2024/10/04 11:24:44.833 28746 28766 Error Unity

With the MLSDK(Marker Tracker Overview | MagicLeap Developer Documentation) approach I am able to spawn a cube but not mapped to the marker per se (although this could be the scaling and positioning in the sample cpde). I am applying both approaches to the MRTK 3 Magic Leap Starter Template where I am basciallty trying to map all the assets aroud the marker.

kbabilinski · October 8, 2024, 4:41pm

I was not able to reproduce the error that you ran into. I copied the script from the developer portal and then attached it to a transform. Do you have the marker tracking permission enabled? What version of the SDK and OS are you using? Is this with SDK 2.4.0 and OS 1.9.0 ?

wiltabone · October 9, 2024, 3:12pm

I'm now on
Magic Leap MRTK3 1.2.0
MLSDK 2.4.0
Mixed Reality OpenXR Plugin 1.10.0
OpenXR Plugin 1.11.0
ML OS 1.9.0

I implemented the OpenXR (Marker Understanding Example | MagicLeap Developer Documentation) approach on the MRTK3 fork - attached to an empty Game Object in a scene.

Both marker understanding and marker tracking permissions are checked.

kbabilinski · October 9, 2024, 3:15pm

Do you still get the error that you mentioned above or is it just that the marker is not visible. If the marker is not visible, you may want to disable the estimate size property when configuring the Marker Detector.

wiltabone · October 9, 2024, 3:18pm

In the OpenXR approach, I still get the NullReferenceException in the runtime console. Kind of stumped as the issue here is that the detector is not even created at this point.

The issue seems to be here:

_markerFeature = OpenXRSettings.Instance.GetFeature<MagicLeapMarkerUnderstandingFeature>();

When run in the editor, the error message from the next line,
ie:

The Magic Leap 2 Marker Understanding OpenXR Feature is missing or disabled enabled. Disabling Script.
UnityEngine.Debug:LogError (object)
MarkerTrackerExample:Start ()

is displayed.

Permissions:

wiltabone · October 9, 2024, 3:57pm

It seems there is something wrong with the OpenXR implementation in the MRTK3 template. I have also attached an eye-tracking script (Eye Tracker Example | MagicLeap Developer Documentation), and I get the same issue:

2024/10/09 15:55:12.306 26373 26393 Error Unity NullReferenceException: Object reference not set to an instance of an object.
2024/10/09 15:55:12.306 26373 26393 Error Unity   at MagicLeap.OpenXR.Features.EyeTracker.MagicLeapEyeTrackerFeature.GetStaticData () [0x00000] in <00000000000000000000000000000000>:0 
2024/10/09 15:55:12.306 26373 26393 Error Unity   at MagicLeap.OpenXR.Features.EyeTracker.MagicLeapEyeTrackerFeature.GetEyeTrackerData () [0x00000] in <00000000000000000000000000000000>:0 
2024/10/09 15:55:12.306 26373 26393 Error Unity   at EyeTrackerTest.Update () [0x00000] in <00000000000000000000000000000000>:0 
2024/10/09 15:55:12.306 26373 26393 Error Unity

EDIT: I have managed to solve the NullRef issues by changing plugin providers from the default set 'Magic Leap 2' to ÓpenXR''. However, I now lose the MRTK features I was using, such as hand tracking highlighting, hand-mapped menu etc. Cannot seem to get both systems working together in this template.

kbabilinski · October 9, 2024, 4:41pm

I'm not sure I understand your comment about solving the issue

wiltabone · October 9, 2024, 4:54pm

I am using the MRTK3 starter template. Plugin providers were set to 'Magic Leap' by default. If I change it to 'Open XR', the eyetracking and marker tracking scripts seem to work - but then most of the other MRTK features I was using before do not work anymore. Is there a particular setup which allows for both OpenXR and MRTK features to function well together?

kbabilinski · October 9, 2024, 4:57pm

Can you verify you are on the correct branch? You should be on mrtk3_MagicLeap2_OpenXR

When I just tested it, I pulled the repo, changed to the branch, enable the marker permission, added the script, and everything ran as expected.

wiltabone · October 10, 2024, 2:07pm

Thanks for the heads up. That was one issue - I changed the branch and got the MRTK3 functionality back. However the OpenXR script was still not mapping any objects to the ArUCo. Instead, I imported and modified the OpenXR marker script from the Unity Starter Template (ML2) - where you have a scene with dropdowns. That one seems to work, but the spawned objects are still not mapped to the marker and appear in the peripheral vision.

using System.Collections.Generic;
using System.Linq;
using System.Text;
using UnityEngine;
using UnityEngine.UI;
using UnityEngine.XR.OpenXR;
using MagicLeap.OpenXR.Features.MarkerUnderstanding;

public class MarkerTrackingExample : MonoBehaviour
{
    [SerializeField]
    private MarkerVisualizer markerVisualPrefab;

   
    private Dictionary<MarkerDetector, HashSet<MarkerVisualizer>> markerVisuals = new();
    private MagicLeapMarkerUnderstandingFeature markerFeature;
    private MarkerDetectorSettings markerDetectorSettings;

    void Start()
    {
        markerFeature = OpenXRSettings.Instance.GetFeature<MagicLeapMarkerUnderstandingFeature>();
        markerVisuals = new Dictionary<MarkerDetector, HashSet<MarkerVisualizer>>();
        OnCreateMarkerDetector();
    }

    void Update()
    {
        markerFeature.UpdateMarkerDetectors();

        int trackerIndex = 0;
        foreach (var markerDetector in markerFeature.MarkerDetectors)
        {
            int expectedVisualCount = markerDetector.Data.Where(d => d.MarkerPose != null).Count();
            if (expectedVisualCount > 0 && !markerVisuals.ContainsKey(markerDetector))
            {
                markerVisuals.Add(markerDetector, new HashSet<MarkerVisualizer>());
            }

            if (markerVisuals.TryGetValue(markerDetector, out var currentVisualSet))
            {
                if (currentVisualSet.Count > expectedVisualCount)
                {
                    foreach (var visual in currentVisualSet)
                        Destroy(visual.gameObject);
                    currentVisualSet.Clear();
                }
            }

            for (int i = 0; i < markerDetector.Data.Count; i++)
            {
                if (markerDetector.Data[i].MarkerPose != null)
                {
                    print("INST MARKER OBJ");
                    var markerVisual = Instantiate(markerVisualPrefab);
                    if (currentVisualSet != null)
                    {
                        currentVisualSet.Add(markerVisual);
                    }
                    markerVisual.Set(markerDetector.Data[i], markerDetector.Settings.MarkerType);
                }
            }

            trackerIndex++;
        }
  
    }

    public void OnCreateMarkerDetector()
    {
        markerDetectorSettings.MarkerDetectorProfile = MarkerDetectorProfile.Default;
        markerDetectorSettings.MarkerType = MarkerType.Aruco;

        //hardcoded aruco defns.
        markerDetectorSettings.ArucoSettings.ArucoType = ArucoType.Dictionary_5x5_100;
        markerDetectorSettings.ArucoSettings.ArucoLength = 100 / 1000f;
        markerDetectorSettings.ArucoSettings.EstimateArucoLength = true;
         
        markerFeature.CreateMarkerDetector(markerDetectorSettings);

    }
}

kbabilinski · October 10, 2024, 2:58pm

Did you run into any log errors when running the other version of the script? I'm interested to understand why we are seeing different results. I tested the "hand interaction scene" if that helps. And simply brought the script into that project after enabling marker tracking permissions .

wiltabone · October 11, 2024, 12:51pm

So the other version of the script (given above) works but the markers instantiate elsewhere in the world (in the bottom peripheral vision). Cannot figure out why yet.

On the other hand, I re-attached the OpenXR script (Marker Understanding Example | MagicLeap Developer Documentation), which I assume is the one you attached to the HandInteraction scene, to the EventSystem object instead. Previously, it was attached to an empty game object set at the origin. For some reason, the instantiated game object attached to the marker script correctly maps to the markers, albeit it takes some time. Kind of baffled - since the event system object is also at the origin (as was the empty game object).

kbabilinski · October 11, 2024, 2:11pm

Disabling the size estimation feature will allow the makers to be detected more quickly.

Topic		Replies	Views
OpenXR Marker Understanding Feature finding markers, but returning a zeroed out pose Unity Development unity , openxr , marker-tracker	44	468	May 29, 2024
Issue with MagicLeapMarkerUnderstandingFeature Unity Development development , openxr , marker-tracker	14	64	August 1, 2024
Magic Leap Spectator App issues with OpenXR and MRTK3 Unity Development mrtk3 , spectator	20	305	July 26, 2024
ML Spectator is not working with OpenXR Unity Development unity , openxr , marker-tracker , spectator	9	342	July 26, 2024
Objects instantiate with a major position offset from markers in marker tracking Unity Development unity	10	242	March 11, 2024

Cannot get Marker Tracking to work (ArUco)

Related topics