Aruco tracking missing updates when screen recording/device stream/advanced capture

Hi I've noticed that the Aruco tracking misses location updates while screen recording/device stream/advanced capture. Can anyone confirm this, and is there a known workaround?

Edit: tracking is totally fine when not capturing.

Thank you.

Unity Editor version: 2022.2.21f1
ML2 OS version: 1.4.0dev1
MLSDK version: 1.9.0
Host OS: (Windows/MacOS) MacOS

Hi @paklnet,

Thank you for bringing this issue to our attention. We do have a new version of the MLSDK available. Updating may help fix this issue. I have reported this bug to our voice of customer team and we will keep you updated on any developments regarding this issue.

Best,

El

I did try bumping up to the new Unity SDK v1.10.0 with the ML SDK v1.4.0-dev1 that I've been using and still see the issue.
Aruco tracking is great, but once I start capturing it misses updates.

I assume it's because screen recording is interfering with the CV2/or whatever other processes are used for the Aruco marker tracking...?

Thank you.

Is there a way to manually trigger the system to check for updated locations of the markers?
I don't need continuous updates because my target is relatively stationary... if I could trigger an update with a timer every 0.5 seconds or so that would be sufficient.

It appears the background updating thread is somehow being blocked by the screen recording process.

Hi @paklnet,

You can set the max frames per second used by the marker tracker here. You can also use MLMarkerTracker.StartScanningAsync(); and MLMarkerTracker.StopScanningAsync(); However this may not fix your issue. We are still working on this issue in the meantime for you as well. Let me know if you have any further questions.

Best,

El

Could you also share your Marker Tracker Settings? This will help us debug your issue.