# Input/Interaction **URL:** https://forum.magicleap.cloud/c/input-interaction/144.md [Latest](https://forum.magicleap.cloud/latest.md) · [Categories](https://forum.magicleap.cloud/categories.md) · [Tags](https://forum.magicleap.cloud/tags.md) --- ## [About the Input/Interaction category](https://forum.magicleap.cloud/t/about-the-input-interaction-category/503)
**Author:** [@sengelman](https://forum.magicleap.cloud/u/sengelman)\ **Replies:** 0\ **Last updated:** [August 5, 2022, 7:30pm UTC](https://forum.magicleap.cloud/t/about-the-input-interaction-category/503 "2022-08-05T19:30:19Z")
Questions regarding designing or developing using the Controller, Hand Tracking, or other input methods and Magic Leap 2. --- ## [Hand tracking issues](https://forum.magicleap.cloud/t/hand-tracking-issues/5788)
**Author:** [@oleksii.kryzhanovskyi](https://forum.magicleap.cloud/u/oleksii.kryzhanovskyi)\ **Replies:** 5\ **Last updated:** [June 16, 2025, 9:01am UTC](https://forum.magicleap.cloud/t/hand-tracking-issues/5788 "2025-06-16T09:01:43Z")
Hello, I hope you’re doing well. I wanted to follow up on this issue that was previously reported. I’m experiencing the same problem with hand tracking in the Magic Leap 2 main menu on the latest OS version. Would you ha… --- ## [Sending data to Magic Leap 2 device](https://forum.magicleap.cloud/t/sending-data-to-magic-leap-2-device/1417)
**Author:** [@hg1](https://forum.magicleap.cloud/u/hg1)\ **Replies:** 4\ **Last updated:** [January 2, 2025, 2:06pm UTC](https://forum.magicleap.cloud/t/sending-data-to-magic-leap-2-device/1417 "2025-01-02T14:06:04Z")
Hi fox, Is there a way to send data (alphanumeric) to the headset? For example, streaming via serial from Arduino, and/or sensors (IoT) or other external devices using either Bluetooth, Wifi or tethered? If so, could yo… --- ## [World coordinate system](https://forum.magicleap.cloud/t/world-coordinate-system/3401)
**Author:** [@carriefox517](https://forum.magicleap.cloud/u/carriefox517)\ **Replies:** 10\ **Last updated:** [November 5, 2024, 9:26pm UTC](https://forum.magicleap.cloud/t/world-coordinate-system/3401 "2024-11-05T21:26:43Z")
I would like to understand, in the world coordinate system, which coordinate system is used as the origin for the eye position and fixation position? Eye Tracking | MagicLeap Developer Documentation --- ## [Use of Controllers with a wired connection](https://forum.magicleap.cloud/t/use-of-controllers-with-a-wired-connection/4345)
**Author:** [@taimei.ml](https://forum.magicleap.cloud/u/taimei.ml)\ **Replies:** 2\ **Last updated:** [October 2, 2024, 3:33am UTC](https://forum.magicleap.cloud/t/use-of-controllers-with-a-wired-connection/4345 "2024-10-02T03:33:14Z")
Can the controller be used with wired instead of using a Bluetooth wireless connection? I would like to use the device in places with security restrictions where wireless is not available. Of course, the use of hand in… --- ## [XRIT Does not detect change from Hands to Controllers (ML2)](https://forum.magicleap.cloud/t/xrit-does-not-detect-change-from-hands-to-controllers-ml2/3381)
**Author:** [@Headwall.CW](https://forum.magicleap.cloud/u/Headwall.CW)\ **Replies:** 3\ **Last updated:** [August 22, 2024, 4:43pm UTC](https://forum.magicleap.cloud/t/xrit-does-not-detect-change-from-hands-to-controllers-ml2/3381 "2024-08-22T16:43:03Z")
Our team would like to support as many headsets as possible with as consistent and interaction suite as is feasible. We're looking to use OpenXR and XRIT to achieve this, and want to replicate the same behavior exhibited… --- ## [AR data collect problem](https://forum.magicleap.cloud/t/ar-data-collect-problem/3572)
**Author:** [@archielin920418](https://forum.magicleap.cloud/u/archielin920418)\ **Replies:** 1\ **Last updated:** [May 27, 2024, 8:06pm UTC](https://forum.magicleap.cloud/t/ar-data-collect-problem/3572 "2024-05-27T20:06:20Z")
What are the normal ranges for various fields collected by an eye tracker (e.g., Fixation Point, LeftEyePosition xyz)? Does the movement of AR glasses in space affect the data collected by the eye tracker, and if so, ho… --- ## [Are there any hand meshing/occlusion examples or solutions for the ML2 yet?](https://forum.magicleap.cloud/t/are-there-any-hand-meshing-occlusion-examples-or-solutions-for-the-ml2-yet/1561)
**Author:** [@dtrujillostyle](https://forum.magicleap.cloud/u/dtrujillostyle)\ **Replies:** 4\ **Last updated:** [March 20, 2024, 7:40am UTC](https://forum.magicleap.cloud/t/are-there-any-hand-meshing-occlusion-examples-or-solutions-for-the-ml2-yet/1561 "2024-03-20T07:40:55Z")
I have looked through the HandTracking and GestureClassification examples and haven't yet found Hand Occlusion or Meshing, also searched the forum to no avail, and every thing I tried to slap together doesn't work or cra… --- ## [Microphone Input in running App on Magic Leap 2](https://forum.magicleap.cloud/t/microphone-input-in-running-app-on-magic-leap-2/3253)
**Author:** [@yuna.seo](https://forum.magicleap.cloud/u/yuna.seo)\ **Replies:** 2\ **Last updated:** [March 7, 2024, 1:26am UTC](https://forum.magicleap.cloud/t/microphone-input-in-running-app-on-magic-leap-2/3253 "2024-03-07T01:26:37Z")
I am currently developing an AI chat and voice conversation application by using Convai plugin for the Magic Leap 2 platform. I have encountered an issue where the microphone input is not being properly captured when ru… --- ## [Integrating camera with OpenCV](https://forum.magicleap.cloud/t/integrating-camera-with-opencv/1920)
**Author:** [@jweatherhead](https://forum.magicleap.cloud/u/jweatherhead)\ **Replies:** 3\ **Last updated:** [January 4, 2024, 11:33pm UTC](https://forum.magicleap.cloud/t/integrating-camera-with-opencv/1920 "2024-01-04T23:33:54Z")
Hi - hopefully this is a simple configuration question. It is possible to feed the main camera image into OpenCV for real-time processing on device? If so, is it permitted to use the GPU for open cv? Thank you --- ## [Support for SpeechRecognition API in ML2 browser](https://forum.magicleap.cloud/t/support-for-speechrecognition-api-in-ml2-browser/2835)
**Author:** [@madschristensen99](https://forum.magicleap.cloud/u/madschristensen99)\ **Replies:** 1\ **Last updated:** [November 7, 2023, 8:46pm UTC](https://forum.magicleap.cloud/t/support-for-speechrecognition-api-in-ml2-browser/2835 "2023-11-07T20:46:39Z")
First off, I just wanted to say as a WebXR developer I’d like to thank Magic Leap for adding support for the hit test API in the latest November update. Another feature I would love to see is support for the SpeechRecogn… --- ## [Controller Input for Omniverse - Remote Rendering](https://forum.magicleap.cloud/t/controller-input-for-omniverse-remote-rendering/2701)
**Author:** [@mathradecs](https://forum.magicleap.cloud/u/mathradecs)\ **Replies:** 2\ **Last updated:** [October 24, 2023, 5:36pm UTC](https://forum.magicleap.cloud/t/controller-input-for-omniverse-remote-rendering/2701 "2023-10-24T17:36:07Z")
Hi, since the last update of the USD Composer application in Omniverse I am able to stream content to the Magic Leap 2 through the remote rendering app. Now I'm struggling to get the controller input into Omniverse. Can… --- ## [Magic Leap 2 IMU data](https://forum.magicleap.cloud/t/magic-leap-2-imu-data/1515)
**Author:** [@mattycorbett](https://forum.magicleap.cloud/u/mattycorbett)\ **Replies:** 15\ **Last updated:** [October 16, 2023, 2:11am UTC](https://forum.magicleap.cloud/t/magic-leap-2-imu-data/1515 "2023-10-16T02:11:51Z")
I was unable to find any documentation on the ability to access the IMU data on the ML2. Can I read real-time data from the accelerometer, gyroscope, and magnetometer? Does this require some "developer work arounds" lik… --- ## [UI control via Hand Tracking raycast](https://forum.magicleap.cloud/t/ui-control-via-hand-tracking-raycast/2672)
**Author:** [@PPXR](https://forum.magicleap.cloud/u/PPXR)\ **Replies:** 4\ **Last updated:** [October 10, 2023, 8:08pm UTC](https://forum.magicleap.cloud/t/ui-control-via-hand-tracking-raycast/2672 "2023-10-10T20:08:08Z")
We are unable to activate UI control via Hand Tracking raycast. The Hand Tracking present in MagicLeap Examples only highlights the Tracking without managing any Raycast. Following the indications of Unity Learn in "'H… --- ## [How to read the System OS Hand Navigation settings](https://forum.magicleap.cloud/t/how-to-read-the-system-os-hand-navigation-settings/2677)
**Author:** [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\ **Replies:** 0\ **Last updated:** [October 5, 2023, 6:56pm UTC](https://forum.magicleap.cloud/t/how-to-read-the-system-os-hand-navigation-settings/2677 "2023-10-05T18:56:39Z")
Hi Magic Leap Developers, Some developers have asked how to access the System Hand Input / Hand Gesture preferences that the user has set on the device inside System Settings (Settings \> Input \> Gestures). I thought thi… --- ## [Pupil Dilation in ML2](https://forum.magicleap.cloud/t/pupil-dilation-in-ml2/2640)
**Author:** [@mattycorbett](https://forum.magicleap.cloud/u/mattycorbett)\ **Replies:** 1\ **Last updated:** [September 28, 2023, 5:29pm UTC](https://forum.magicleap.cloud/t/pupil-dilation-in-ml2/2640 "2023-09-28T17:29:24Z")
Does ML2's eye tracking APIs allow for pupil dilation measurements yet? I believe it was not included in earlier releases. --- ## [How to calibrate eyes without using hands or controller](https://forum.magicleap.cloud/t/how-to-calibrate-eyes-without-using-hands-or-controller/2176)
**Author:** [@julien.villiger](https://forum.magicleap.cloud/u/julien.villiger)\ **Replies:** 8\ **Last updated:** [September 27, 2023, 7:45pm UTC](https://forum.magicleap.cloud/t/how-to-calibrate-eyes-without-using-hands-or-controller/2176 "2023-09-27T19:45:04Z")
Dear community, I was wondering if it's possible to go through the eye calibration process without using the hands or the controller. I managed to launch the eye calibration app from my Unity app, but still, it's mandat… --- ## [Voice Intents Starting but OnVoiceEvent Not Being Called](https://forum.magicleap.cloud/t/voice-intents-starting-but-onvoiceevent-not-being-called/2571)
**Author:** [@josephdemartini801](https://forum.magicleap.cloud/u/josephdemartini801)\ **Replies:** 1\ **Last updated:** [September 14, 2023, 6:50pm UTC](https://forum.magicleap.cloud/t/voice-intents-starting-but-onvoiceevent-not-being-called/2571 "2023-09-14T18:50:08Z")
Hello, My Unity project has the Unity SDK version 1.9.0, and the Magic Leap device itself is version 1.4.0 (dev1). When using voice intents, it successfully starts and MLVoice.IsStarted returns true. On the device itsel… --- ## [Voice Input Too Sensitive](https://forum.magicleap.cloud/t/voice-input-too-sensitive/2323)
**Author:** [@nathan](https://forum.magicleap.cloud/u/nathan)\ **Replies:** 3\ **Last updated:** [August 8, 2023, 5:08pm UTC](https://forum.magicleap.cloud/t/voice-input-too-sensitive/2323 "2023-08-08T17:08:55Z")
We are experiencing voice recognition issues on some of our keywords mis-triggering when the words are not said. Voice recognitions have even been hit in quiet areas which is quite concerning, but most likely was caused … --- ## [Runtime Voice Intents Crash Unity Application on Command Recognition](https://forum.magicleap.cloud/t/runtime-voice-intents-crash-unity-application-on-command-recognition/2004)
**Author:** [@audeo](https://forum.magicleap.cloud/u/audeo)\ **Replies:** 5\ **Last updated:** [May 31, 2023, 6:17pm UTC](https://forum.magicleap.cloud/t/runtime-voice-intents-crash-unity-application-on-command-recognition/2004 "2023-05-31T18:17:23Z")
I am building a simple application based on this Voice Intents example. I've configured Unity as the setup guide directs, and have built a script attached to an empty game object that reads a list of commands from a file… --- ## [MRTK Enabling Hand Mesh](https://forum.magicleap.cloud/t/mrtk-enabling-hand-mesh/1699)
**Author:** [@ben.mark](https://forum.magicleap.cloud/u/ben.mark)\ **Replies:** 1\ **Last updated:** [April 6, 2023, 2:21pm UTC](https://forum.magicleap.cloud/t/mrtk-enabling-hand-mesh/1699 "2023-04-06T14:21:37Z")
I am using the Magic Leap 2 with MRTK input actions. The Articulate Hand Tracking Profile includes the mesh materials but I don't see the mesh when I run the scene. In the documentation, I saw that the WORLD\_RECONSTRUCTI… --- ## [Arm motion tracking (Hand, Elbow & Shoulder)](https://forum.magicleap.cloud/t/arm-motion-tracking-hand-elbow-shoulder/1682)
**Author:** [@eleni.mangina](https://forum.magicleap.cloud/u/eleni.mangina)\ **Replies:** 1\ **Last updated:** [April 5, 2023, 4:57pm UTC](https://forum.magicleap.cloud/t/arm-motion-tracking-hand-elbow-shoulder/1682 "2023-04-05T16:57:03Z")
Hi everyone. Is there someone to talk to, about how to add tracking functionality for the elbow and shoulder? Thank you in advance - Eleni --- ## [Magic Leap 2 Eye Tracking](https://forum.magicleap.cloud/t/magic-leap-2-eye-tracking/1442)
**Author:** [@mattycorbett](https://forum.magicleap.cloud/u/mattycorbett)\ **Replies:** 3\ **Last updated:** [February 24, 2023, 7:22pm UTC](https://forum.magicleap.cloud/t/magic-leap-2-eye-tracking/1442 "2023-02-24T19:22:55Z")
I am looking to develop an app that uses the device user's eyes to inform UI design. Specifically, I need eye gaze direction, which I believe I can access on the ML2. However, the documentation is not as specific about d… --- ## [About WebXR hand tracking](https://forum.magicleap.cloud/t/about-webxr-hand-tracking/1239)
**Author:** [@tokufxug](https://forum.magicleap.cloud/u/tokufxug)\ **Replies:** 9\ **Last updated:** [January 13, 2023, 5:50pm UTC](https://forum.magicleap.cloud/t/about-webxr-hand-tracking/1239 "2023-01-13T17:50:28Z")
I accessed the WebXR hand tracking demo page and the hand tracking did not work. there is no hand tracking in WebXR Viewer's Not Support. Is this a bug? Thanks. Sadao Tokuyama --- ## [(Continued) USB or Bluetooth Keyboard input lag in Android apps (idling?)](https://forum.magicleap.cloud/t/continued-usb-or-bluetooth-keyboard-input-lag-in-android-apps-idling/1106)
**Author:** [@paklnet](https://forum.magicleap.cloud/u/paklnet)\ **Replies:** 6\ **Last updated:** [January 11, 2023, 6:29am UTC](https://forum.magicleap.cloud/t/continued-usb-or-bluetooth-keyboard-input-lag-in-android-apps-idling/1106 "2023-01-11T06:29:56Z")
Continuing the discussion from USB or Bluetooth Keyboard input lag in Android apps (idling?): It seems even with the new release this problem still occurs. Both ConnectBot and Termux exhibit lagging keyboard input. Di… --- ## [Microsoft Xbox One and its Chatpad as Keyboard](https://forum.magicleap.cloud/t/microsoft-xbox-one-and-its-chatpad-as-keyboard/1129)
**Author:** [@juan.suero.robotics](https://forum.magicleap.cloud/u/juan.suero.robotics)\ **Replies:** 1\ **Last updated:** [October 20, 2022, 5:25pm UTC](https://forum.magicleap.cloud/t/microsoft-xbox-one-and-its-chatpad-as-keyboard/1129 "2022-10-20T17:25:19Z")
I have used the Microsoft Xbox One and its Chatpad on the Hololens but now im trying to get a keyboard for Magic Leap. Is there a way to use a USB keyboard with Magic Leap? could i use the Microsoft Xbox One and its Ch… --- ## [USB or Bluetooth Keyboard input lag in Android apps (idling?)](https://forum.magicleap.cloud/t/usb-or-bluetooth-keyboard-input-lag-in-android-apps-idling/911)
**Author:** [@paklnet](https://forum.magicleap.cloud/u/paklnet)\ **Replies:** 1\ **Last updated:** [September 22, 2022, 4:00pm UTC](https://forum.magicleap.cloud/t/usb-or-bluetooth-keyboard-input-lag-in-android-apps-idling/911 "2022-09-22T16:00:16Z")
When using Android apps like ConnectBot or Termux on ML2, input from USB or bluetooth keyboard quickly starts to lag by one or more keystrokes. Sometimes moving/keeping the controller pointed on the Android app window o… --- ## [Magic Leap 2 Hand Tracking](https://forum.magicleap.cloud/t/magic-leap-2-hand-tracking/736)
**Author:** [@robert](https://forum.magicleap.cloud/u/robert)\ **Replies:** 2\ **Last updated:** [August 31, 2022, 5:21pm UTC](https://forum.magicleap.cloud/t/magic-leap-2-hand-tracking/736 "2022-08-31T17:21:38Z")
Hi. The Magic Leap 1 SDK includes APIs for hand tracking https://developer.magicleap.com/en-us/learn/guides/lumin-sdk-handtracking Does the Magic Leap 2 SDK include the same? Maybe it doesn't yet, but at least I'm wo… --- ## [Unity build doens't recognize controller tracking](https://forum.magicleap.cloud/t/unity-build-doenst-recognize-controller-tracking/655)
**Author:** [@anna.shabayev](https://forum.magicleap.cloud/u/anna.shabayev)\ **Replies:** 2\ **Last updated:** [August 25, 2022, 10:24pm UTC](https://forum.magicleap.cloud/t/unity-build-doenst-recognize-controller-tracking/655 "2022-08-25T22:24:58Z")
Are there are any other requisites for getting the controller to track on the Unity build? The headset works find in the build, just not the controller. I've checked the CONTROLLER\_POSE permission. And I've tried control…