# MRTK with Hand tracking, spactial mapping, controller and voice input all active

**URL:** <https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744>\
**Category:** MRTK Development\
**Created:** [September 1, 2022, 11:44am UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744 "2022-09-01T11:44:22Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![daniel](https://avatars.discourse-cdn.com/v4/letter/d/3ec8ea/32.png) [@daniel](https://forum.magicleap.cloud/u/daniel)\
**Post date:** [September 1, 2022, 11:44am UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/1 "2022-09-01T11:44:22Z")

</div>

Give us as much detail as possible regarding the issue you're experiencing.

**Unity Editor version** : 2022.2.0b5  
**ML2 OS version** : 0.53.2  
**MLSDK version** : 0.53.2  
**MRTK version** : 2.8

We are having unknown issues trying to get MRTK examples working in general.

Ideally we need Handtracking, controller, voice control and spatial mapping working at the same time ideally.

Using the MRTK-MagicLeap examples, it appears that if we try to enable the hand tracking and the controller then either nither or only hand tracking will work. This varies on each rebuild with no change.

We have had simular problems with spatial mapping + hand tracking. The build when first deployed worked, and prompted on app start if spatial mapping should be allowed. Then if we remove and then sideload the same APK, spatial mapping no longer works.

My method for the project is to apply MRTK-MagicLeap as per online instructions to the MagicLeap2\_Examples as previded by The Lab 2.0.  
ILoad MRKT hand gesture example and enable controller support too in the MRTK profile. The controller will not work.

I can provide my project as a zip if required. Currently this is blocking is from evaluating suitablity for our app with use on the ML2.

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [September 1, 2022, 4:43pm UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/2 "2022-09-01T16:43:13Z")

</div>

Hi Daniel,

Happy to help you get this up and running, just a few questions. Are you using the default Magic Leap MRTK configuration profile?

---

<div class="post-metadata">

**Author:** ![daniel](https://avatars.discourse-cdn.com/v4/letter/d/3ec8ea/32.png) [@daniel](https://forum.magicleap.cloud/u/daniel)\
**Post date:** [September 8, 2022, 2:22pm UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/3 "2022-09-08T14:22:22Z")

</div>

Just for the record, as I know you are looking at this via Email.

Has anyone else had issues mixing multiple inputs? There are no examples of doing this in the ML2 MRTK. This is now blocking us showing our app to our investors on ML2.

---

<div class="post-metadata">

**Author:** ![sengelman](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/sengelman/32/11_2.png) [@sengelman](https://forum.magicleap.cloud/u/sengelman)\
**Post date:** [September 14, 2022, 1:47am UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/4 "2022-09-14T01:47:58Z")

</div>

@daniel , we just came out with a new software release: [September Software Release - #2 by sengelman](https://forum.magicleap.cloud/t/september-software-release/849/2)

I'm running this through our internal channels at the moment. Is there a way you can upgrade your project (and corresponding devices) to the latest and try again in the meantime?

---

<div class="post-metadata">

**Author:** ![daniel](https://avatars.discourse-cdn.com/v4/letter/d/3ec8ea/32.png) [@daniel](https://forum.magicleap.cloud/u/daniel)\
**Post date:** [September 14, 2022, 3:56pm UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/5 "2022-09-14T15:56:01Z")

</div>

Yes, we have done that now. I created a fresh project using the instructions again. Now we have no input working using the HandsInteraction example. I can upload the example project I setup to github and share the link.

---

<div class="post-metadata">

**Author:** ![sengelman](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/sengelman/32/11_2.png) [@sengelman](https://forum.magicleap.cloud/u/sengelman)\
**Post date:** [September 14, 2022, 11:19pm UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/6 "2022-09-14T23:19:11Z")

</div>

@daniel , that sounds like a fair plan. Keep us updated!

---

<div class="post-metadata">

**Author:** ![daniel](https://avatars.discourse-cdn.com/v4/letter/d/3ec8ea/32.png) [@daniel](https://forum.magicleap.cloud/u/daniel)\
**Post date:** [September 16, 2022, 11:22am UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/7 "2022-09-16T11:22:46Z")

</div>

Hi, we have found that using Unity 2022.2.0b7 helps. We did this on a fresh install of Windows 11 (via Azure VM).

We are still having input profile issues, for example controller + hand tracking together seems to be hit or miss. Spatial mapping also looks like it's not taking senor data, the mesh looks like I am in a large warehouse with a tall ceiling 3-4 stories high, and the floor is a few meters below my feet.

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [September 23, 2022, 10:18pm UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/8 "2022-09-23T22:18:30Z")

</div>

Are you still having issues developing for the Magic Leap using MRTK?

---

<div class="post-metadata">

**Author:** ![daniel](https://avatars.discourse-cdn.com/v4/letter/d/3ec8ea/32.png) [@daniel](https://forum.magicleap.cloud/u/daniel)\
**Post date:** [September 26, 2022, 11:34am UTC](https://forum.magicleap.cloud/t/mrtk-with-hand-tracking-spactial-mapping-controller-and-voice-input-all-active/744/9 "2022-09-26T11:34:06Z")

</div>

Thank you, with the version you zipped over this is now working for us. There is a limitation with the mapping however, but I'll create a new thread.
