# Mrtk-ml2-1.0.0-v1 from ML Hub flaky, no keyboard

**URL:** <https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103>\
**Category:** Unity Development\
**Tags:** development, unity, ml-hub\
**Created:** [October 17, 2022, 5:50pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103 "2022-10-17T17:50:02Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![juan.suero.robotics](https://avatars.discourse-cdn.com/v4/letter/j/94ad74/32.png) [@juan.suero.robotics](https://forum.magicleap.cloud/u/juan.suero.robotics)\
**Post date:** [October 17, 2022, 5:50pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/1 "2022-10-17T17:50:02Z")

</div>

So im trying to figure out what UI i need to standardize on in the short term because i have an application that supposed to be multiplayer from Hololens2 and Magic Leap 2.  
Theres no photon or anything like that just some middle ware and websockets but 99 percent the same UI would be great.

my choices are  
MRTK3  
MRTK2  
XRI Unity XR Interaction Toolkit.?

I tried to use MRTK3 on magic leap but didnt build  
I was able to get a basic Unity Interaction Toolkit Hello world to build and run.  
then i tried MRTK2 i found in the ML Hub. ( Unity® MRTK Package 1.0.0 Version 1.0 )

C:\Users\meta\MagicLeap\tools\unity\mrtk\v1.0.0-v1  
mrtk-ml2-1.0.0-v1.unitypackage

and it build and deployed and somewhat worked but the hand tracking was super shaky.  
and the controller tracking was unusable. Keyboard wouldnt come up.  
I need the keyboard for my use case.

So what should i choose then XRI? Unity XR Interaction Toolkit? Do you have some documentation on that? Also finally when is MagicLeap coming with OpenXR support in unity?

**Unity Editor version** :  
2022.2.0b10

**ML2 OS version** :  
SDK 1.0.0 is B3E.220818.12-R.046-R.417

**MLSDK version** :  
1.0.0

**Host OS** : (Windows/MacOS)  
Windows 10

**Error messages from logs** (syntax-highlighting is supported via Markdown):

---

<div class="post-metadata">

**Author:** ![sengelman](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/sengelman/32/11_2.png) [@sengelman](https://forum.magicleap.cloud/u/sengelman)\
**Post date:** [October 19, 2022, 3:41pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/2 "2022-10-19T15:41:34Z")

</div>

**We would recommend MRTK version 2** as of October, 2022.

You say the tracking for the Controller is unusable? That's very strange. First, @juan.suero.robotics , please make sure all stickers are removed from the headset and Controller, then report back?

---

<div class="post-metadata">

**Author:** ![juan.suero.robotics](https://avatars.discourse-cdn.com/v4/letter/j/94ad74/32.png) [@juan.suero.robotics](https://forum.magicleap.cloud/u/juan.suero.robotics)\
**Post date:** [October 19, 2022, 7:23pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/3 "2022-10-19T19:23:16Z")

</div>

well i just tried  
unity b11 on magic leap 2 using 3d Core template with MRTK3  
installed with their install tool  
and then git cloning their HandInteractionExamples from

> **[MixedRealityToolkit-Unity/UnityProjects/MRTKDevTemplate at mrtk3 ·...](https://github.com/microsoft/MixedRealityToolkit-Unity/tree/mrtk3/UnityProjects/MRTKDevTemplate)**
>
> mrtk3/UnityProjects/MRTKDevTemplate

i see the nice ray and the controller and i can select things but no grabbing works yet

let me go back and see the MRTK2 with Magic Leap

---

<div class="post-metadata">

**Author:** ![juan.suero.robotics](https://avatars.discourse-cdn.com/v4/letter/j/94ad74/32.png) [@juan.suero.robotics](https://forum.magicleap.cloud/u/juan.suero.robotics)\
**Post date:** [October 20, 2022, 3:17am UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/4 "2022-10-20T03:17:58Z")

</div>

So long story short I think i was facing issues with a project on  
Unity 2022.2.0b11 , using 3D core ( not URP ), and mrtk2 ( the one from ML Hub )  
this project had no hand tracking and no controller but displayed the HandInteractionExamples  
no keyboard

I got MRTK3 to work as mentioned earlier  
with Unity 2022.2.0b11 , using 3D core ( not URP ), and mrtk3  
in this project the controller works to select things with Raycast  
but cant grab, touch, no handtracking  
no keyboard

finally MRTK2 worked under the following configuration  
with Unity 2022.2.0b11 , URP ), and and mrtk2 ( the one from ML Hub )  
full hand tracking, grabbing, but no controller  
no keyboard

---

<div class="post-metadata">

**Author:** ![sengelman](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/sengelman/32/11_2.png) [@sengelman](https://forum.magicleap.cloud/u/sengelman)\
**Post date:** [October 20, 2022, 4:05am UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/5 "2022-10-20T04:05:48Z")

</div>

@juan.suero.robotics We will need logs. I don't have enough information to troubleshoot your Controller not functioning. Is there anything in there that points to a configuration issue? Is your device on the latest OS?

---

<div class="post-metadata">

**Author:** ![juan.suero.robotics](https://avatars.discourse-cdn.com/v4/letter/j/94ad74/32.png) [@juan.suero.robotics](https://forum.magicleap.cloud/u/juan.suero.robotics)\
**Post date:** [October 20, 2022, 12:42pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/6 "2022-10-20T12:42:38Z")

</div>

what are the things required to show the controller?  
is there a controller subsystem check box i dont have checked?

yes i have the latest OS

Build: B3E.220818.12-R.046-R.417  
SDK Version 29

logs attached

is there something in the MRTK i need to enable like the profile.  
im using the default profile that comes with your build of the mrtk2 as provided by the ML Hub  
in the MRTK3 i get form the MRTK3 github they dont use profiles anymore, its based on subsytems or something.

 ![image](https://us1.discourse-cdn.com/flex019/uploads/magicleap1/original/1X/6cdb36d1e6a5ddf8b82f3143a936c531a49dc5ff.jpeg)

[device\_Log\_20221020\_0834\_47.txt](https://forum.magicleap.cloud/uploads/short-url/KZUCTWVnPkXhv3KZ3KYPI6y8zT.txt) (871.2 KB)

---

<div class="post-metadata">

**Author:** ![juan.suero.robotics](https://avatars.discourse-cdn.com/v4/letter/j/94ad74/32.png) [@juan.suero.robotics](https://forum.magicleap.cloud/u/juan.suero.robotics)\
**Post date:** [October 20, 2022, 1:06pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/7 "2022-10-20T13:06:07Z")

</div>

ok that was the issue. well .. that was the final issue i had other issues along the way

issue 1:  
i bought the device early so did not have the latest firmware on the Magic leap  
and ML hub was still having version 0.53 of the SDK while  
internet resources were advising on 0.52  
but now im on version 1.0 of the Magic Leap SDK

issue 2:  
magic leap has not released MRTK2 build yet

issue 3:  
was using 3d Core project and not the universal renderer

issue 4:  
magic leaps mrtk2 ships with only handtracking profile enabled

so finally got it to work and also figured out how to get MRTK3 working on Magic Leap 2  
but only the controller there works no handtracking.  
ill run MRTK3 on hololens 2 and see if they have even finished the handtracking for MRTK3

 ![image](https://us1.discourse-cdn.com/flex019/uploads/magicleap1/original/1X/091b7d56621abfbeecbc6d42f4831b5b749e4827.png)

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [October 20, 2022, 5:14pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/8 "2022-10-20T17:14:11Z")

</div>

@juan.suero.robotics Sorry to hear that you ran into these problems while setting up your project. I logged your feedback so we can improve the MRTK documentation. While we update the guides, lets see if we can get all of the questions answered.

1. Can you provide a link to the guide you were using to setup your MRTK project? The latest version of the setup instructions can be found here : [MagicLeap Developer Documentation](https://developer-docs.magicleap.cloud/docs/guides/third-party/mrtk/mrtk-setup)
2. Are you looking for a sample project that is preconfigured for the Magic Leap 2 and MRTK ? Note, we currently do not provide support for MRTK v3 .
3. Thank you for catching this issue, we will make sure to update the documentation to instruct users to use the Universal render pipeline.
4. Please see the Interactions example scene, this scene demonstrates hand and controller input.

Note, to make sure all of the preconfigured profiles are imported correctly. Please delete the `MRTK - Magic Leap 2` folder and re-import the package when upgrading package versions.

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [October 20, 2022, 5:16pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/9 "2022-10-20T17:16:02Z")

</div>

Regarding the Keyboard -

Currently we do not support a system level keyboard. Instead, developers are encouraged to use a 3rd party solution. Please see the Unity Asset store for a few keyboard options.

---

<div class="post-metadata">

**Author:** ![juan.suero.robotics](https://avatars.discourse-cdn.com/v4/letter/j/94ad74/32.png) [@juan.suero.robotics](https://forum.magicleap.cloud/u/juan.suero.robotics)\
**Post date:** [October 20, 2022, 10:08pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/10 "2022-10-20T22:08:56Z")

</div>

there wasnt alot available out there

> **[GitHub - magicleap/MRTK-MagicLeap: An extension to provide compatibility with...](https://github.com/magicleap/MRTK-MagicLeap)**
>
> An extension to provide compatibility with Magic Leap features such as hand tracking and 6dof controller support, to Microsoft's Mixed reality Toolkit (MRTK). - GitHub - magicleap/MRTK-MagicLea...

[https://developer-docs.magicleap.cloud/docs/guides/third-party/mrtk/mrtk-setup](https://developer-docs.magicleap.cloud/docs/guides/third-party/mrtk/mrtk-setup)

and the readme at  
C:\Users\meta\MagicLeap\tools\unity\mrtk\v1.0.0-v1\README.md  
[https://developer.magicleap.cloud/learn/docs/guides/unity/getting-started/configure-unity-settings](https://developer.magicleap.cloud/learn/docs/guides/unity/getting-started/configure-unity-settings)

---

<div class="post-metadata">

**Author:** ![kbabilinski](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.magicleap.cloud/kbabilinski/32/19_2.png) [@kbabilinski](https://forum.magicleap.cloud/u/kbabilinski)\
**Post date:** [October 25, 2022, 3:19pm UTC](https://forum.magicleap.cloud/t/mrtk-ml2-1-0-0-v1-from-ml-hub-flaky-no-keyboard/1103/11 "2022-10-25T15:19:19Z")

</div>

Thank you, we will correct the github repository description to make it more clear that the github package only supports MRTK for the Magic Leap 1, and that the MRTK support package for Magic Leap 2 needs to be downloaded via the Magic Leap Hub
