Today we’ve launched our latest major quarterly Operating System and SDK release, featuring a new facial expression API, hotly anticipated depth camera sensor enhancements, and a whole host of updates. Let’s dive into the details.
Release Highlights
Facial Expression API
We’re introducing our MLFacialExpression API for C API and Unity to make avatar animation more dynamic. Our motion capture process uses real-time data from the headset camera to detect a range of the user’s facial expressions. Currently the API supports blinks, eye openness, eyelid tightening, cheek raises, brow movement and more. We plan on supporting asymmetrical eye expressions like winks in future releases.
Depth Camera API
One request we frequently heard from developers over the past few months focused on our MLDepthCamera API for C API and Unity. Specifically, developers wanted - nay, demanded - short-range mode to take full advantage of our Depth Camera sensor data.
Well, we delivered.
In this release, we enabled short-range mode and the ability to switch between long and short range modes. We also enabled the capability to set depth camera frame rate, and exposure time. Please note this is an experimental API.
Voice Intent Development Toolkit
We’re proud to introduce our Voice Intent Development Toolkit for Magic Leap 2 to enhance voice command development. The toolkit serves as an assistant for app developers to build application-specific voice experiences.
The local web service provides an intuitive user interface and aims to guide the voice intent developers from the creation of the very first voice intent to the creation of the asset (which is a Magic Leap 2-specific JSON scheme) that can be co-deployed with the desired application.
The English and Japanese languages are currently supported.
Dual Role USB-C Port Support
Magic Leap 2 now supports dual role USB-C port functionality, and developers can now disable the automatic data transfer protocol prompt to better suit their needs. The device will default to File Transfer / ML Hub Connectivity and can be configured in the Settings App.
Third Party Resources
This month we’re spotlighting Ready Player Me, a leading avatar platform which works perfectly with Magic Leap 2. In fact, let us show you. We developed a guide to implement the Ready Player Me VR half-body avatars inside your Unity project for Magic Leap 2. In this guide, we walk developers through how to use Magic Leap 2’s multiple sensors for an engaging avatar experience.
Let us know what other guides you’d like to see from us.
SDK Release Highlights
API Updates
- New MLFacialExpressions API (C API, Unity)
- MLDepthCamera Experimental API (C API, Unity):
- Enabled Short Range mode and ability to switch between Long and Short Range modes;
- Enabled capability to set frame rate and exposure time.
This is a breaking change to the experimental API.
- MLAudio API: Exposed MLAudioMicCaptureType_RawMicsAndAECRef to get raw microphone streams. (C API)
- MLInput API: Updated API documentation to reflect valid ranges for MLInputBuzzCommand. (C API)
- Enabled headset left and right uncalibrated magnetometer streams via standard Android APIs.
Systems & Performance
Power Management
- Sleep Mode: This release exposes the Sleep power state. The Sleep power state may be entered: (a) automatically, from the Standby power state following the expiration of a user configurable timer or (b) directly, from the Device Modal via a press of the Sleep button. In this release, the Sleep power state is disabled by default.
- Automatic Power-Off: This feature automatically powers off the device from the Sleep power state following the expiration of a user configurable timer. This feature is disabled by default.
- Battery Saver mode: The release exposes the Battery Saver mode to reduce average power consumption and extend battery life. In this release, the Battery Saver feature is disabled by default.
1.3.1 Package Version Guide
Listed below are the version numbers of the packages that comprise the 1.3.1 update:
- Magic Leap OS - 1.3.1 [B3E.230616.02-R.121]
- Unity SDK -1.9.0
- C SDK - 1.3.1
- MRTK - 1.7.0 Version 1.0
- MRTK 3 - 1.0.0 Preview 3
- OpenXR - 1.3.1
Reminder: if you update to the latest SDK, you also need to update the OS on your device. If you are using Unity, be sure to use the versions listed above for full compatibility. After you download the packages listed above, check out our setup guides.
Unity 2022 Long Term Support
A reminder Unity announced long term support for its 2022 editor and runtime in June. Magic Leap 2 requires 2022.2.x, so now developers can be sure they are building for a stable Unity LTS environment when developing Magic Leap 2 apps. Never a better time than now to develop for our platform.
Developer Input and Feedback
Our Developer Forum and our Bug Report submission form are prime channels for direct input to continuously improve Magic Leap 2. If you have an issue developing for our platform, give us a shout on the Forum. We respond to each question. If you suspect you’ve found a bug, don’t hesitate to report it to us either through the bug report form or a forum post.