Mixed Reality Toolkit

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
Mixed Reality Toolkit (MRTK)
Other namesHoloToolkit (HTK)
DeveloperMicrosoft
Initial release2017; 9 years ago (2017)
Stable release
v2.8.3 / November 7, 2022; 3 years ago (2022-11-07)
Repositorygithub.com/MixedRealityToolkit/MixedRealityToolkit-Unity
Written inC#
Engine
    Lua error in Module:EditAtWikidata at line 29: attempt to index field 'wikibase' (a nil value).
    LicenseMIT License
    Websitelearn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk3-overview/
    As ofMarch 2023

    Mixed Reality Toolkit (MRTK) is an open-source software development kit (SDK) developed by Microsoft in 2016 for the development of mixed reality (MR) and augmented reality (AR) software applications.[1][2] It consists of a collection of components and features designed to enhance the mixed reality user and developer experiences.[3] The toolkit was originally developed by Microsoft for the release of the HoloLens 1 augmented reality headset, although it supports a variety of platforms.[2]

    History

    [edit | edit source]

    Initial release

    [edit | edit source]

    Known as the "HoloToolkit" (HTK) prior to its initial public release, the software development kit was created to aid in the development of the new Microsoft HoloLens augmented reality device. Mixed Reality Toolkit was released to the public as an open-source SDK in December 2017, one year after the release of Microsoft's HoloLens.[4] The software has had multiple successful generations, including MRTK, MRTK2, and the soon-to-be-released MRTK3.

    HoloLens Augmented Reality Headset
    HoloLens Augmented Reality Headset

    Layoffs

    [edit | edit source]

    On January 18, 2023, Microsoft announced that it would be laying off approximately 10,000 employees.[5] Days later, these layoffs were found to include the entire team behind the development of MRTK, along with significant portions of the HoloLens hardware team.[6] Currently, the future of MRTK is uncertain, although it is expected that the extended reality (XR) community will continue to maintain the software due to it being released as open-source under the MIT License.

    Transition to independent governance

    [edit | edit source]

    In September 2023, the Mixed Reality Toolkit transitioned into an independent GitHub organization and is now overseen by a steering committee, which includes representatives from Microsoft, Magic Leap, and Qualcomm.[7] Qualcomm reaffirmed its commitment by ensuring continued support for cross-platform interoperability, particularly through integration with its Snapdragon Spaces XR Developer Platform.[8] The MRTK codebase remains open source and is licensed under the MIT License, enabling community-driven contributions across augmented reality and virtual reality platforms. [9]

    Supported platforms

    [edit | edit source]

    Mixed Reality Toolkit is considered to be a platform-agnostic tool as it features a wide variety of supported platforms.[1] This high level of compatibility allows developers to quickly and easily build mixed reality applications tailored to the specific platform they are working on.[3] The following is a list of supported platforms:

    Supported Platform Minimum Version Devices
    OpenXR Unity 2020.3.8+ HoloLens 2, Windows Mixed Reality headsets, Meta Quest, Magic Leap 2 SteamVR devices
    Windows XR Plugin N/A HoloLens, HoloLens 2, Windows Mixed Reality headsets
    Oculus XR Plugin Unity 2019.3+ Meta Quest, Meta Quest 2, Meta Quest 3, Meta Quest Pro
    ARCore XR Plugin N/A Android devices (via AR Foundation)
    ARKit XR Plugin N/A iOS devices (via AR Foundation)
    OpenVR N/A Windows Mixed Reality headsets, HTC Vive, Oculus Rift
    Ultraleap Hand Tracking N/A Ultraleap Leap Motion controller
    Unreal Engine N/A HoloLens2, Windows mixed Reality, SteamVR

    Components and features

    [edit | edit source]

    Mixed Reality Toolkit is equipped with a range of components and features that allow developers to create immersive mixed reality applications. These provide developers with a broad range of tools and technologies, including low-level APIs, and high-level development frameworks.[3] These components and features are designed to be used in combination with additional software libraries to create engaging and interactive mixed reality experiences.

    MRTK primary feature areas
    Name Description
    Input System Provides developers with the ability to read and handle device-level input events from a wide range of sources
    Hand Tracking (HoloLens 2) Enables users to control their HoloLens 2 device with their hands
    Eye Tracking (HoloLens 2) Interprets user eye movements to provide accurate interactions
    Profiles Configurable profiles used to set up and manage the toolkit in each scene
    Hand Tracking (Ultraleap) Enables users to control their device by interfacing with the Leap Motion Data Provider
    UI Controls Pre-made UI components used to quickly create user interfaces
    Solvers Components to solve complex problems in mixed reality, such as object placement and 3D manipulation
    Multi-Scene Manager System for managing multiple scenes in mixed reality, including scene loading, unloading, and transition effects
    Spatial Awareness Detects physical environment elements to enhance user experience and interactions
    Diagnostic Tool Interface which provides critical runtime verification data to simplify system debugging and analysis
    MRTK Standard Shader Shader system designed to implement high quality, yet performant, visuals on mixed reality devices
    Speech & Dictation Utilizes speech recognition and natural language processing to interpret user keywords and commands
    Boundary System Defines the boundaries of a user's area for increased safety and awareness
    In-Editor Simulation Interface designed to test a range of MRTK interactions within the editor without creating a new build
    Experimental Features Features currently in development or unfinished, which may not have been thoroughly tested

    MRTK contains UX building block components, which include buttons, object manipulators, system keyboards, object collections, and more.[3] These tools are provided to developers with the intention of simplifying the development process and encouraging innovation in mixed reality.

    See also

    [edit | edit source]

    References

    [edit | edit source]
    1. ^ a b Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    2. ^ a b Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    3. ^ a b c d Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    4. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    5. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    6. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    7. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    8. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    9. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
    [edit | edit source]