SDKs I recommend for #AR & #VR with details that makes each of them unique & useful for different use cases:
π MRTK (Microsoft Mixed Reality Toolkit): one of my favorites and it is a powerful open source project that accelerates cross-platform mixed reality creation.
𧡠Thread
π MRTK (Microsoft Mixed Reality Toolkit): one of my favorites and it is a powerful open source project that accelerates cross-platform mixed reality creation.
𧡠Thread
MRTK provides a lot of features and supports a large amount of XR devices such as HoloLens 2, Meta Quest, Windows Mixed Reality, SteamVR, and others.
More information about MRTK: learn.microsoft.com/en-us/windows/β¦
More information about MRTK: learn.microsoft.com/en-us/windows/β¦
π AR Foundation: a super useful cross-platform wrapper around augmented reality SDKs that allow you to work with a common set of APIs.
The idea of AR Foundation is to use XR Plugins such as Google ARCore XR Plug-in (on Android) Apple ARKit XR Plug-in (on iOS), and others.
The idea of AR Foundation is to use XR Plugins such as Google ARCore XR Plug-in (on Android) Apple ARKit XR Plug-in (on iOS), and others.
AR Foundation allows you to use core device features such as device tracking, plane detection, point clouds, anchors, 2d image tracking, 3d object tracking, body tracking, and much more.
One important aspect is that you can ask AR Foundation if a specific feature is supported or not to help with providing your users with the best experience possible.
More info about AR Foundation: docs.unity3d.com/Packages/com.uβ¦
More info about AR Foundation: docs.unity3d.com/Packages/com.uβ¦
π Lightship ARDK: an amazing cross-platform toolkit for #AR which is powerful but I wish they wouldβve taken advantage of AR Foundation and not write everything from the ground up, however they add a lot more features to their toolkit than whatβs available with AR Foundation.
Lightship ARDK provides features such as real-time mapping, multiplayer, semantic segmentation, and the incredible VPS system for virtual positioning.
More info about Lightship ARDK: lightship.dev/products/ardk
More info about Lightship ARDK: lightship.dev/products/ardk
π XR Interaction Toolkit: is a super cool drag and drop component-based interaction system (also cross-platform) which allows you to use a set of predefined components to create AR or VR experiences with Unity.
XR Interaction Toolkit provides the following features:
- Cross-platform XR controller input
- Basic object hover, select, and grab
- Haptic feedback for controllers
- Canvas interactions
- Support to room-scale vs stationary for VR camera rigs
- Cross-platform XR controller input
- Basic object hover, select, and grab
- Haptic feedback for controllers
- Canvas interactions
- Support to room-scale vs stationary for VR camera rigs
XR Interaction Toolkit also provides an AR system with a built-in interaction system for object manipulation, AR Annotations, and a lot more.
More info about XR Interaction Toolkit: docs.unity3d.com/Packages/com.uβ¦
More info about XR Interaction Toolkit: docs.unity3d.com/Packages/com.uβ¦
π UltimateXR: is an open source framework / toolkit for Unity which provides cross-platform support for VR experiences as well as grab and manipulation mechanics, hand tracking features, customizable full body avatars, advanced UI components, locomotion mechanics, and more.
More information about UltimateXR can be found at: ultimatexr.io
π Oculus Integration: is a Meta / Oculus SDK for all XR features available to develop with Meta Quest devices, XR Controller handling, Camera Rigs stationary or room-scale, Canvas Input support, passthrough, hand tracking, controller tracking, and much more.
More information about Oculus Integration: developer.oculus.com/downloads/packβ¦
π Oculus Integration (Interaction SDK): heavily recommended as it provides everything you need to create realistic hand and controller interactions.
This system allows you to author gestures or use predefined gestures available out of the box, grab interactions, hover interactions, and a bunch of different components which will make your hands' experiences feel a lot more vivid.
π Oculus Integration (Movement SDK): introduced a few days ago and is a system which allows you to use eye tracking features from Meta Quest Pro and use body and eye tracking with Meta Quest devices.
π Oculus Integration (Voice SDK): enables you to bring voice interactions to your AR/VR experiences. This system is powered by Wit.ai Natural Language Understanding (NLU).
π Needle Tools: one of my favorites today and is a web-based runtime for 3D experiences, it is flexible, and it allows you to use it with Web XR for AR and VR experiences on supported browsers.
More information about Needle Tools: needle.tools
More information about Needle Tools: needle.tools
π VRIF: A very popular interaction framework which makes it very easy to create your own object interactions with a predefined list of components. Some of the components allow you to do physical grabbing and throwing of objects, handle buttons, knobs, levers, and other objects.
More information about VRIF: assetstore.unity.com/packages/templβ¦
π Hurricane VR: very similar to VRIF but with a heavy focus on providing high quality physics interactions.
More information about Hurricane VR:
assetstore.unity.com/packages/toolsβ¦
More information about Hurricane VR:
assetstore.unity.com/packages/toolsβ¦
Well thatβs a wrap up of some of the main SDKs I have mostly used and if you have others that you like to mention be sure do so below π
β’ β’ β’
Missing some Tweet in this thread? You can try to
force a refresh
γ
