iOS - RealityKit 2

July 12, 2021 Publish By : EXPERT APP DEVS 2 min read Viewed By : 828
iOS RealityKit 2

Overview :- 

  • RealityKit is a framework. Is used to implement high-performance 3D simulation and rendering.
  • Using realityKit developers will have more visual, audio and animation control when working on their AR.

 

Captured chair image and arrange in other place using AR Kit

  • Capture chair image and arrange in other place 

chairs are arranged using AR Kit

  • In above image the chairs are arranged using AR Kit 
  1. Custom Shaders & Meshes

  • Reality Kit has two amazing features that bring RealityKit to the next level. 
  • Using this feature developers customize materials and graphics and generate 3D content or shapes.
  1. Faces

  • Using TrueDepth camera you can access face meshes 
  • This feature is used for AR photo filters that need to place some content that fits to the face shape.
  1. Audio

  • Using this new AudioBufferResource you can create spatial-aware sounds dynamically instead of loading from static files. 
  1.      Component System

  • The session highlighted updates to the entity components 
  • To build your own entity component system you can arrange assets in your AR scene and you can build more complex functionality into the system layer. 
  • The session introduced Systems in such a  way to control 3D models, listen for the updates and coordinate with the events. EntityQuery is used to search a scene for entities with specified components.
  • Entity should be used as a container of components with an identifier, so all information about the appearance, animation, behaviors and other state should belong in components.
  1.      Animation

  • Now it's possible to blend multiple animations together and adjust the speed and also work with animation timelines. It will be easy to tailor animations beyond what a USDZ already contains.
  1.       Character Controller

  • 3D reconstruction of the world from the LiDAR on iPhone 12 Pro and iPad Pro, Scene Understanding makes AR experiences even more realistic by allowing virtual content to collide with and be occluded by the real world. 
  • A Character Controller makes it easy to work with user-controlled objects. Simply we define a CapsuleShape that takes the shape and size of the 3D model to detect collisions with the world around you. Then you can call the move(to:) method to have the character navigate around real obstacles on its way to the final destination. Or, if you’d prefer a more direct path, teleport(to:) will move the object without paying attention to objects in the way.

References :- 

https://developer.apple.com/augmented-reality/realitykit/

https://ethansaadia.medium.com/whats-new-in-realitykit-2-b2a7db4b57e

Need a consultation?

Drop us a line! We are here to answer your questions 24/7.