Immersive Reality
YouTube ... Quora ...Google search ...Google News ...Bing News
- Immersive Reality ... Metaverse ... Digital Twin ... Internet of Things (IoT) ... Transhumanism
- Assistants ... Personal Companions ... Agents ... Negotiation ... LangChain
- Generative AI ... Conversational AI ... ChatGPT | OpenAI ... Bing | Microsoft ... Bard | Google ... Claude | Anthropic ... Perplexity ... You ... Ernie | Baidu
- Gamification ... Crypto Metaverse
- Oculus | Facebook
- HoloLens | Microsoft
- Krikey - entertain the world through Augmented Reality
- AR/VR for Training & Education | Meetup
- Metaverse: Ambitious augmented-reality tool engages users, promotes coding skills | Common Sense Education
- Don Allen III ... XR/AI futurist
- Magic Leap ... designed and built to integrate useful, usable digital content within its user's unoccluded view of their actual environment.
Immersive Reality (or Extended Reality (XR)) refers to the spectrum of experiences that combine the real and virtual worlds. It includes all forms of immersive technology that can extend, enhance, or replace human experiences; digital content presented to users from a first-person perspective, providing the illusion that users are present within the content rather than observing the content from the outside. It is this sense of presence that is the common denominator among Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR).
Contents
What's the difference? Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR)
- Virtual Reality (VR) is an immersive and interactive simulated environment that is experienced in the first person and provides a strong sense of presence to the user. VR is a type of immersive technology that creates a simulated environment that is experienced in the first person and provides a strong sense of presence to the user. In VR, the user feels present in a fully simulated environment, and can interact with the virtual content in a natural and immersive way. This distinguishes virtual reality from 3D simulations and movies. VR is typically achieved through the use of a VR headset, which completely takes over the user’s vision to give them the impression that they are somewhere else. The headset displays images on LCD or OLED panels inside, which are refracted by lenses to fill the user’s field of vision with whatever is being displayed. This can be a game, a 360-degree video, or just the virtual space of the platform’s interface. In gaming, VR can be used to create immersive experiences where the user feels present in a fully simulated environment. In education, VR can be used to create interactive and immersive learning experiences. For example, medical students can use VR to explore the human body and learn about anatomy. In healthcare, VR can be used for therapy and treatment. For example, VR can be used to treat phobias by exposing patients to virtual simulations of their fears in a controlled environment.
- Augmented Reality (AR) is immersive and interactive virtual content spatially registered to the real world and experienced in the first person, providing a strong sense of presence within a combined real/virtual environment. AR a type of immersive technology that overlays virtual content on the real world in real-time. In AR, the user sees the real world through a camera or transparent display, and virtual content is added to the scene to create an augmented experience. AR can be experienced through a variety of devices, including smartphones, tablets, and AR glasses. The virtual content in AR can range from simple 2D images and text to complex 3D models and animations. AR can be used for a wide range of applications, including gaming, education, advertising, and more. There are many examples of Augmented Reality (AR) across various industries. In gaming, AR can be used to create immersive experiences where virtual game characters are overlaid on the real world. For example, Pokémon Go lets users search for animated characters in their real-life neighborhoods. In education, AR can be used to create interactive and immersive learning experiences. For example, language translation apps can use AR to overlay translations on real-world text. In healthcare, AR can be used to visualize medical data and aid in diagnosis and treatment. In retail, AR can be used to allow customers to visualize products in real environments before making a purchase. For example, the Target app has a feature called “See it in Your Space” that enables users to take a photo of a space in their home and digitally view an object to see how it will look there.
- Mixed Reality (MR) a type of immersive media that combines elements of both Virtual Reality (VR) and Augmented Reality (AR). In MR, virtual content is not only overlaid on the real world but can also interact with it in real-time. This creates a more immersive experience where the virtual and real worlds are blended together.
Telepresence
Telepresence refers to a set of technologies that allow a person to feel as if they were present, to give the appearance or effect of being present via telerobotics, at a place other than their true location. Telepresence requires that the user's senses interact with specific stimuli to provide the feeling of being in that other location. Additionally, users may be given the ability to affect the remote location. In this case, the user's position, movements, actions, voice, etc. may be sensed to transmit and duplicate in the remote location to bring about this effect. Telepresence is distinct from virtual presence, where the user is given the impression of being in a simulated environment. Telepresence and virtual presence rely on similar user-interface equipment, and they share the common feature that the user interacts with a remote location. Telepresence can be used for various purposes, including remote work, meetings, and collaboration. For example, Cisco TelePresence Systems enable in-person collaboration with simplicity and state-of-the-art. Telepresence can also be used for local development against a remote Kubernetes or OpenShift cluster.
Here are some examples of telepresence technology:
- Video Conferencing: Video conferencing allows people in different locations to have real-time audio and video communication, giving the impression of being in the same room. This technology is commonly used for remote meetings and collaboration.
- Telepresence Robots: Telepresence robots are mobile devices equipped with cameras, microphones, and displays that allow users to remotely navigate and interact with a physical environment. These robots provide a physical presence for the user in a remote location, enabling them to participate in events, explore spaces, or interact with people.
- Holographic Telepresence: Holographic telepresence combines telepresence technology with augmented reality to create the illusion of a hologram of a person in a physical space. This technology allows users to interact with virtual objects and people as if they were physically present.
- Virtual Reality (VR) Telepresence: VR telepresence uses virtual reality technology to create an immersive experience where users feel as if they are physically present in a remote location. Users can interact with the virtual environment and communicate with others in real-time.
- Remote Surgery: Telepresence technology is used in the field of medicine to enable surgeons to perform procedures remotely. Surgeons can control robotic systems equipped with cameras and surgical instruments to perform surgeries in distant locations.
- Remote Exploration: Telepresence technology is used in various industries, such as deep-sea exploration and space exploration, to allow operators to remotely control robots and probes in hazardous or inaccessible environments.
- Remote Education: Telepresence technology is used in education to connect educators, students, and professionals across different locations. It enables remote learning, virtual classrooms, and interactive lectures.
VR Showcase
AR Showcase
VRChat
Youtube search... ...Google search
VRChat is a free-to-play massively multiplayer online virtual reality social platform created by Graham Gaylor and Jesse Joudrey. It allows players to interact with others as 3D character models. The game was released for Microsoft Windows as a standalone application compatible with the Oculus DK1 development kit on January 16, 2014, and via Steam's early access program on February 1, 2017. It supports the Oculus Rift, Oculus Rift S and the Oculus Quest via the Oculus Store, the HTC Vive series, Windows Mixed Reality headsets and the Valve Index through SteamVR. Notably, it also supports full-body humanoid avatar tracking via Vive Trackers, though none of these accessories are mandatory to play. The game later launched on the Oculus Quest on May 20, 2019, supporting limited cross-play with the Microsoft Windows version. Wikipedia
Vision Pro | Apple
Apple Vision Pro is a new mixed reality; augmented reality headset with straps and an external battery pack that can capture photos and videos, show movies, and more. The device blends digital content into the space around us, according to Apple. The company calls this new technology spatial computing. The Vision Pro is a standalone headset featuring an innovative design without the need for a dedicated controller. Instead, thanks to the use of multiple external and internal sensors and cameras, Apple is planning to rely entirely on voice inputs and hand/eye gestures. It also features Optic ID, Apple's latest biometric security authentication technology based on the details of your iris. One of the interesting features of the Vision Pro is that it will let you replace your face with a hyperrealistic avatar when you’re using FaceTime. You can scan your face using the headset to create a digital “persona” of yourself that will appear during video calls.
Unity
Start bringing your vision to life today with the Unity real-time 3D development platform.
- Games Bring your game to life with the world's leading platform for creating and operating interactive, real-time 3D content. Unity enables you to quickly create, easily operate, and fully monetize your game.
- Automotive, Transportation & Manufacturing Bring the power of immersive, interactive experiences across every stage of your product lifecycle using our real-time 3D development platform.
- Film, animation and cinematic From independent boutiques to global media producers, studios around the world are harnessing the power of real-time rendering to speed up production, smooth workflow hurdles, and grow their creativity with Unity.
- Architecture, Engineering & Construction Our new real-time BIM product Unity Reflect is now available. Create immersive, interactive experiences in VR and AR, from Autodesk Revit, Navisworks, SketchUp, and Rhino.
Unity AI Machine Learning
Youtube search... ...Google search
At Unity, we aim to maximize the transformative impact of Machine Learning for researchers and developers alike. Our Machine Learning tools, combined with the Unity platform, promote innovation. To further strengthen the Machine Learning community, we provide a forum where researchers and developers can exchange information, share projects, and support one another to advance the field. Unity Machine Learning Agents allows researchers and developers to create games and simulations using the Unity Editor which serve as environments where intelligent agents can be trained using reinforcement learning, neuroevolution, or other machine learning methods through a simple-to-use Python API.
Unity ML Agents
- Unity_ML_Agents | Siraj Raval - GitHub
Creating 3D Artificial Intelligence in a simulated world is actually pretty easy using Unity 5. It's a powerful tool and I'll go over its new ML Agents toolkit, that allows researchers and developers to build/train ML models in a 3D simulation. It's pretty fun watching it in a 3D world, lets break down the code and concepts. | Siraj Raval
Baton Master
- Baton_Master_Unity | Siraj Raval - GitHub
Baton Master is an educational Virtual Reality experience built for the Oculus platform. It allows a player to conduct an orchestra in a simulated environment. This is a project built using Unity, and the implementation files are in C#. Right now, the game is built around 1 song: "Finish the Fight" by Michael Salvatorri, aka the Halo 3 theme (because Halo 3 will always be my favorite Halo game, sorry kids). But more songs can easily be added once you understand the project structure and game mechanics. The future of Education is gaming, and in order to build that future we need to start building high quality, engaging educational games. In this tutorial, I show you how I built my first game for the Oculus Virtual Reality platform in C# using Unity. Baton Master lets you practice conducting in a simulated orchestral environmental. I wanted to understand the process of encoding real-world knowledge into game mechanics. I recorded a 3 hour screencast of me rebuilding it from scratch but i condensed it as much as I could to focus on the most relevant parts for you. I'm also releasing the code so please use it as you need it to learn, build, and explore the incredible world of Virtual Reality. | Siraj Raval
Auki Labs
- Auki Labs ... creating a decentralized protocol for collaborative spatial computing
- Conjure Kit
Auki Labs is a company that is creating a protocol for collaborative spatial computing to allow for social AR experiences. Their flagship product, the ConjureKit, allows you to manifest your imagination in the reality we all inhabit. They have developed a patent-pending instant calibration method that gives AR developers unprecedented ability to create social experiences. Peer-to-peer positioning ensures relevant relative positioning without awkward or time-consuming preparations Auki Labs also have a bespoke distributed networking engine that makes developing spatial multiplayer experiences effortless.
Bockade Labs
- Bockade Labs ... from text prompts create 360° landscapes
- Unreal Engine ... open and advanced real-time 3D creation tool
Blockade Labs is a technology company that creates AI-powered tools for world-building technowizards. They are committed to breaking down the barriers between technology and creativity so that everyone can manifest their ideas into reality. One of their products is Skybox Lab, an AI-powered solution for generating incredible 360° skybox experiences from text prompts.
Security