The Metaverse - AR, VR, MR

The connotation of the metaverse has absorbed the achievements of the information revolution (5G/6G), the Internet revolution (web3.0), the artificial intelligence revolution, and the virtual reality technology revolution including VR, AR, MR, and especially game engines, showing humans the possibility of building a holographic digital world parallel to the traditional physical world; it has triggered the interaction of information science, quantum science, mathematics and life sciences, and changed the scientific paradigm; it has promoted breakthroughs in traditional philosophy, sociology and even humanities systems; it encompasses all digital technologies, including the achievements of blockchain technology; it has enriched the digital economic transformation model, and integrated digital financial achievements such as DeFi, IPFS, and NFT.

AR (Augmented Reality)

AR is a new technology that "seamlessly" integrates real-world information and virtual-world information. This technology uses computer technology to superimpose virtual information on the real world, and displays it through mobile phones, tablets and other devices, so that people can perceive it, thereby achieving a great fusion of reality and virtuality, enriching the real world, and showing scenes that cannot be realized in the real world, thereby achieving "enhancement" of reality and achieving a sensory experience beyond reality. In short, it is to "live" the content of the plane itself, give the physical object more information, enhance the three-dimensional sense, and enhance the visual effect and interactive experience.

The common application of AR technology is to use the mobile phone camera to scan objects in the real world, and display the corresponding pictures, audio and video, 3D models, etc. on the mobile phone through image recognition technology. Such as the "AR red envelope" function of some software. And the deeper application of AR technology is still being explored.

VR (Virtual Reality)

Virtual reality, also known as spiritual technology, has the characteristics of immersion, interactivity and imagination. VR technology combines computer graphics, simulation technology, multimedia technology, artificial intelligence technology, computer network technology, parallel processing technology and multi-sensor technology, simulating the functions of human vision, hearing, touch and other sensory organs, making people immersed in the virtual world generated by the computer, and can communicate in real time through language, gestures, etc., to enhance the sense of entry and immersion. Through VR technology, people can feel the real world realistically while breaking through the limitations of time and space and other conditions, and feel the wonderful experience of entering the virtual world.

The application of VR technology is very wide, such as astronauts using VR simulation technology for training; architects make drawings into three-dimensional virtual buildings for easy experience and modification; real estate developers allow customers to visit houses in person; virtual stage scenes produced by the entertainment industry, etc.

MR (Mixed Reality)

MR stands for Mixed Reality, which is a further development of virtual reality technology. It introduces real scene information into the virtual environment, builds a bridge of interactive feedback information between the virtual world, the real world and the user, and thus enhances the realism of the user experience. The key point of MR technology is to interact with the real world and obtain information in a timely manner. Therefore, its implementation needs to be in an environment that can interact with various things in the real world. MR technology allows the real self to interact with virtual (or physical) objects and scenes at will, achieving the interweaving of virtual and real.

The interactive feedback between virtual and real MR technology enables people to communicate at a long distance, which is very practical. For example, with the support of 5G network, doctors in two places can perform surgery and guidance simultaneously, which is of great significance in the medical field.

The difference between VR and AR:

In simple terms, in virtual reality (VR), the scenes and characters you see are all fake, which is to put your consciousness into a virtual world. In augmented reality (AR), the scenes and characters you see are partly real and partly fake, which is to bring virtual information into the real world.

Interaction difference

VR equipment: Because VR is a purely virtual scene, VR equipment is more used for the interaction between users and virtual scenes. More uses are: position trackers, data gloves (such as 5DT), motion capture systems, data helmets, etc.

AR equipment: Since AR is a combination of real scenes and virtual scenes, it basically requires a camera. Based on the pictures taken by the camera, it is combined with virtual pictures for display and interaction, such as GOOGLE GLASS (in fact, strictly speaking, IPAD, mobile phones and other smart products with cameras can be used for AR, as long as AR software is installed.)

Technical difference

Similar to game production, creating a virtual scene for people to experience, its core is the use of various graphics technologies. The most common application we have is in games, which can be said to be an upgraded version of traditional game entertainment equipment, mainly focusing on whether the virtual scene has a good experience. They don't care whether it is related to the real scene. VR devices are often immersive, and the typical device is Oculus Rift.

AR uses a lot of computer vision technology. AR devices emphasize the function of restoring human vision, such as automatically identifying and tracking objects, instead of me pointing them out manually; autonomously tracking and 3D modeling of the surrounding real scene, instead of me opening Maya to make a very similar scene. The typical AR device is an ordinary mobile phone, and the upgraded version is Google Project Tango.