Google is upping its game in AR/VR development. Recently, at its annual developer conference, Google I/O, the company announced several huge augmented reality projects. The most noteworthy is the Geospatial ARCore API that is related to map navigation.
If we would describe it in geeky terms, the Geospatial ARCore API allows AR content to be properly geolocated. The ARCore Geospatial API uses Google Earth 3D models and Google Maps Street View image data. It offers users with immersive direction visualization through location-based augmented reality assistance.
To properly understand this, let’s start with understanding the Visual Positioning System (VPS).
Live Wire – Google’s Visual Positioning System (VPS)
In 2019, Google launched Live View. It is an AR overlay on top of Google Maps. Live Wire, integrated with Google’s Visual Positioning System, combines augmented reality with AI and Big Data.
What is VPS?
VPS technology’s core concept is to use the capability of computer vision and camera to provide users with walking navigation. It is a data model founded on trillions of street images from across the world. To provide visual localization information, the system converts the set of images into a high-definition 3D point map.
Then, deep neural networks identify and explain the elements of the image (recognized most likely over time). This localization model has trillions of points and covers every country where Street View is available.
Immersive visualization on Google Maps, which blends aerial and street-level imagery, has now taken it a step further. Earlier, we just had a Global Positioning System (GPS) that provided a limited map view.
We all know and use GPS, but to understand VPS with more clarity, let’s dive a bit into the definition of GPS.
What Exactly is GPS?
A global Positioning System (GPS) is a satellite navigation system that determines an object’s ground position. It is a US-owned utility that offers positioning, navigation, and timing (PNT) services to users.
There are two GPS services available – one for civilians, and the other for the military. The civilian service is available to all users at any time, anywhere in the world. Military service is open to members of the United States and its allies, as well as designated government entities.
When it comes to determining position, GPS and other sensor data alone are rarely enough to reach the precision necessary for augmented reality apps. Therefore, to identify precise positions, the Geospatial API leverages device sensor data (such as GPS), along with acquired image data.
How does it do it? First, the Geospatial system generates an image map. Then, it processes them to detect and match recognized elements of the ecosystem to the VPS localization model. As a result, you get accurate location, position, and orientation on the app.
How Does Visual Positioning System Work?
Visual Positioning System (VPS) enables the smartphone to virtually localize its surroundings on its map. It creates a 3D environment by combining numerous images of the surrounding area.
Using GPS triangulation techniques, the system analyses several images of the surroundings captured by the phone’s camera to reconstruct the location relative to the environment.
Through ad-hoc visual cues, the technology can determine inside and outdoor locations. It identifies distinguishing elements such as sign boards, buildings, landmarks, etc., by scanning geolocated images. Here is how it works:
- The user needs to tap an icon to enable the visual view.
- Then points the camera toward the location where he or she needs to go. An overlay of Google map data will be displayed around them.
- There will be arrows going in the user’s desired direction and a little map at the bottom to remind them of their destination.
Advantages of Visual Positioning System (VPS)
Virtual Positioning System (VPS) is revolutionizing navigation in unprecedented ways. As it gets more sophisticated, the technology will help in numerous ways:
- Speech Assistance for Visual Impaired – The visually impaired will benefit greatly from the close-up visual location guide (through speech assistance). With the VPS, they will navigate across roadways much more easily.
- Easier Navigation in Unknown Places – VPS navigation is much simpler to understand than GPS. People will not feel lost in an unknown location thanks to the camera-assisted navigation support. They just need to open the camera and point it in the direction they want to go.
The technology has the potential to revolutionize navigation in densely populated places where GPS capabilities are frequently disrupted or obstructed by skyscrapers.
- Business & Marketing – Businesses can use VPS to fill out their Google business profile. It can help businesses provide a virtual tour of their store or office location to their clients.
- Logistics – VPS can completely transform the logistics and transportation industries by improving the navigational skills of robots, drones, and self-driving cars.
The Future of VPS & Geospatial ARCore API
The Anchors in ARCore (Google’s product development kit to help create AR apps) uses locally-created image maps to determine position and orientation. However, it doesn’t support taking this image map outside one app for other applications to use. The new Geospatial ARCore API solves this problem.
Geospatial API is a step up from its Cloud Anchors API. The system will determine both horizontal (latitude and longitude) and vertical (height/altitude) positions of an anchor in the Geospatial API. Using these position data, the user can put the anchor practically anywhere in the world.
The VPS localization model is still developing. It will support anchoring on geometric planes as enhancements as the VPS localization model will evolve with the future editions of the Geospatial API. It looks like an exciting time for AR/VR Development in street navigation.