Volvo Cars engineers call it “the ultimate driving simulator”, but it is not just an excuse for them to indulge their inner basement gamer. Instead, the Swedish company’s ground-breaking mixed-reality simulator is used to make new strides in safety and autonomous driving technology.
A setup with a moving driving seat, a steering wheel with haptic feedback, and a crystal-clear virtual reality headset would make any serious gamer jealous, but Volvo Cars’ simulator takes this concept to the next level, making it hard to tell reality from the simulation. Which is exactly the point.
Using cutting-edge technology from the leading real-time 3D development platform Unity and Finnish virtual and mixed reality experts Varjo, the simulator involves driving a real car on real roads. It combines life-like, high definition 3D graphics, an augmented reality headset, and a full-body Teslasuit that provides haptic feedback from a virtual world, while also monitoring bodily reactions.
This combination of software and hardware allows Volvo Cars engineers to endlessly simulate traffic scenarios on a real test track road while using a real car, all in total safety. Engineers can gain important insights on the interaction between people and the car for the development of new safety, driver assistance, and autonomous driving features.
Testers can be exposed to imagined active safety and driver assistance features, upcoming autonomous drive user interfaces, future car models, and many other scenarios. It can be used on real test track roads or in the test lab, and every scenario is fully customizable. The possibilities are literally endless.
Volvo Cars “ultimate simulator” was demonstrated yesterday in an event live-streamed from Volvo’s Open Innovation Arena and hosted by a team of its innovation experts. Last year, together with Varjo, Volvo Cars became the first car maker to make it possible to drive a real car while wearing a mixed reality headset. Now that collaboration has been expanded to include Unity and full-body haptic suit maker Teslasuit.
According to Casper Wickman, senior leader of User Experience at Volvo’s Open Innovation Arena and one of the hosts of the Livestream, this enables Volvo Cars to study authentic human reactions in a safe environment and at a fraction of the cost of a real test.
“Working together with great companies like Varjo, Unity, and Teslasuit has allowed us to test so many scenarios that look and feel totally real, without having to physically build anything,” says Casper Wickman. “It lets us test drive actual cars in through traffic scenarios that look and feel real, but can be adjusted at the touch of a button.”
When developing safety systems for cars, like collision-avoiding technologies, testing is crucial. But testing these systems, in reality, can be dangerous, time-consuming, and expensive. Virtual and mixed reality simulations, however, allow for perfectly safe testing in authentic environments, without having to build any physical prototypes or set up complex scenarios.
“By using this cutting-edge technology, we are exploring and leading the development for creating safe cars in the future. It’s great to play a part in that,” said Casper Wickman.
Varjo Mixed Reality Headset
Last year, Volvo Cars, together with Varjo, became the first car maker to make it possible to drive a real car while wearing a mixed reality headset. The Varjo XR-1 Developer Edition headset uses video cameras to enable mixed reality and provides mixed or virtual reality at a high-definition resolution. With the Varjo XR-1 headset, the objects and environments created in Unity can be seamlessly integrated into the real world.
Through the application of forces, vibrations, or motions, haptic technology makes it possible to recreate the experience of touch when interacting with the virtual world. By wearing Teslasuit’s advanced full-body haptic suit, Volvo’s simulation testers can physically feel small reproductions of the forces one would experience in a crash, while experiencing no actual risk. The suit also enables Volvo’s engineers to test these reactions by studying how muscles, stress levels, and heart rate react under stress and apply this learning in creating the next generation of safety systems aimed at avoiding and mitigating risky situations.
Unity Simulation Engines
The simulation scenarios are created using the latest real-time 3D software from Unity, the company behind one of the world’s most popular development platforms for video game development. Using Unity, Volvo experts can create virtual environments and objects to use in simulations or put a fully accurate 3D model of any Volvo car design into any virtual environment, assessing the design in different lights, locations and weather.