At Wayve, we are committed to pushing the boundaries of automated driving by harnessing frontier AI technology and world-class collaborations. Since 2018, our work with NVIDIA has played a crucial role in advancing our mission to reimagine autonomous mobility through embodied intelligence, including NVIDIA’s participation in Wayve’s Series C investment round in May 2024.
Today at CES, NVIDIA Cosmos™ was unveiled. Cosmos is a platform comprising state-of-the-art generative world foundation models, advanced tokenizers, guardrails and an accelerated video processing pipeline built to advance the development of physical AI systems such as autonomous vehicles (AVs) and robots. We are excited to be among the first companies to explore Cosmos to complement our industry-leading R&D programmes and enhance our path to market.
Advancing Foundation Models for Driving
Multimodal foundation models are central to Wayve’s unique AV2.0 approach to self-driving, which we have been pioneering since 2017. By integrating vision, language, and action, our advanced end-to-end AI models offer unparalleled capabilities in understanding complex driving environments, equipping vehicles with an intelligent "robot brain" that learns from and dynamically interacts with its surroundings.
Advancements in world models and generative AI enable us to simulate diverse driving scenarios and generate high-quality synthetic data. Wayve GAIA, the world’s first generative world model for autonomy, and Wayve PRISM, a novel 4D scene reconstruction model enabling photorealistic representations of dynamic scenes, play a pivotal role in enhancing the decision-making capabilities of the Wayve AI Driver. Such AI breakthroughs are critical to accelerating the journey toward higher levels of autonomy, from L2+ assisted driving to L4 automated driving. Wayve’s world-class research has laid a strong foundation for collaborating with industry leaders like NVIDIA.
Key Areas of Collaboration with NVIDIA
Our ongoing work with NVIDIA focuses on three areas of innovation and development to advance AI-driven mobility:
1. Embedded Integration: NVIDIA’s automotive-grade hardware provides a solid foundation for building robust, embedded solutions. Working closely with NVIDIA’s engineering teams ensures that Wayve’s end-to-end AI models operate seamlessly on vehicle hardware stacks. This collaboration paves the way for scalable, real-world deployment of our autonomous driving technology on millions of vehicles.
2. Offline Capabilities and Tooling: Wayve’s AI training and fleet learning infrastructure is built on Microsoft Azure, which relies on NVIDIA’s industry-leading hardware. This offline tooling is designed to allow OEMs to optimize, validate, and customize our driving models. This ensures high performance across various automotive platforms and market conditions while maintaining operational efficiency. By combining our expertise, we can enable automakers to seamlessly integrate AI solutions into their production workflows.
3. Strategic Ecosystem Alignment: Teaming with NVIDIA aligns Wayve’s products with the tools and technologies already trusted by automakers. This alignment helps ensure that our product offerings meet the evolving demands of our customers. By teaming with NVIDIA, Wayve is well-positioned to accelerate the path to commercial deployment of AI-driven automotive systems.
Exploring the Potential of Cosmos
Cosmos presents exciting opportunities for advancing AI capabilities, including accelerating data processing and generating synthetic data for safety and validation, to complement our core technology. For example, we could leverage Cosmos to search for edge and corner case driving videos that automakers can use for safety and validation. Making AI tools and data more accessible to the industry encourages adoption and accelerates the deployment of advanced driving technology.
Alex Kendall, Co-founder and CEO of Wayve, says:
"NVIDIA Cosmos represents an exciting step forward in AI capabilities that will drive innovation in the automotive industry. We’re excited to explore how this platform can help us address the unique challenges that Embodied AI systems face."
Norm Marks, Vice President of Automotive at NVIDIA, adds:
"Wayve’s work in end-to-end AI systems for autonomous driving is paving the way for the future. The new NVIDIA Cosmos platform provides tools that align with Wayve’s innovative approach to bring physical AI into the driving domain and redefine autonomy."
Driving Progress Through Collaboration
At Wayve, we embrace a partnership-first approach, working with trusted companies to build robust AI infrastructure that supports the global deployment of AV2.0 technology and accelerates the benefits of embodied AI in physical systems like cars and robots. As we explore new opportunities across NVIDIA’s technology platforms, we remain committed to building innovative, safe, and trustworthy technology that shapes the future of driving. We’re excited to continue advancing the possibilities of automotive AI. Stay tuned for future updates!
