Alibaba Cloud has collaborated with Nvidia to integrate its large multimodal model (LMM) solution into the automotive platform, enhancing smart mobility experiences for China-based automakers. This partnership also involves Banma, Alibaba’s intelligent cockpit solution provider, with a focus on revolutionizing in-car interactions and autonomous driving capabilities.
The unveiling of the LMM solution by Alibaba Cloud’s cloud computing services unit marks a significant step in the partnership. This tailored solution for automotive applications was co-developed with Nvidia and Banma Network Technology. Additionally, Alibaba Cloud’s large language model Qwen, including Qwen2-7B and Qwen2-VL vision language model, has been incorporated into the NVIDIA DRIVE AGX Orin platform for autonomous vehicles. This integration, along with NVIDIA’s model acceleration technology, aims to reduce computational costs and minimize latency in real-time processing.
The collaboration between Alibaba Cloud and Nvidia is especially beneficial for leading Chinese electric vehicle (EV) makers, such as Li Auto, Great Wall Motors, Geely Auto’s Zeekr Intelligent Technology, and Xiaomi’s EV unit, who use the NVIDIA DRIVE AGX Orin platform for their next-generation fleets.
Key features of the LMM solution include Alibaba Cloud’s Mobile Agent, a multimodal AI agent for edge devices, which enhances in-car voice assistants’ capabilities. The technology enables users to execute complex voice commands, such as ordering food through delivery apps, while on the move.
Nvidia’s expertise in AI and graphics processing plays a crucial role in optimizing Alibaba Cloud’s models’ performance on automotive-grade hardware. This optimization ensures that AI-driven features operate efficiently within the constraints of in-vehicle computing systems.
Overall, the collaboration between Alibaba Cloud and Nvidia is expected to have a significant impact on the automotive industry in China, accelerating the adoption of AI-driven technologies in vehicles across the country.
Looking ahead, Alibaba Cloud plans to extend its collaboration with Nvidia by adapting Qwen models for the NVIDIA DRIVE Thor platform, which combines advanced driver assistance, autonomous driving, and AI cockpit capabilities into a secure system.
In a separate initiative, Nvidia and Alibaba Cloud are working on LLM-related initiatives for accelerated computing, focusing on parallel processing to speed up work and increase energy efficiency. These custom solutions aim to help traditional enterprises transition their LLM operations to the cloud.
To learn more about cybersecurity and cloud technology, visit Tenable at the Cyber Security & Cloud Expo Europe event. Stay updated on upcoming enterprise technology events and webinars powered by TechForge by visiting their events page.
Tags: AI, Alibaba Cloud, cloud, NVIDIA
