Qualcomm and Microsoft Align Efforts to Scale On-Device AI at Build.
Highlights
- On-device generative AI solutions allow developers and cloud service providers to make generative AI more affordable, reliable, and private by moving queries and inferencing to edge devices such as PCs and phones.
- Qualcomm and Microsoft affirm their collaboration to scale AI capabilities and bring best-in-class AI experiences to users across consumer, enterprise, and industrial devices.
May 23, 2023, SEATTLE – During Microsoft Build 2023, Qualcomm Technologies, Inc. displayed its latest innovations in on-device AI, including showing generative AI running on Snapdragon® compute platforms, as well as new pathways for developers building applications for Windows 11 PCs powered by Snapdragon.
“For generative AI to become truly mainstream, much of the inferencing will need to be executed on edge devices,” said Ziad Asghar, senior vice president of product management, Qualcomm Technologies, Inc. “Our best-in-class AI hardware and software empowers developers to make full use of our powerful AI capabilities, delivering incredible new user experiences on laptops, phones and other devices powered by Snapdragon.”
The future of AI needs to include both on-device and cloud AI. Running AI applications on device improves cost-effectiveness, privacy, personalization, and latency. Snapdragon platforms include a dedicated Qualcomm® AI Engine to process AI workloads more efficiently than when processed purely on CPU or GPU, making on-device AI possible even in small, thin, and light devices.
At Microsoft Build, Qualcomm Technologies will show demos and offer tools to help develop generative AI on the next generation of Windows 11 PCs. Stable Diffusion, a text-to-image generative AI model with more than 1 billion parameters, now runs entirely on the device, and the Company says it sees a clear path to running models with up to 10 billion parameters on devices in the coming months, including large language models (LLMs). To enhance the Qualcomm® AI Stack and help developers create the next generation of on-device AI experiences, the Qualcomm AI Engine Direct SDK will be made available to the public for the first time at Build. With the ONNX Runtime and Qualcomm AI Stack, you can run your AI workloads today on the Snapdragon 8cx Gen 3 AI Engine on both the Surface Pro 9 5G and Lenovo ThinkPad x13s.
“Both cloud and device processing are needed to extend AI across the vast universe of devices and applications,” said Pavan Davuluri, Corporate VP, Windows Silicon and System Integration at Microsoft. “By bringing together Microsoft’s cloud AI leadership and the capabilities of the Windows platform with Qualcomm Technologies’ on-device AI expertise, we will accelerate the opportunities for generative AI experiences.”
Qualcomm Technologies will also show at Build the dramatic performance improvements available when popular applications are compiled natively for Snapdragon, as well as debut a new developer portal that collects critical tools, resources, and support for Windows on Snapdragon development in one easy-to-use location.