Arm technology innovation powers new wave of edge AI
Cambridge superchip architect Arm has rolled out yet another game-changing technology in its relentless drive to transform products at the bleeding edge of AI and Machine Learning advancement.
The rapid adoption of AI and ML into edge and endpoint devices is driving not only increased functionality but also increased device and system requirements.
This in turn means providers must deliver systems with more performance and on-device ML capabilities, while maintaining or improving power efficiency.
To address the challenge, Arm has literally spawned a whole new Ethos. With an ever-increasing range of devices adding AI functionality, Arm has revealed the latest member of its Ethos product line – the Arm Ethos-U65 – which provides a new performance point and new capabilities.
The sky’s the limit because horizons are unlimited in terms of technology reach, according to Dennis Laudick, vice-president of marketing in the Machine Learning group at Arm.
He says the Ethos-U65 maintains the power efficiency of the Arm Ethos-U55 while extending its applicability from Arm Cortex-M to Cortex-A and Neoverse-based systems. And the play delivers twice the on-device machine learning performance.
Laudick says: “Arm’s unparalleled AI platform is designed to deliver flexible, scalable technologies to the broadest range of devices. Earlier this year we announced new ML IP, the Arm Cortex-M55 processor and Arm Ethos-U55, the world’s first microNPU, a combined solution delivering a 480x leap in ML performance for microcontrollers.
“This solution is enabling ML compute to happen everywhere, from the tiniest endpoint devices to smart home solutions and beyond.
“We’re already seeing great success with the Ethos-U55 as licensees including NXP Semiconductors deliver solutions that address the increasing demand for on-device ML processing for billions of small, power-constrained IoT and embedded devices.
“NXP will now also add the Ethos-U65 to its SoC offerings, providing their customers with more on-device intelligence for smarter, more powerful devices that benefit from high efficiency, greater privacy, and reliability.”
Laudick adds that 5G network rollouts are enabling and enhancing connectivity for billions of diverse devices, “which is why we added another performance point with the Ethos-U65.”
He adds: “This will enable an additional range of solutions for complex AI workloads across the Cortex-M, Cortex-A and Neoverse processor families, while increasing throughput and efficiency on a consistent software stack and with familiar tools.
“By enabling greater system-level performance in rich embedded devices, as well as subsystems in applications like data and control planes of Neoverse-based systems, developers can unlock better throughput and power efficiency, more intelligence, and more natural ways to interact with our connected world.
“Critical to enabling the AI revolution is the need to support the millions of developers working to make this technology innovative and accessible to the masses.
“The Ethos-U65 leverages the extensive Arm AI ecosystem that is creating and optimising algorithms to broadly enable on-device AI. The Arm AI platform delivers a unified software and tools interface for implementing the most popular neural networks across the heterogenous Arm-based processors typically found in modern integrated circuits (ICs).
“In addition, there is rich support for open source software to bring the flexibility required in implementing these complex use cases. We recognise that one of the greatest benefits for our developer ecosystem is alignment around common platforms in order to protect the scale of investments through portability, standards, and common APIs.
“Our guiding principle is to enable developers to write code once and deploy it anywhere by providing an extensible platform, using common software and toolchains with a simple goal that it should just work.”
Laudick says that AI and ML represent a “once-in-a-generation paradigm shift in capability using data, compute, and software.”
He adds: “Arm continues to support this transformation with an unparalleled roadmap of dedicated ML processors and technologies, enabling everyone from cloud providers to tiny IoT device manufacturers.
“Through the momentum of our Ethos architecture, and the massive success we’ve already seen for AI devices, we’re helping the ecosystem unlock significant value by delivering the foundations for many new possibilities – maybe even ones we’ve yet to imagine.”