Arm sets new compute agenda with revolutionary v9 technology
Cambridge superchip architect Arm has unleashed its most powerful ever technology suite to define the future of cross-the-board compute.
In a move that leaves its competitors’ eyes watering, the company has unveiled the new Armv9 architecture to form the leading edge of the next 300 billion super-secure Arm-based chips.
The move is in response to the global demand for ubiquitous specialised processing with increasingly capable security and artificial intelligence (AI). Armv9 is the first new Arm architecture in a decade, building on the success of Armv8 which today drives the best performance-per-watt everywhere computing happens.
CEO Simon Segars said: “As we look toward a future that will be defined by AI, we must lay a foundation of leading-edge compute that will be ready to address the unique challenges to come.
“Armv9 is the answer. It will be at the forefront of the next 300 billion Arm-based chips driven by the demand for pervasive specialised, secure and powerful processing built on the economics, design freedom and accessibility of general-purpose compute.”
The number of Arm-based chips shipped continues to accelerate, with more than 100 billion devices shipped over the last five years. At the current rate, 100 per cent of the world’s shared data will soon be processed on Arm; either at the endpoint, in the data networks or the cloud.
Such pervasiveness conveys a responsibility on Arm to deliver more security and performance, along with other new features in Armv9. The new capabilities in Armv9 will accelerate the move from general-purpose to more specialized compute across every application as AI, the Internet of Things and 5G gain momentum globally.
To address the greatest technology challenge today – securing the world’s data – the Armv9 roadmap introduces the Arm Confidential Compute Architecture (CCA).
Confidential computing shields portions of code and data from access or modification while in-use, even from privileged software, by performing computation in a hardware-based secure environment.
The Arm CCA will introduce the concept of dynamically created Realms, useable by all applications, in a region that is separate from both the secure and non-secure worlds.
For example, in business applications, Realms can protect commercially sensitive data and code from the rest of the system while it is in-use, at rest, and in transit.
In a recent Pulse survey of enterprise executives, of enterprise executives, more than 90 per cent of the respondents believe that if Confidential Computing were available, the cost of security could come down enabling them to dramatically increase their investment in engineering innovation.
Henry Sanders, corporate vice president and chief technology officer, Azure Edge and Platforms at Microsoft, commented: “The increasing complexity of use cases from edge to cloud cannot be addressed with a one-size-fits-all solution.
“As a result, heterogeneous compute is becoming more ubiquitous, requiring greater synergy among hardware and software developers. A good example of this synergy between hardware and software are the ArmV9 confidential compute features which were developed in close collaboration with Microsoft.
“Arm is in a unique position to accelerate heterogeneous computing at the heart of an ecosystem, fostering open innovation on an architecture powering billions of devices.”
The ubiquity and range of AI workloads demands more diverse and specialized solutions. For example, it is estimated there will be more than eight billion AI-enabled voice-assisted devices in use by the mid-2020s, and 90 per cent or more of on-device applications will contain AI elements along with AI-based interfaces like vision or VOICEii.
To address this need, Arm partnered with Fujitsu to create the Scalable Vector Extension (SVE) technology, which is at the heart of Fugaku, the world’s fastest supercomputer.
Building on that work, Arm has developed SVE2 for Armv9 to enable enhanced machine learning (ML) and digital signal processing (DSP) capabilities across a wider range of applications.
SVE2 enhances the processing ability of 5G systems, virtual and augmented reality, and ML workloads running locally on CPUs, such as image processing and smart home applications.
Over the next few years, Arm will further extend the AI capabilities of its technology with substantial enhancements in matrix multiplication within the CPU, in addition to ongoing AI innovations in its Mali™ GPUs and Ethos™ NPUs.
Over the past five years, Arm designs have increased CPU performance annually at a rate that outpaces the industry. Arm will continue this momentum into the Armv9 generation with expected CPU performance increases of more than 30 per cent over the next two generations of mobile and infrastructure CPUs.
However, as the industry moves from general-purpose computing towards ubiquitous specialised processing, annual double-digit CPU performance gains are not enough.
Along with enhancing specialised processing, Arm’s Total Compute design methodology will accelerate overall compute performance through focused system-level hardware and software optimizations and increases in use-case performance.
By applying Total Compute design principles across its entire IP portfolio of automotive, client, infrastructure and IoT solutions, Armv9 system-level technologies will span the entire IP solution, as well as improving individual IP.
Additionally, Arm is developing several technologies to increase frequency, bandwidth, and cache size, and reduce memory latency to maximise the performance of Armv9-based CPUs.
Richard Grisenthwaite, SVP, chief architect and fellow, Arm, concluded: “Addressing the demand for more complex AI-based workloads is driving the need for more secure and specialised processing, which will be the key to unlocking new markets and opportunities.
“Armv9 will enable developers to build and program the trusted compute platforms of tomorrow by bridging critical gaps between hardware and software, while enabling the standardisation to help our partners balance faster time-to-market and cost control alongside the ability to create their own unique solutions.”
As previously reported by Business Weekly, the technology uptick will also put Arm in pole position to revolutionise the technology powering supercomputers and data centres.
It is already working with NVIDIA on installing supercomputers into the KAO Data Campus in Harlow in association with NVIDIA, which has made a $40 billion takeover bid for Arm currently being vetted by competition watchdogs around the world.