View all newsletters
Receive our newsletter - data, insights and analysis delivered to you

Nvidia and AMD announce new AI chips for desktop computers

Both companies say they’re moving closer toward realising ‘AI PCs’ capable of running advanced LLMs at the edge. 

By Greg Noone

Nvidia and AMD have both announced new AI chips for desktop computers. Nvidia is releasing three new graphics cards featuring tensor cores capable of running generative AI applications, while AMD’s new processor is combined with a neural processing unit (NPU) designed to handle AI tasks on desktop computers – a world-first, according to the company.

A Ryzen 8000 chip, used to illustrate a story about Nvidia and AMD and their advocacy of AI PCs.
AMD’s new Ryzen 8000 chip, is equipped with a neural processing unit capable of accelerating AI applications on domestic computers and reducing their reliance on processing them in the cloud. (Photo by AMD)

Rising demand for AI chips

The news comes amid rising demand for AI chips throughout the PC market, as interest in running generative AI applications off the cloud continues to rise. For example, Nvidia claims that its new graphics cards – the RTX 4060 Super, RTX 4070 Ti Super and the RT 4080 Super – boost large language model (LLM) processing speeds by up to five times, and AI video generation by up to 150%. “With 100 million RTX GPUs shipped, they provide a massive installed base for powerful PCs for AI applications,” said Nvidia’s senior director of product management, Justin Walker, at a press conference. 

For its part, AMD’s new Ryzen 8000G series boasts eight cores, sixteen threads and an NPU designed to accelerate and optimize AI software applications and workloads. “AMD continues to lead the AI hardware revolution by offering the broadest portfolio of processors with dedicated AI engines in the x86 market,” said AMD’s general manager for its computing and graphics group, Jack Huynh. Though NPU-like components have previously been included in laptops, AMD claims that it is the first company to include them in desktop PC processors.

AI PC era in the offing?

Both statements from AMD and Nvidia said that their respective product releases would help usher in the era of the “AI PC,” a concept wherein advanced AI models can be run on normal consumer and office computers. Currently, most generative AI applications are run in the cloud, though exceptions to this rule have emerged in recent months. Apple, for example, runs foundation models for voice modelling and transcription on the iPhone. Qualcomm, meanwhile, announced its development of processors capable of running AI applications on Windows laptops in May 2023. 

Even so, the market has yet to produce a PC capable of running all types of AI applications locally. For its part, Nvidia’s new GPUs will still rely on cloud computing to conduct heavy-duty processing. “Nvidia GPUs in the cloud can be running really big, large language models and using all that processing power to power very large AI models, while at the same time, RTX tensor cores in your PC are going to be running more latency-sensitive AI applications,” Walker told journalists yesterday. 

Read more: Intel pitches AI PCs, but is it already late to the party?

Content from our partners
Scan and deliver
GenAI cybersecurity: "A super-human analyst, with a brain the size of a planet."
Cloud, AI, and cyber security – highlights from DTX Manchester

Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how Progressive Media Investments may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.