Why More CPUs Are Needed In Data Centers

The shift from generative AI to agentic AI will significantly increase the amount of compute power needed in data centers. Queries to search for and analyze data from multiple sources will be performed simultaneously by agents and without human intervention, rather than a single request from a live person. Jeff Defilippi, senior director of product management at Arm, talks with Semiconductor Engineering about the impact of running these queries 24 x 7, how queries will be orchestrated across agents, how compute resources need to be architected to handle all of this, and how to improve the bandwidth in the chip architecture to allow for faster data movement.