메타가 DRAM 재활용 칩을 냈습니다... 메모리 수요 줄어들까? HBM 다음은 CXL?

Meta has begun reusing DDR4 memory from retired servers in its latest servers. To achieve this, they personally designed Vistara, a CXL Type-3 memory expansion chip, and deployed it in a real service environment. In this video, we examine papers to verify whether Vistara is merely a simple operational method or an actual semiconductor chip. We also looked at the bandwidth differences between local DDR5 and CXL DDR4, memory configurations per server, and actual service improvement results. We explain, using cache and ML parameter server examples, why the number of servers and processing times decreased despite the addition of slower DDR4. We also distinguished whether CXL is a technology that replaces HBM or can resolve the DRAM supply shortage. We also cover the difference between direct-linked memory expansion and memory pools shared by multiple servers. We examine how complex the management of operating systems and AI runtimes becomes as memory tiers increase. We also summarized the roles played by Samsung Electronics, SK Hynix, and Panesia within the CXL ecosystem. If HBM is a competition of speed, CXL is a competition of how efficiently memory is utilized. Written by Patch Edited by Lee Jin-i [email protected]