Apple: M5 Ultra features up to 512GB of unified memory

Glonghui, August 25 | According to Apple (AAPL.O)’s official website, the newly launched M5 Ultra chip is equipped with up to 512GB of high-capacity high-bandwidth unified memory, and offers up to 1.2TB/s unified memory bandwidth, which is 50% higher than the M3 Ultra. This enables users to store massive datasets entirely in local memory, increase the number of Tokens generated per second, and fully run ultra-large large language models (LLMs) with tens of billions of parameters directly on-device. The M6 chip supports up to 32GB of unified memory, allowing it to handle multiple high-load applications simultaneously and run LLMs on-device for secure and privacy-focused AI agent tasks. In addition, M6 offers up to 170GB/s of unified memory bandwidth, which is a 10% improvement over the M5 and 2.5 times that of the M1.