This is the second article in the series, following our first blog in Dec 2023: https://www.sigarch.org/tuning-the-symphony-of-heterogeneous-memory-systems/ Modern applications are increasingly memory hungry. Applications like Large-Language Models (LLM), in-memory databases, and data analytics platforms often demand more memory bandwidth and capacity than what a standard server CPU can provide. This leads to the development of coherent fabrics to interconnect more memory with cache coherence...