Intel Announces Xeon Max - World's First x86 Processors with HBM Memory

Intel has announced Xeon Max, a series of processors equipped with HBM2e high speed memory, and according to the company it is the world's first CPUs with HBM.
Previously these chips appeared under the codename Sapphire Rapids HBM.
The processors offer up to 56 cores with support for 112 virtual threads and have a TDP of 350W, and they are designed for high-performance server systems.Image source: IntelThe Xeon Max processors use an EMIB interface that integrates four chips with compute cores, as well as located next to the same substrate 64 GB of high-speed HBM2e memory, split into four clusters of 16 GB each.
The total bandwidth is about 1 Tbyte/s.
So there is more than 1GB of HBM2e memory per processor core.
Key features of the Xeon Max are support for PCIe 5.0 and CXL 1.1 interfaces.
HBM2e memory can be used both as additional cache and as additional RAM.
Moreover, a server with Xeon Max can be equipped with no RAM modules at all - the system will rely solely on HBM.
The company claims that Xeon Max power consumption is 68% lower than that of AMD Milan-X processors for the same performance.
The Xeon Max's support for the new AMX instructions speeds up AI-related tasks and provides an eight-fold increase in peak performance over AVX-512 instructions in INT8 and INT32 operations.
Intel says the Xeon Max is up to five times faster in some types of operations compared to the Intel Xeon 8380 or AMD EPYC 7773X (Milan-X with 3D V-Cache technology).
The presentation also compares the Xeon Max to the AMD EPYC 7763, against which the new Intel product shows up to 3.6 times better performance.
Compared to the NVIDIA A100 server computing gas pedal in the MLPerf DeepCAM test, which deals with calculations that accelerate and augment simulations on supercomputers using AI, Xeon Max is up to 1.2 times faster than the competitor.
The Xeon Max series of server processors will hit the market in January 2023.
Key competitors to Xeon Max will be AMD's new EPYC Genoa processors.
Their announcement is expected tomorrow, November 10.
According to rumors, these processors will be available as solutions equipped with HBM memory.