IBM and Mellanox publish first RoCE-based STAC-M2 results
Audited STAC-M2 Benchmark of IBM LLM on an IBM-BNT G8264 switch, using IBM x3550 servers and Mellanox MNPH29C-XTR ConnectX®-2 EN with RoCE
STAC has just released an audited STAC-M2(TM) Benchmark of the following stack:
- IBM WMQ Low Latency Messaging v22.214.171.124
- Red Hat Enterprise Linux AS 5.5
- 2 x Quad-Core Intel Xeon X5570 2.93 GHz
- IBM x3550 M2 Model Servers
- Mellanox MNPH29C-XTR ConnectX®-2 EN with RoCE
- IBM-BNT G8264 10Gb/40Gb Ethernet Switch
Using standard Ethernet and RoCE protocols, at the base message rates set by the specs, the mean latency of the solution did not exceed 7 microseconds, while standard deviation of latency was measured at 1 microsecond. At the highest tested rate of 2.3 million messages/second, the mean latency of the solution was just 13 microseconds while the standard deviation of latency was measured at 2 microseconds.
STAC Benchmark Council members with a premium subscription can request the full STAC Report. (Observer Members who have not already obtained a free sample report may also obtain the full report.) The report highlights are available to the public.
To understand the difference between the STAC Report Highlights and the full STAC Report, click here.