IBM and Mellanox publish first RoCE-based STAC-M2 results

Audited STAC-M2 Benchmark of IBM LLM on an IBM-BNT G8264 switch, using IBM x3550 servers and Mellanox MNPH29C-XTR ConnectX®-2 EN with RoCE

STAC has just released an audited STAC-M2(TM) Benchmark of the following stack:

- IBM WMQ Low Latency Messaging v2.4.0.2
- Red Hat Enterprise Linux AS 5.5
- 2 x Quad-Core Intel Xeon X5570 2.93 GHz
- IBM x3550 M2 Model Servers
- Mellanox MNPH29C-XTR ConnectX®-2 EN with RoCE
- IBM-BNT G8264 10Gb/40Gb Ethernet Switch

Using standard Ethernet and RoCE protocols, at the base message rates set by the specs, the mean latency of the solution did not exceed 7 microseconds, while standard deviation of latency was measured at 1 microsecond. At the highest tested rate of 2.3 million messages/second, the mean latency of the solution was just 13 microseconds while the standard deviation of latency was measured at 2 microseconds.

STAC Benchmark Council members with a premium subscription can request the full STAC Report. (Observer Members who have not already obtained a free sample report may also obtain the full report.) The report highlights are available to the public.

To understand the difference between the STAC Report Highlights and the full STAC Report, click here.

About STAC News

Read the latest about research, events, and other important news from STAC.

Subscribe to notifications of research, events, and more.

(If you're a human, don't change the following field)
Your first name.
(If you're a human, don't change the following field)
Your first name.

Enter your email above, then click "Sign Up" to join the STAC mail list and (optionally) register to access materials on the site. Click for terms.