STAC Report Highlights provide some insight into the performance of the stack that was tested, but there’s more to the story. The full STAC Report for a STAC-M2 v1.0 Benchmark contains additional information, including:
1) Results from additional test cases:
- Tests where the Consumer API is required to parse each message rather than treating it as an opaque buffer
- Tests with three distinct types of slow consumers
- Tests where one or a group of clients restarts during message flow (if the system supports caching)
- Tests with two Producers, not just one
2) Latency versus throughput for a range of message rates, including the highest rate tested in each configuration.
3) Deeper latency analysis:
- Full latency statistics for the highest message rate tested, not just the base rate
- Latency percentiles all the way to six nines (99.9999th), not just 99th
- Visualizations such as histograms and time plots of latency over test runs
4) Additional metrics (recovery times in restart cases and an additional latency metric that shows underlying transport speed, which factors out any latency due to queuing prior to send).
The full STAC Report is in the STAC Vault™. Vault content is only accessible to STAC Benchmark Council members with an appropriate premium subscription. Click here for more information.