STAC-ML Pack for GroqWare™ with Python 3.8 on a GroqNode™ with 8 x GroqCard™ Accelerators

Audited

STAC-ML Markets Inference Benchmark

Stack under test:

  • STAC-ML Pack for GroqWare (Rev A)
  • GroqWare™ SDK 0.9.0.5 devtools and runtime
  • Python 3.8.15; NumPy 1.23.4,
  • Ubuntu Linux 22.04.1 LTS
  • GroqNode™ GN1-B8C-ES:
    • 8 x GroqCard™ 1 Accelerators (GC1-010B)
    • 2 x AMD EPYC™ 7413 24-core Processors @ 2650 MHz
    • 16 slots x 64GB DDR4 (Samsung 3200MHz) - 1024GiB Total

Please log in to see file attachments. If you are not registered, you may register for no charge.

The STAC-ML Working Group develops and promotes benchmark standards for key machine learning (ML) workloads in finance (in which we include "AI"). This enables customers, vendors, and STAC to make apples-to-apples comparisons of techniques and technologies.