STAC-ML Pack for GroqWare™ with Python 3.8 on a GroqNode™ with 8 x GroqCard™ Accelerators

Audited

STAC-ML Markets Inference Benchmark

Stack under test:

  • STAC-ML Pack for GroqWare (Rev A)
  • GroqWare™ SDK 0.9.0.5 devtools and runtime
  • Python 3.8.15; NumPy 1.23.4,
  • Ubuntu Linux 22.04.1 LTS
  • GroqNode™ GN1-B8C-ES:
    • 8 x GroqCard™ 1 Accelerators (GC1-010B)
    • 2 x AMD EPYC™ 7413 24-core Processors @ 2650 MHz
    • 16 slots x 64GB DDR4 (Samsung 3200MHz) - 1024GiB Total

Please log in to see file attachments. If you are not registered, you may register for no charge.

Are you looking for our event dedicated to AI infrastructures? See AI STACNYC London