Reports
The reports and detailed configuration information are now available to eligible subscribers at the links above. To learn more about subscription options, please contact us.
NVIDIA recently submitted unaudited results for STAC-AI™ LANG6 (Inference-Only) on a GB200 Grace Blackwell system.
The Stack Under Test (SUT) was a Nebius 4xGB200 VM server featuring NVIDIA GB200 NVL72 Grace Hopper Superchip. The specific VM is equipped with a single node off the NVL72 system, having 4xGB200 GPUs and 2 Grace CPUs. Two separate tests were performed for the Llama-3.1-8B-Instruct and Llama-3.1-70B-Instruct models.
Note STAC has not audited these reports and NVIDIA is solely responsible for these results.
The EDGAR4a/b Data Sets mentioned involved in the benchmark model a Retrieval Augmented Generation (RAG) workload based on EDGAR securities filings, having a median initial context size of approximately 1,200 words. The EDGAR5a Data Set represents question-answering against an entire EDGAR 10-K filing with a median initial context size of 44,000 words.