NVIDIA's Vera Rubin NVL72 system achieved leading performance in MLPerf Inference v6.1 benchmarks, demonstrating advances in AI inference efficiency.
System performance, efficient infrastructure scaling and continuous software optimization are key levers that determine AI inference economics. Higher system performance means more tokens generated, resulting in higher revenue. Efficient scaling means throughput grows proportionally as hardware gets added, requiring fewer resources to serve users at scale. Continuous optimization means generating more value from infr...