NVIDIA推出了AIPerf基准测试工具，用于测量和评估大型语言模型的推理性能。

You’re deploying a model on a system. It starts up, prompts are getting responses. Now the hard question: Is this fast? Your instincts might lead you to send...