TensorRT 8 Provides Leading Enterprises Fast AI Inference Performance

TensorRT 8 Provides Leading Enterprises Fast AI Inference Performance

NVIDIA today launched TensorRT™ 8, the eighth generation of the company’s AI software, which slashes inference time in half for language queries — enabling developers to build the world’s best-performing search engines, ad recommendations and chatbots and offer them from the cloud to the edge.