GPU goliath claims tech can boost throughput by 2x for Hopper, up to 30x for Blackwell GTC Nvidia's Blackwell Ultra and ...
The open-source inferencing software increases throughput and reduces the cost of LLM token generation, the chipmaker said.
Nvidia CEO Jensen Huang said that the company has new open-source software called Dynamo, which he described as the operating system of a future AI factory. According to Huang, in the past, a company ...
Nvidia CEO Jensen Huang unveiled Dynamo, a distributed inference serving library that he described as the "operating system ...