Nvidia focuses on AI inference

Nvidia is increasing its focus on AI inference to compete with custom chip manufacturers. This strategic move is a response to the growing demand for efficient and specialized inference solutions.

AI inference, the process of using a trained machine learning model to make predictions on new data, has become a crucial area for many companies. The ability to perform inference quickly and efficiently is essential for applications such as autonomous driving, speech recognition, and computer vision.

Nvidia, traditionally a leader in the GPU market for AI model training, is now seeking to strengthen its position in the field of inference as well. This comes in a context of increasing competition from companies developing custom chips, optimized for specific inference workloads.