A GPU is a specialized processor originally designed for rendering graphics but now essential for AI because it can perform thousands of mathematical operations in parallel, exactly what neural network training and inference require. Training a large model on CPUs alone could take months; the same model on GPUs finishes in days or hours. NVIDIA dominates the AI GPU market with its CUDA ecosystem, and cloud providers like AWS and Google Cloud rent GPU capacity by the hour.