A GPU is a chip that runs a huge number of calculations at the same time. That is why AI training and serving mostly run on GPUs or on similar specialised chips such as Google's TPUs.
Example
A data centre with thousands of GPUs trains a new language model.
For pros
For local AI, graphics memory (VRAM) matters most. Computers with memory shared between processor and graphics can also load larger models.
