CUDA

Compute Unified Device Architecture

Definition

CUDA is NVIDIA's parallel computing platform and programming model that enables software to use NVIDIA GPUs for general-purpose computations. Deep learning frameworks like PyTorch and TensorFlow rely on CUDA kernels to execute matrix operations at the speed required for model training and inference.

CUDA support is a de facto requirement for running large AI models efficiently.

Related Terms

GPU

Graphics Processing Unit

TensorRT

Distributed training

Distributed Model Training

Model serving

LLM Model Serving

← Back to Glossary

Ship secure code faster

Crash Override integrates security into the developer workflow. No context switching, no waiting on reviews.

Talk to a Human See the Product