GPT

Generative Pre-trained Transformer

Definition

GPT refers to OpenAI's series of autoregressive language models built on the transformer decoder architecture. Pre-trained on large text corpora to predict the next token, GPT models are adapted via instruction fine-tuning and RLHF to follow natural language instructions.

GPT-4 and its successors are among the most capable language models available and power ChatGPT and the OpenAI API.

Related Terms

LLM

Large Language Model

Transformer

Transformer Architecture

Autoregressive

Autoregressive Generation

RLHF

Reinforcement Learning from Human Feedback

← Back to Glossary

Ship secure code faster

Crash Override integrates security into the developer workflow. No context switching, no waiting on reviews.

Talk to a Human See the Product