Skip to content
ai

Encoder

Transformer Encoder

Definition

The encoder is the transformer component that converts input tokens into rich contextual representations using bidirectional self-attention. Each token's representation incorporates information from all other tokens in the sequence, unlike the masked attention in decoders.

Encoder-only models like BERT excel at tasks requiring full-sequence understanding, such as classification and retrieval.

Can this ship? Are we exposed? Can you prove it?

Every CISO is asking these three questions. We answer them with facts, not guesses, from repository to runtime.