Transformer basics
The objectives, training recipe, and analysis terms a transformer paper treats as known.
These cards are original study material. They are not questions from a named employer or a live hiring loop.
Card 1 of 50
Front. Causal-lm. What does causal language modeling train the model to predict?