Applied
Transformer basics
Shapes, attention, positions, masks, and the residual stack, card by card.
These cards are original study material. They are not questions from a named employer or a live hiring loop.
Card 1 of 50
Front. Input-shape. What is the shape of the hidden states entering a transformer layer?