FreeExam

Transformer basics

Shapes, attention, positions, masks, and the residual stack, card by card.

These cards are original study material. They are not questions from a named employer or a live hiring loop.

Card 1 of 50

Front. Input-shape. What is the shape of the hidden states entering a transformer layer?