Transformer basics
The memory, numerics, parallelism, and artifacts that a transformer train or serve stack depends on.
These cards are original study material. They are not questions from a named employer or a live hiring loop.
Card 1 of 50
Front. Weights-size. How large is a weight file for a 7B-parameter model in bf16?