FreeExam

Transformer basics

The memory, numerics, parallelism, and artifacts that a transformer train or serve stack depends on.

These cards are original study material. They are not questions from a named employer or a live hiring loop.

Card 1 of 50

Front. Weights-size. How large is a weight file for a 7B-parameter model in bf16?