AI Research Scientist

Build the pieces of a transformer in plain Python lists, with every formula given: matrix ops, attention with causal masks, heads, layer and RMS norm, GELU, stable softmax and cross-entropy, positional and rotary encodings, dropout, clipping, SGD and Adam, schedules, convolution, pooling, and decoding.