Maths for ML / Notation

α\alpha

alpha

Greek letters and conventionsBeginner

Say it “alpha”

Generic coefficient. Often a learning rate, a mixing weight, or attention weights.

Example

αij=softmax⁡j(eij)\alpha_{ij} = \operatorname{softmax}_j(e_{ij})

Attention weights.

Where you’ll see it in ML

Learning rate, LoRA scale α, attention weights.

Don’t confuse it with

← All 94 symbols