Maths for ML / Notation

≪\ll

much less than

Arithmetic and relationsIntermediate

Say it “is much smaller than”

Left side is smaller by a large factor (think orders of magnitude).

Example

r≪dr \ll d

A LoRA rank r is tiny compared to the hidden size d.

Where you’ll see it in ML

Low-rank assumptions, small learning rates, ε ≪ 1.

Don’t confuse it with

Lessons that use it

← All 94 symbols