limit
Say it “the limit as x approaches a of f of x”
The value f gets closer and closer to as x approaches a.
Example
The sigmoid saturates at 1.
Where you’ll see it in ML
Saturation of activations; the definition of the derivative.
Say it “the limit as x approaches a of f of x”
The value f gets closer and closer to as x approaches a.
The sigmoid saturates at 1.
Saturation of activations; the definition of the derivative.