infinity
Say it “infinity”
Bigger than any number — used in limits and ranges, not as an actual value.
Example
In code
np.inffloat('inf')Where you’ll see it in ML
Masking in attention: set scores to −∞ so softmax gives them 0.
Say it “infinity”
Bigger than any number — used in limits and ranges, not as an actual value.
np.inffloat('inf')Masking in attention: set scores to −∞ so softmax gives them 0.