min / max
Say it “min over x of f of x”
The smallest / largest value. With a subscript, search over that variable.
Example
That's ReLU at −2.
In code
np.max(x) # largest entry
np.maximum(0, x) # max(0, x) per entry: ReLUtorch.max(x) # largest entry
torch.relu(x) # max(0, x) per entryWhere you’ll see it in ML
ReLU, max-pooling, hinge loss, GANs' min-max game.