One thing that gets lost in today’s “AI is all math”

One thing that gets lost in today’s “AI is all math” conversations: early neural network researchers intentionally added randomness because perfectly predictable systems turned out to be terrible at exploring ideas or escaping bad patterns. Funny part is we still rely on that today — from random weight initialization to training noise — and a lot of modern deep learning quietly works because the models aren’t completely orderly.