It would be very convenient (though mind-numbingly boring) if the content of our days was just a simple interpolation of things we had experienced hundreds of times before. We could train a deep learning model to replace us!
In fact, every single of our days is completely unique -- unlike any day we've experienced before, and unlike any day experienced by anyone since the dawn of humanity.
And somehow we can still cope. That's the point of general intelligence: extreme generalization.
And somehow we can still cope. That's the point of general intelligence: extreme generalization.
Machine learning is about fitting to a static distribution -- human learning is about gathering knowledge that may turn out to be useful in a future that is guaranteed to share little commonality with the past.
