1/12 Have you ever wondered how ML systems (and brains) deal with uncertainty? In this thread, we'll explore foundational concepts in probability, such as entropy, cross-entropy, and KL-divergence. This summarizes my latest video:

Here's the breakdown of key ideas 🧵 2/12 Our brains naturally operate with probabilities. When you see a vague shape in fog, you don't settle on a single interpretation. Instead, you evaluate multiple possibilities simultaneously, each with its own likelihood. This probabilistic thinking is crucial for processing ambiguous information