Let's start with logistic regression. Assume you want to classify a penguin as male or female based on its
* weight,
* species and
* bill length
Better yet, let's make this specific. Here's a dataviz for this exact scenario. It is based on the {palmerpenguins} data set.
As you can see, the male and female penguins form clusters that do not overlap too much.
However, regular linear regression (LR) won't help us to distinguish them. Think about it. Its output is something numerical. Here, we want to find classes.