Tivadar Danka Profile picture
Jun 25 20 tweets 7 min read Read on X
What you see below is one of the most beautiful formulas in mathematics.

A single equation, establishing a relation between 𝑒, π, the imaginary number, and 1. It is mind-blowing.

This is what's behind the sorcery: Image
First, let's go back to square one: differentiation.

The derivative of a function at a given point describes the slope of its tangent plane. Image
By definition, the derivative is the limit of difference quotients: slopes of line segments that get closer and closer to the tangent.

These quantities are called "difference quotients". Image
Here is the precise definition of the derivative.

Take a mental note, as this is going to be essential. Image
Due to what limits are, we can write the derivative as the difference quotient plus a small error term.

This is a minor but essential change in our viewpoint. Image
By rearranging the terms, we see that a differentiable function equals a linear part + error.

In essence, differentiation is the same as a linear approximation.

I am not going to lie: this is mindblowing. Image
If you don't believe me, check out this plot.

Around x₀, the linear function given by the derivative is pretty close to our function.

In fact, this is the best possible local linear approximation. Image
If the linear approximation is not good enough, can we do better?

Sure. For instance, the first and second derivatives give the best local quadratic approximation. Image
You guessed right. The first n derivatives determine the best local approximation by an n-th degree polynomial.

This is the n-th Taylor polynomial of f around x₀. Image
For instance, this is what the Taylor polynomials around zero look like for sin(x).

As you can see, higher-order Taylor polynomials are almost indistinguishable from sin(x).

This is not an accident. Image
Hold on to your seats: if you think big and let n to infinity, the resulting Taylor expansion can yield the original function!

(Functions where this is true are called analytic, but the terminology is not important for us.) Image
For example, this holds for our favorite trigonometric functions, sine and cosine.

(You can verify this by hand using the derivatives of sine and cosine.) Image
The Taylor expansion of the amazing exponential function also yields itself.

This is one of the most important formulas in mathematics.

Why? Image
Because we can use it to extend the exponential function onto the complex plane!

(I don't want to scare you, but you can even plug in matrices. We'll stick to complex numbers, though.) Image
Now, by letting z = i x, we stumble upon something staggering.

The complex exponential function is a linear combination of trigonometric functions!

The first time I learned about this, my head exploded. Image
This is Euler's formula in its full might. Image
By plugging in π, we get the famous Euler's identity.

This result wins almost all "what's the most beautiful formula of mathematics" contests. Image
Besides its staggering beauty, there is much more to it.

Euler's formula connects the polar form of complex numbers with the exponential function.

This fundamental identity underlies the entire field of science and engineering. Image
(This is how the polar form is visualized on the complex plane.) Image
If you have enjoyed this explanation, there is more in my Mathematics of Machine Learning book.

Understanding mathematics will make you a better engineer, and I want to help you with that.

Get the book here: amazon.com/Mathematics-Ma…

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Tivadar Danka

Tivadar Danka Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @TivadarDanka

Jun 24
"Probability is the logic of science."

There is a deep truth behind this conventional wisdom: probability is the mathematical extension of logic, augmenting our reasoning toolkit with the concept of uncertainty.

In-depth exploration of probabilistic thinking incoming. Image
Our journey ahead has three stops:

1. an introduction to mathematical logic,
2. a touch of elementary set theory,
3. and finally, understanding probabilistic thinking.

First things first: mathematical logic.
In logic, we work with propositions.

A proposition is a statement that is either true or false, like

• "it's raining outside",
• "the sidewalk is wet".

These are often abbreviated as variables, such as A = "it's raining outside".
Read 29 tweets
Jun 23
Understanding graph theory will seriously enhance your engineering skills; you must absolutely be familiar with them.

Here's a graph theory quickstart, in collaboration with @alepiad.

Read on: Image
What do the internet, your brain, the entire list of people you’ve ever met, and the city you live in have in common?

These are all radically different concepts, but they share a common trait.

They are all networks that establish relationships between objects. Image
As distinct as these things seem to be, they share common properties.

For example, the meaning of “distance” is different for

• Social networks
• Physical networks
• Information networks

But in all cases, there is a sense in which some objects are “close” or “far”. Image
Read 15 tweets
Jun 22
In machine learning, we take gradient descent for granted.

We rarely question why it works.

What's usually told is the mountain-climbing analogue: to find the valley, step towards the steepest descent.

But why does this work so well? Read on. Image
Our journey is leading through

• differentiation, as the rate of change,
• the basics of differential equations,
• and equilibrium states.

Buckle up! Deep dive into the beautiful world of dynamical systems incoming. (Full post link at the end.)
First, let's talk about derivatives and their mechanical interpretation!

Suppose that the position of an object at time t is given by the function x(t), and for simplicity, assume that it is moving along a straight line — as the distance-time plot illustrates below. Image
Read 27 tweets
Jun 21
Matrix factorizations are the pinnacle results of linear algebra.

From theory to applications, they are behind many theorems, algorithms, and methods. However, it is easy to get lost in the vast jungle of decompositions.

This is how to make sense of them. Image
We are going to study three matrix factorizations:

1. the LU decomposition,
2. the QR decomposition,
3. and the Singular Value Decomposition (SVD).

First, we'll take a look at LU.
1. The LU decomposition.

Let's start at the very beginning: linear equation systems.

Linear equations are surprisingly effective in modeling real-life phenomena: economic processes, biochemical systems, etc. Image
Read 19 tweets
Jun 20
Matrix multiplication is not easy to understand.

Even looking at the definition used to make me sweat, let alone trying to comprehend the pattern. Yet, there is a stunningly simple explanation behind it.

Let's pull back the curtain! Image
First, the raw definition.

This is how the product of A and B is given. Not the easiest (or most pleasant) to look at.

We are going to unwrap this. Image
Here is a quick visualization before the technical details.

The element in the i-th row and j-th column of AB is the dot product of A's i-th row and B's j-th column. Image
Read 17 tweets
Jun 19
The single most undervalued fact of linear algebra: matrices are graphs, and graphs are matrices.

Encoding matrices as graphs is a cheat code, making complex behavior simple to study.

Let me show you how! Image
If you looked at the example above, you probably figured out the rule.

Each row is a node, and each element represents a directed and weighted edge. Edges of zero elements are omitted.

The element in the 𝑖-th row and 𝑗-th column corresponds to an edge going from 𝑖 to 𝑗.
To unwrap the definition a bit, let's check the first row, which corresponds to the edges outgoing from the first node. Image
Read 18 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(