Tivadar Danka Profile picture
Aug 15 24 tweets 7 min read Read on X
There is a non-recursive formula for the Fibonacci numbers, expressing them in terms of the golden ratio and its powers.

Why should you be interested? Because it teaches an extremely valuable lesson about power series.

Read on to find out what: Image
The Fibonacci numbers form one of the most famous integer sequences, known for their intimate connection to the golden ratio, sunflower spirals, mating habits of rabbits, and several other things.

By definition, they are defined by a simple second-order recursion: Image
What’s usually not known is that the Fibonacci numbers have a simple and beautiful closed-form expression, written in terms of the golden ratio.

This is called the Binet formula.

In this thread, we are going to derive it from the first principles.
Let's start with our primary tool: power series.

A power series is an infinite sum of monomials. You can think about them as “polynomials of infinite degree”.

The coefficients of the monomials are called the coefficients of the power series. Image
One of the most important examples is the famous geometric series.

We’ll use this to derive the closed formula for the Fibonacci numbers. Image
A power series is fully determined by its coefficients: two power series are equal if and only if their coefficients are equal.

This is called the uniqueness property of power series. Image
Power series are also linear in a sense.

That is, summing two power series is the same as summing their coefficients. Image
What happens if we define a power series via the Fibonacci numbers?

Let’s find out.

This is called the Fibonacci generating function: Image
First, we’ll use recursion to obtain a closed-form expression for F(x).

Do you recall how the Fibonacci numbers were initially defined?

We can multiply each term by the corresponding monomial to obtain the terms of the generating function on both sides. Image
After summing the terms, we obtain an equation - for the generating function! Image
With a tiny bit of algebra, we can find the closed form of F(x)!

Here it is below: Image
The right-hand side is a rational fraction, that is, the fraction of two polynomials.

How are we going to find the power series for this particular rational fraction?

By taking a closer look at the polynomial 1 - x - x² in the denominator.
The second-degree polynomial 1 - x - x² is a famous one. Why?

Let’s take a look at its roots via the quadratic formula: Image
This is the golden ratio and its conjugate! Image
These two numbers are quite special.

Geometrically speaking, they describe the segments a and b such that the ratio of a to b is the same as a to a + b. Image
Besides its geometric properties, the golden ratio and its conjugate are also special in an algebraic way.

Their sum and product are 1 and -1, respectively, while their difference is √5. Image
Take note of these, as they’ll come in shortly.

What can we do with all of these? As the golden ratio and its conjugate are the roots of 1 - x - x², we can decompose this quadratic polynomial into the product of two linear terms.

How? Via the partial fraction decomposition. Image
We love rational fractions for one main reason: because they can be decomposed into the sum of geometric series.

In the case of the Fibonacci generating function, the decomposition is particularly simple. Image
We can find a and b by adding the two fractions together. Image
Using the fact that two polynomials are equal if and only if their coefficients are equal leads to a simple system of linear equations. Image
This can be easily solved in terms of the golden ratio and its conjugate. Image
Applying this to the Fibonacci generating function, we can obtain its final form.

(Recall that addition and scalar multiplication of power series can be done coefficientwise.) Image
And thus, we finally obtain the Binet formula!

(As follows from the uniqueness property of power series.) Image
Most machine learning practitioners don’t understand the math behind their models.

That's why I've created a FREE roadmap so you can master the 3 main topics you'll ever need: algebra, calculus, and probabilities.

Get the roadmap here: thepalindrome.org/p/the-roadmap-…

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Tivadar Danka

Tivadar Danka Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @TivadarDanka

Aug 14
The Law of Large Numbers is one of the most frequently misunderstood concepts of probability and statistics.

Just because you lost ten blackjack games in a row, it doesn’t mean that you’ll be more likely to be lucky next time.

What is the law of large numbers, then? Read on: Image
The strength of probability theory lies in its ability to translate complex random phenomena into coin tosses, dice rolls, and other simple experiments.

So, let’s stick with coin tossing.

What will the average number of heads be if we toss a coin, say, a thousand times?
To mathematically formalize this question, we’ll need random variables.

Tossing a fair coin is described by the Bernoulli distribution, so let X₁, X₂, … be such independent and identically distributed random variables. Image
Read 17 tweets
Aug 12
In machine learning, we take gradient descent for granted.

We rarely question why it works.

What's usually told is the mountain-climbing analogue: to find the valley, step towards the steepest descent.

But why does this work so well? Read on: Image
Our journey is leading through:

• Differentiation, as the rate of change
• The basics of differential equations
• And equilibrium states

Buckle up!

Deep dive into the beautiful world of dynamical systems incoming.
First, let's talk about derivatives and their mechanical interpretation!

Suppose that the position of an object at time t is given by the function x(t), and for simplicity, assume that it is moving along a straight line — as the distance-time plot illustrates below. Image
Read 25 tweets
Aug 10
You have seen the famous bell curve hundreds of times before.

Contrary to popular belief, this is NOT a probability, but a probability density.

What are densities, and why do we need them? Read on: Image
First, let's talk about probability.

The gist is, probability is a function P(A) that takes an event (that is, a set), and returns a real number between 0 and 1.

The event is a subset of the so-called sample space, a set often denoted with the capital Greek omega (Ω). Image
Every probability measure must satisfy three conditions: nonnegativity, additivity, and the probability of the entire sample space must be 1.

These are called the Kolmogorov axioms of probability, named after Andrey Kolmogorov, who first formalized them. Image
Read 21 tweets
Aug 10
Most people think math is just numbers.

But after 20 years with it, I see it more like a mirror.

Here are 10 surprising lessons math taught me about life and work: Image
1. Breaking the rules is often the best course of action.

We have set theory because Bertrand Russell broke the notion that “sets are just collections of things.”
2. You have to understand the rules to successfully break them.

Miles Davis said, “Once is a mistake, twice is jazz.”

Mistakes are easy to make. Jazz is hard.
Read 12 tweets
Aug 9
Differentiation reveals much more than the slope of the tangent plane.

We like to think about it that way, but from a different angle, differentiation is the same as an approximation with a linear function. This allows us to generalize the concept.

Let's see why: Image
By definition, the derivative of a function at the point 𝑎 is defined by the limit of the difference quotient, representing the rate of change. Image
In geometric terms, the differential quotient represents the slope of the line between two points of the function's graph. Image
Read 12 tweets
Aug 9
Graph theory will seriously enhance your engineering skills.

Here's why you must be familiar with graphs: Image
What do the internet, your brain, the entire list of people you’ve ever met, and the city you live in have in common?

These are all radically different concepts, but they share a common trait.

They are all networks that establish relationships between objects. Image
As distinct as these things seem to be, they share common properties.

For example, the meaning of “distance” is different for

• Social networks
• Physical networks
• Information networks

But in all cases, there is a sense in which some objects are “close” or “far”. Image
Read 14 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(