With the impressive rollout of #ChatGPT, the entire world has taken notice
It’s an eerie experience speaking with the #AI trained on GPT-3, @OpenAI’s private neural network
While amazing, I fear yet another groundbreaking tech will be in centralized hands
Enter @bittensor_…🧵
It’s an eerie experience speaking with the #AI trained on GPT-3, @OpenAI’s private neural network
While amazing, I fear yet another groundbreaking tech will be in centralized hands
Enter @bittensor_…🧵
https://twitter.com/thekusamarian/status/1601673148591546369
1/ AI Basics
I’m no expert in artificial intelligence, but I’ve spent hours reading up and was lucky enough to speak with @unconst1 and @DoctorM_DO whose passion is palpable
In this thread we’ll talk the basics of AI, the threats of centralization, and where #Bittensor fits in
I’m no expert in artificial intelligence, but I’ve spent hours reading up and was lucky enough to speak with @unconst1 and @DoctorM_DO whose passion is palpable
In this thread we’ll talk the basics of AI, the threats of centralization, and where #Bittensor fits in
2/
Let’s start with #OpenAI so we can translate their structure to Bittensor’s model
Open AI is the company behind the last 3 iterations of #GPT
GPT is the neural network, essentially a fine tuned artificial human brain, which is the infrastructure that apps are built on
Let’s start with #OpenAI so we can translate their structure to Bittensor’s model
Open AI is the company behind the last 3 iterations of #GPT
GPT is the neural network, essentially a fine tuned artificial human brain, which is the infrastructure that apps are built on
https://twitter.com/openai/status/1375164572613545985
3/
There have been 3 iterations of #GPT to date
GPT-1: Groundbreaking model trained with some data. Can be thought of as a POC
GPT-2: Trained on more data and fine tuned to predict the next word
GPT-3: 10x more data w/ fine tuned parameters enabling DALL·E, #ChatGPT and more
There have been 3 iterations of #GPT to date
GPT-1: Groundbreaking model trained with some data. Can be thought of as a POC
GPT-2: Trained on more data and fine tuned to predict the next word
GPT-3: 10x more data w/ fine tuned parameters enabling DALL·E, #ChatGPT and more
https://twitter.com/SteveGagz/status/1529533016976113665
4/
Apps are built on GPT to leverage the learning model. In general, more data with quality "inputs" and "weights" result in a better learning model to build on
But think
#GPT-3 cost at least $10 million to train on 175 billion parameters > 10x any other learning model...
Apps are built on GPT to leverage the learning model. In general, more data with quality "inputs" and "weights" result in a better learning model to build on
But think
#GPT-3 cost at least $10 million to train on 175 billion parameters > 10x any other learning model...
5/
And this model is siloed to one private company and its own data set. Even within #OpenAI, each new model has to be completely re-trained
So all the previous value from GPT-1 and 2 was lost
Plus, each iteration costs exponentially more money, time and computing power/energy
And this model is siloed to one private company and its own data set. Even within #OpenAI, each new model has to be completely re-trained
So all the previous value from GPT-1 and 2 was lost
Plus, each iteration costs exponentially more money, time and computing power/energy
https://twitter.com/martinbouch/status/1549012233635627009
6/
Issues w/ GPT
1. Inefficient: Losing knowledge gained by previous iterations or other models outside OpenAI
2. Siloed: Others can't build on these models without having similar $$$
3. Bias: Centralized control creates ethical dilemmas in something as powerful as AI
Issues w/ GPT
1. Inefficient: Losing knowledge gained by previous iterations or other models outside OpenAI
2. Siloed: Others can't build on these models without having similar $$$
3. Bias: Centralized control creates ethical dilemmas in something as powerful as AI
7/ Enter @bittensor_
Academics have proposed that decentralization can solve many of the inherent problems noted above
This isn't condemnation of OpenAI, it's a problem well-known throughout the field
But how exactly does #Bittensor solve these issues?
towardsdatascience.com/the-future-of-…
Academics have proposed that decentralization can solve many of the inherent problems noted above
This isn't condemnation of OpenAI, it's a problem well-known throughout the field
But how exactly does #Bittensor solve these issues?
towardsdatascience.com/the-future-of-…
8/
"Incentivizing Intelligence"
#Bittensor has created an incentive layer powered by #Bitcoin-style tokenomics to capture maximum compute and open up #AI silos
This layer is powered by @substrate_io, the tech behind @Polkadot. Something @gavofyork and @rphmeier may like
"Incentivizing Intelligence"
#Bittensor has created an incentive layer powered by #Bitcoin-style tokenomics to capture maximum compute and open up #AI silos
This layer is powered by @substrate_io, the tech behind @Polkadot. Something @gavofyork and @rphmeier may like
9/
Validators are already running models today and being rewarded with $TAO resulting in astounding growth of the network over the past year
Soon, if you hold $TAO you can build an app on the network accessing over 100 billion parameters to date
Breaking down those AI silos
Validators are already running models today and being rewarded with $TAO resulting in astounding growth of the network over the past year
Soon, if you hold $TAO you can build an app on the network accessing over 100 billion parameters to date
Breaking down those AI silos
10/
This is key!
You don't have to build out your own neural network, you just hold $TAO and build your solution on @bittensor_'s decentralized infrastructure
Because it's decentralized, bias and censorship risk decreases substantially resulting in a more pure system
This is key!
You don't have to build out your own neural network, you just hold $TAO and build your solution on @bittensor_'s decentralized infrastructure
Because it's decentralized, bias and censorship risk decreases substantially resulting in a more pure system
11/
And with models compounding on each other's knowledge by sharing valuable information with each other, the more #Bittensor grows, the better the model
In fact, the founders estimate that Bittensor could surpass GPT-4 by the end of next year
Slowly, then all at once 🚀 👀
And with models compounding on each other's knowledge by sharing valuable information with each other, the more #Bittensor grows, the better the model
In fact, the founders estimate that Bittensor could surpass GPT-4 by the end of next year
Slowly, then all at once 🚀 👀
https://twitter.com/TheKusamarian/status/1587878750665854976
12/
For all you $DOT fans out there, they plan on self-funding a slot in January 2023 to decentralize even further
As the network has grown, the founders aim to move toward governance directing growth of the network in true @Polkadot fashion
This also means $TAO on DEX soon™
For all you $DOT fans out there, they plan on self-funding a slot in January 2023 to decentralize even further
As the network has grown, the founders aim to move toward governance directing growth of the network in true @Polkadot fashion
This also means $TAO on DEX soon™
13/
This is what true #Web3 looks like. Innovative solutions to difficult problems powered by @substrate_io and @Polkadot's unique offering
As more use cases like @bittensor_ arise, Polkadot will continue to gain traction and position itself as the center of tech innovation
This is what true #Web3 looks like. Innovative solutions to difficult problems powered by @substrate_io and @Polkadot's unique offering
As more use cases like @bittensor_ arise, Polkadot will continue to gain traction and position itself as the center of tech innovation
https://twitter.com/csaint02/status/1601607700302860289
14/
#Bittensor has many more plans in store for 2023 and you can learn more about where they started to where they are now in the link below
DAOs, Subnetworks, TAO wallet and more
And look out for a rebrand coming soon! Stoked to see what they've cooked up!
#Bittensor has many more plans in store for 2023 and you can learn more about where they started to where they are now in the link below
DAOs, Subnetworks, TAO wallet and more
And look out for a rebrand coming soon! Stoked to see what they've cooked up!
https://twitter.com/bittensor_/status/1590017956821741569
If you enjoyed this thread, please like and retweet the first tweet linked below!
Give me a follow to stay up to date on @Polkadot and @kusamanetwork
Thanks for reading 🤝 and I’m happy to answer any questions in the comments below
Give me a follow to stay up to date on @Polkadot and @kusamanetwork
Thanks for reading 🤝 and I’m happy to answer any questions in the comments below
https://twitter.com/csaint02/status/1602996900864483329?s=20&t=1nw6Z_ZW44V14ulbyW59xg
• • •
Missing some Tweet in this thread? You can try to
force a refresh
