Open source 2.7 billion parameter GPT-3 model was released
github.com/EleutherAI/gpt…
As you probably know OpenAI has not released source code or pre-trained weights for their 175 billion language model GPT-3.
A thread 👇
github.com/EleutherAI/gpt…
As you probably know OpenAI has not released source code or pre-trained weights for their 175 billion language model GPT-3.
A thread 👇
1/ Instead, OpenAI decided to create a commercial product and exclusively license GPT-3 to Microsoft.
But open-source enthusiasts from eleuther.ai have open-sourced the weights of 1.3B and 2.7B param models of their replication of GPT-3
🛠️github.com/EleutherAI/gpt…
But open-source enthusiasts from eleuther.ai have open-sourced the weights of 1.3B and 2.7B param models of their replication of GPT-3
🛠️github.com/EleutherAI/gpt…
2/ It is the largest (afaik) publicly available GPT-3 replica. The primary goal of this project is to replicate a full-sized GPT-3 model and open source it to the public, for free.
The models were trained on an open-source dataset The Pile pile.eleuther.ai which ...
The models were trained on an open-source dataset The Pile pile.eleuther.ai which ...
3/ which consists of 22 smaller, high-quality datasets combined together (825 GB text in total). Larger GPT models (10B and full GPT-3) are not available yet, but soon will be released by eleuther.ai.
...
...
4/ The 2.7B model likely won't fit into the Colab TPUs memory, and you may have to get some larger TPU pods to finetune from it. Sampling from it, however, works just fine.
👫 Colab notebook colab.research.google.com/github/Eleuthe…
...
👫 Colab notebook colab.research.google.com/github/Eleuthe…
...
5/ It is the first time I tried some kind of GPT model, and I was not too impressed (see my fav results below). Maybe 2.7 billion params are not enough yet to leave the copyrighters without their jobs 🤷🏼♂️. Let's wait for a bigger model.
...
...
7/
I decided to ask the AI if it will kill us, meatbags, in the near future. This is what I got in response...
I decided to ask the AI if it will kill us, meatbags, in the near future. This is what I got in response...
8/
Prompt: Will AI enslave the humankind in the next 20-30 years?
====
GPT-3 Answers:
====
The increasing pace of AI is not going to decrease. As of now the AI revolution has just began. The effects of AI on people and the future is not known yet, but if that is the AI’s fate..
Prompt: Will AI enslave the humankind in the next 20-30 years?
====
GPT-3 Answers:
====
The increasing pace of AI is not going to decrease. As of now the AI revolution has just began. The effects of AI on people and the future is not known yet, but if that is the AI’s fate..
9/ ...then the exposure of the human population is going to increase drastically.
There is a possibility that you will be in one of the AI enslaved societies.
The AI Revolution is a powerful technologies that is coming to the world in the near future. The AI revolution will...
There is a possibility that you will be in one of the AI enslaved societies.
The AI Revolution is a powerful technologies that is coming to the world in the near future. The AI revolution will...
10/
will be implemented as a protection mechanism for the protection of planet earth from dangerous climate change and increasing nuclear war. The AI has the potential to be our savior for the future. It is going to be a technology that is going to change the world drastically...
will be implemented as a protection mechanism for the protection of planet earth from dangerous climate change and increasing nuclear war. The AI has the potential to be our savior for the future. It is going to be a technology that is going to change the world drastically...
11/
but there is a possibility that this is simply an illusion that we are living in a world of AI and it is just a pure mass hallucination, and all those projections actually represent the AI’s downfall and not an AI savior.
...
but there is a possibility that this is simply an illusion that we are living in a world of AI and it is just a pure mass hallucination, and all those projections actually represent the AI’s downfall and not an AI savior.
...
12/
.I am excited to see what the AI revolution is going to bring.
.I believe that it is going to bring great changes to our civilization.
.I believe that it is going to bring great changes in human civilization.
(c) GPT-3 🦾
.I am excited to see what the AI revolution is going to bring.
.I believe that it is going to bring great changes to our civilization.
.I believe that it is going to bring great changes in human civilization.
(c) GPT-3 🦾
13/
Well, the last 10 years or so have been awful for everyone. It's not AI enslaving the humans in the next 20 or 30, it's automation on a global scale.
(c) GPT-3 🦾
Well, the last 10 years or so have been awful for everyone. It's not AI enslaving the humans in the next 20 or 30, it's automation on a global scale.
(c) GPT-3 🦾
@threadreaderapp unroll
😅 
• • •
Missing some Tweet in this thread? You can try to
force a refresh
