🥁 Introducing @vidtranslator 🌎
Hacked together a twitter bot that uses @OpenAI #whisper to translate any videos in any tweets, in... any language.
Making @Twitter a truly global water cooler.
It's mind-blowing how good it is! Examples 🧵
As a ukranian born who doesn't remember any Ukranian, it bothered me that pres. Zelensky doesn't upload videos with english subtitles!
Well, #whisper to the rescue!
Now, with the ease of @vidtranslator , just mentioning it in a reply to a tweet with video, say from @IAPonomarenko will return a translated video!
How about other things that are happening?
A lot of the time, twitter is the immediate platform, tweets and videos are recorded, and while you could translate tweets, videos.. needed folks to use captioning software, it's a slow process!
No longer!
I'm really impressed with whisper, it's not perfect and I'm running the medium model (again, on my own PC, @replicatehq can I get an upload permission?)
But it's pretty fast!
Here's a german for example:
Nuance is hard to translate, like Ukranians calling russian terrorists Orcs, but whisper again, shines here!
@ilyasut @npew @gdb I know I said this before, but @OpenAI did very good with this model release as open source, bringing the world together like never before!
Can't wait for whisper 2.0! Mean while, try translating videos with @vidtranslator (let's see how quickly it breaks)
@simonw @m1guelpf Liked this? Please retweet the main thread for visiblity!
And don't forget to signup for myai.art it's going to blow your mind!
Share this Scrolly Tale with your friends.
A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.