swyx the extraordinary alien Profile picture
Jun 6, 2022 10 tweets 8 min read Read on X
There’s a very real possibility local dev may be dead in 10 years.

- @isamlambert “Planetscale doesnt believe in localhost”
- @ericsimons40 Stackblitz runs Node fast in the browser
- @github runs entirely on Codespaces

This would be the biggest shift in dev workflow since git.
writing about “The Death of Localhost” in my next @DXTipsHQ piece, pls offer any relevant data/notable technologies. will acknowledge in writeup!

dx.tips
only 2 ways to make money in dev infra

bundling and unbundling the mainframe
Here is @benthompson writing about @satyanadella's Build keynote:

"the thin client model has won"
stratechery.com/2022/thin-plat…

Perfect for the big move from a Windows-centric to Azure-centric Microsoft.

I wonder if this was planned since the Dave Cutler era ImageImage
@isamlambert @ericsimons40 @github This is live!


big thanks to everyone that contributed opinions and datapoints (shoutouts in the article)! I ended up compiling a nice big list of all the bigco cloud dev environments, and collecting all the arguments for/against ImageImageImageImage
I've updated this post with great takes from this fantastic thread from Kelsey!



In particular like the "working around red tape" theory. So much of cloud service growth is secretly shadow IT. Image
Some survey data and interesting responses (see the Etsy one) in this poll!

"in the long run, fully utilizing the cloud will make engineers more productive. Imagine taking a large test suite and running 1000 tests in parallel on a FaaS platform"

Google launched Cloud Workstations at this week's #GoogleCloudNext 

siliconangle.com/2022/10/11/goo…

this is basically the entire End of Localhost thesis, fully supported as step 1 of GCP’s solution to the software supply chain problem

(great recap on the GCP pod with @forrestbrazeal)
$25m series a?! in this economy?!

wonderful meetup event tonight. can feel the energy building and love @jolandgraf and @svenefftinge’s incredible passion for solving this problem. super encouraged that they really get how important it is to make dev environments *ephemeral*

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with swyx the extraordinary alien

swyx the extraordinary alien Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @swyx

Jul 23
Llama 3: the Synthetic Data model

Llama 3 paper is finally out! by @lvdmaaten and Angela Fan. Quick diffs from yesterday's leaks (+ watch our exclusive @ThomasScialom interview out now!)

- NEW SCALING LAWS! turns out there's a reason why they trained a 405B param model because they had 15T tokens

- full weight class benchmarks table vs Gemma, Mistral, 4o/sonnet! no surprises - 8B and 70B are strongest here, but 405B has solid IFEval and Tool Use
- Multimodal encoder, Vision and Speech Adapter coming
- 15T token data pipeline uses Llama 2 cleaning/filtering, and Deepseek v2 pipelines for code and math!

some pretty fun notes on infra and training - together with full details on learning rates and training recipe.Image
Image
Image
Image
this is going to make @Teknium1 happy - 3 approaches for syndata explored, apart form the obvious 8B/70B distillation

- 405B teaching itself with code execution feedback

- translating code data to smaller programming languages (like TypeScript and PHP??? this is slander)

- "backtranslation" - 1.2m synthetic dialogs going from documentation/explanations to code, then using LLM as judge to filter (pretty smart!)

For math: let's verify step by step :)
Image
Image
Image
Image
All 3 frontier models would basically place out of college immediately lmao Image
Read 8 tweets
Jun 10
a lot of people recapping the WWDC keynote but are any Apple engineers on here sharing insights and behind the scenes?

Apple Intelligence is going to be the largest deployment of tool using AI and i’d like someone to speak at @aidotengineer on the design considerations!

free tix for anyone who introduces an Apple speaker for us!Image
Image
Image
Image
holy shit… guys… Apple quietly destroyed Phi-3, Gemma, and Mistral in one standing jump

everyone saying Apple was “behind on AI” was clowning





Image
Image
Image
Image
Read 4 tweets
Nov 6, 2023
Join @latentspacepod and @thursdai_pod live at DevDay!

Now:

spotted: “New Products Deep Dive” for 45 mins… I wonder what that will be twitter.com/i/spaces/1BRJj…

GPT4 Turbo is ~3x cheaper than GPT4!

1. OpenAI's longest ever Context length: 128k
2. Better JSON/function calling
3. Knowledge: built in RAG and April 2023 cutoff
4. Dalle3, GPT4-V, and TTS model all in API today!!!
4b. Whisper V3 open sourced (coming to API)
5. Customization: GPT3 16k, GPT4 finetuning, Custom Models services
6. Higher Rate Limits - 2x tokens per minute, request raises in account settings - plus: Copyright Shield!

"GPT4 Turbo is a smarter model than GPT4" (GPT4.5 confirmed!)


Image
Image
Image
@latentspacepod @thursdai_pod Friendship resumed with Satya senpai Image
Read 23 tweets
Oct 10, 2023
it’s official - I think GitHub Copilot is the first* generative AI product to publicly claim they’ve passed $100m ARR — enough to stand alone as a publicly listed company

Whenever people ask me “is AI a fad” the biggest thing I point to is “follow the money”:

- revenue, not just funding
- RECURRING, not tcosts on hype
- people publicly saying they’d pay 5x the cost

(*there’s likely a few others but none confirmed officially - see Anatomy of Autonomy post on @latentspacepod)
Image
next up is @DedyKredo LIVE CODING a full test suite, making code changes, and automating commit and PR review, all assisted by @CodiumAI . audible “what the fuck” from @eugeneyan.



ends with a powerful message for Israel. we stand with you @itamar_mar. youtube.com/live/qw4PrtyvJ…
@DedyKredo @CodiumAI @eugeneyan @itamar_mar i think @mdwelsh is an early contender for the “@Dharmesh Award for Most Laughs Per Minute” in his talk

youtube.com/live/qw4PrtyvJ…
Read 17 tweets
Jul 18, 2023
That was fast - Llama 2 is out!

and cleared for commercial use! and *destroys* Falcon 40B on @DanHendrycks's MMLU and other top benchmarks

They really meant it when they said "imminently" lol



Scheduled a @latentspacepod at 3pm PT - join @FanaHOVA and… https://t.co/iWFLYJLCJd https://t.co/C0YKJ8snjr https://t.co/TZvfRrz5lKtwitter.com/i/spaces/1nAKE…
twitter.com/i/web/status/1…



Image
Image
Image
@DanHendrycks @latentspacepod @FanaHOVA it seems @mascobot is on top of it - you can try out llama 2 here:

they also have a Llama playground but its not currently working for me https://t.co/cao0EUYWQSreplicate.com/a16z-infra/lla…
LLaMA 2 seems to know its own name...? what chat completions were given to it?

and these examples from @rajko_rad are great, thank you a16z (why did a16z get the hookup tho? so many questions haha)


Image
Image
Image
Image
Read 17 tweets
Jun 30, 2023
🆕 Essay: The Rise of the AI Engineer



Keeping up on AI is becoming a full time job.

Let's get together and define it. https://t.co/KD2lY9FTtmlatent.space/p/ai-engineer
Builders need a place to talk turpentine. This is why i'm teaming up with @benghamine to produce @aiDotEngineer, the definitive place to talk AI UX, devtools, infra, and all things AI Engineering.

500 seats.
SF/Virtual, Oct 8-10.

Join us!

Screenshot from a DM today. We're changing lives and encouraging people to get over their own mental hurdles to build with AI. I love this so much.

https://t.co/MZXlc9VQzu
Read 5 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(