There’s a very real possibility local dev may be dead in 10 years.
- @isamlambert “Planetscale doesnt believe in localhost”
- @ericsimons40 Stackblitz runs Node fast in the browser
- @github runs entirely on Codespaces
This would be the biggest shift in dev workflow since git.
writing about “The Death of Localhost” in my next @DXTipsHQ piece, pls offer any relevant data/notable technologies. will acknowledge in writeup!
big thanks to everyone that contributed opinions and datapoints (shoutouts in the article)! I ended up compiling a nice big list of all the bigco cloud dev environments, and collecting all the arguments for/against
I've updated this post with great takes from this fantastic thread from Kelsey!
"in the long run, fully utilizing the cloud will make engineers more productive. Imagine taking a large test suite and running 1000 tests in parallel on a FaaS platform"
wonderful meetup event tonight. can feel the energy building and love @jolandgraf and @svenefftinge’s incredible passion for solving this problem. super encouraged that they really get how important it is to make dev environments *ephemeral*
Llama 3 paper is finally out! by @lvdmaaten and Angela Fan. Quick diffs from yesterday's leaks (+ watch our exclusive @ThomasScialom interview out now!)
- NEW SCALING LAWS! turns out there's a reason why they trained a 405B param model because they had 15T tokens
- full weight class benchmarks table vs Gemma, Mistral, 4o/sonnet! no surprises - 8B and 70B are strongest here, but 405B has solid IFEval and Tool Use
- Multimodal encoder, Vision and Speech Adapter coming
- 15T token data pipeline uses Llama 2 cleaning/filtering, and Deepseek v2 pipelines for code and math!
some pretty fun notes on infra and training - together with full details on learning rates and training recipe.
this is going to make @Teknium1 happy - 3 approaches for syndata explored, apart form the obvious 8B/70B distillation
- 405B teaching itself with code execution feedback
- translating code data to smaller programming languages (like TypeScript and PHP??? this is slander)
- "backtranslation" - 1.2m synthetic dialogs going from documentation/explanations to code, then using LLM as judge to filter (pretty smart!)
a lot of people recapping the WWDC keynote but are any Apple engineers on here sharing insights and behind the scenes?
Apple Intelligence is going to be the largest deployment of tool using AI and i’d like someone to speak at @aidotengineer on the design considerations!
free tix for anyone who introduces an Apple speaker for us!
1. OpenAI's longest ever Context length: 128k 2. Better JSON/function calling 3. Knowledge: built in RAG and April 2023 cutoff 4. Dalle3, GPT4-V, and TTS model all in API today!!!
4b. Whisper V3 open sourced (coming to API) 5. Customization: GPT3 16k, GPT4 finetuning, Custom Models services 6. Higher Rate Limits - 2x tokens per minute, request raises in account settings - plus: Copyright Shield!
"GPT4 Turbo is a smarter model than GPT4" (GPT4.5 confirmed!)
@latentspacepod @thursdai_pod Friendship resumed with Satya senpai
it’s official - I think GitHub Copilot is the first* generative AI product to publicly claim they’ve passed $100m ARR — enough to stand alone as a publicly listed company
Whenever people ask me “is AI a fad” the biggest thing I point to is “follow the money”:
- revenue, not just funding
- RECURRING, not tcosts on hype
- people publicly saying they’d pay 5x the cost
(*there’s likely a few others but none confirmed officially - see Anatomy of Autonomy post on @latentspacepod)
next up is @DedyKredo LIVE CODING a full test suite, making code changes, and automating commit and PR review, all assisted by @CodiumAI . audible “what the fuck” from @eugeneyan.
Builders need a place to talk turpentine. This is why i'm teaming up with @benghamine to produce @aiDotEngineer, the definitive place to talk AI UX, devtools, infra, and all things AI Engineering.