Stop building the thing.
Build the thing that builds all the things.
IMO the most important thing every developer could be doing right now on nights and weekends is building a general purpose personal junior dev agent they can control and trust, that they can scale to fleets.… twitter.com/i/web/status/1…
first thing Tony ever built wasn't a flying suit of armor, fancy weapons, or mini fusion reactor
he built the thing that builds the things (and saves his life when the other stuff fails)
now that GPT4/Claude/RMT/Unlimiformer context is trending to infinity (
) the stuff you can do to improve developer experience is bananas
just wrote a smol debugger that reads my entire codebase so i can just chuck in my error message to pair program lmao
shoutout due to @mlejva who inspired me with e2b_dev (disclosure - i am investing in his new company) and i just wanted to see how far i could get in a weekend + make stupidly scalable with @modal_labs
.@Replit just announced their own LLaMa style code LLM at their developer day!
replit-code-v1-3b
- 2.7b params
- 20 languages
- 525B tokens (“20x Chinchilla?”)
- beats all open source code models on HumanEval benchmark
- trained in 10 days with @NaveenGRao@MosaicML
and @amasad follows up with a finetuned version - replit-finetune-v1-3b - using @Replit data - and this catapults Replits model *ahead* of @OpenAI codex 🤯
they are matching the performance of >10B LLMs with way smoller 2.7B models
and it will be open source/freely licensed!
better quality view of slides from the man himself:
follow @pirroh for the release next week - both “the model weights and vocabulary under Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)”
I love seeing the birth of a new social network. unsure about its future but its cool that in early days it’s still smol enough you can hold the world “map” in your head and zoom in to see individual people
the internet was a nicer place when it was a neighborhood and not a mob
everyone out here tweeting bsky fomo, i'm in here making @chirperai bots, we are not the same
just so we’re clear, everyone remembers that bluesky is a blockchain app yeah?
@jack is the most bitcoin-pilled ceo that isnt mcafee-level crazy
just curious to see the biggest web3 skeptics go wild over a text based NFT platform because ✨exclusive invites ✨
Presenting
- Summary of #AutoGPT / @babyAGI_
- The 5 stages of "brain" development it took to get from Foundation Models to Autonomous Agents
- Why Full Autonomy is like "Full Self Driving"!
Begin:
@babyAGI_ (this is the obligatory threadooor TLDR of my latest newsletter post, hop over if you like my long form work: latent.space/p/agents)
I think there have been 4 "Killer Apps" of AI so far.
"Killer App" as in:
- unquestionable PMF
- path to making >$100m/yr
- everybody holds it up as an example
They are: 1. Generative Text 2. Generative Art 3. Copilot for X 4. ChatGPT
this feels like cheating. i cant look at any new codebase without this visualization again (cc @ShaneaLeven or @danlovesproofs maybe already has a smarter take on this)
One surprising finding that I'm just gonna present without comment because it's kind of a hot take -
Despite needing to:
- store and retrieve from @pinecone memory
- craft agentic and generative prompt templates
- chunk long text
Incredible how Stephen Wolfram toiled away in relative obscurity for ~15 years, only to wake up one day and find that Wolfram|Alpha is literally the perfect bridge from agentic AI to real world knowledge, errors included.
if you had asked me in January how long it would take us to blend symbolic ai and generative ai i would have said 5 years… took 10 lines of json with the new chatgpt plugins system
It can now:
- browse the web (RIP Bing waitlist, cutoff)
- write and run Python (RIP replit?)
- access org info (RIP docsearch startups)
- add third party plugins from OpenTable, Wolfram, Instacart, Zapier, etc)
- developer SDK in preview
When I talked about the AI Red Wedding last year (