My brother (@0xDACA) and I worked on a fun project tonight, inspired by @yoheinakajima : Coding Agent that follows the Test Driven Development (TDD) methodology!
You write the tests - and the agent runs in a loop until it creates the feature properly!
We start with a simple FastAPI app and two tests - one of which will fail (the "echo" endpoint does not exist)
2/6
Then - we run the agent - it does not read the tests, it can just run them and get the output.
On the first try, it created the "echo" endpoint with a POST method - which failed, as the test defined it as a GET:
3/6
It then took the failures and converted the code to use GET instead - which failed again but with a different error*.
*We tried to make it fail on purpose, so in the test, we defined the expected key name of the return value as "message1" and not "message"
4/6
It, therefore, took the failures (again), and adjusted the code - this time making the return value "message1" - which worked, and the tests passed.
5/6
Currently only works well with small changes, but we are working on cool stuff for it: enabling changes across multiple files, creating its own tests, etc
Framing it inside TDD is super useful to steer it in a specific, measurable direction - while keeping it somewhat autonomous
• • •
Missing some Tweet in this thread? You can try to
force a refresh
It is actually straightforward, we just ask Llama-3-405B running on @togethercompute / @GroqInc
etc to act as an expert in a field, and to generate dataset items to pass this knowledge forward to a smaller model.
(forgive my prompt engs, this can be improved for sure!)
A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin!
Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)
The setup is also quite easy:
1. a simple @supabase instance for vector db, authentication, and compute functions connected either to OpenAI or your own @ollama server running somewhere
2. A @nextjs app (with native support with @capacitorjs )
2. The hardware device
The hardware device setup is also quite straightforward, and it will become cheaper and easier to set up in the next week or so (once switching to Raspberry Pi Zero) - so stay tuned!