Hacked together an app today powered by Llama-3.1 on @GroqInc. Inspired by o1, it uses reasoning chains to solve problems. Maybe prompting is all you need?
Works great on the Strawberry problem, even triple checks the solution! All within 4 seconds of thinking… at the speed of Groq.
g1 uses reasoning chains, in principle a dynamic Chain of Thought, that allows the LLM to "think" and solve some logical problems that usually otherwise stump leading models.
At each step, the LLM can choose to continue to another reasoning step, or provide a final answer. Each step is titled and visible to the user.
The system prompt also includes tips for the LLM. The README on GitHub has a full breakdown, but a few examples are asking the model to “include exploration of alternative answers” and “use at least 3 methods to derive the answer”.