Building @predictionguard, Creating #AI for good with @SILintl, Co-hosting @PracticalAIFM (aka Data Dan, @dwhitena@sigmoid.social)
Apr 4, 2023 • 7 tweets • 5 min read
I used @predictionguard (paired with @LangChainAI)to evaluate 27 Large Language Models (LLMs) for text generation and automatically select a best/fallback model for use in some generative #AI applications.
A thread 🧵
Some general thoughts:
-> No surprise in the top performer (@OpenAI GPT-3.5), but...
-> 3 of @CohereAI models show up, including the runner up.
-> Surprised to see XLNet, a model that I can pull down from @huggingface, performs better than some of the popular #LLMs