Daniel Whitenack Profile picture
Building @predictionguard, Creating #AI for good with @SILintl, Co-hosting @PracticalAIFM (aka Data Dan, @dwhitena@sigmoid.social)
Apr 4, 2023 7 tweets 5 min read
I used @predictionguard (paired with @LangChainAI)to evaluate 27 Large Language Models (LLMs) for text generation and automatically select a best/fallback model for use in some generative #AI applications.

A thread 🧵 Some general thoughts:

-> No surprise in the top performer (@OpenAI GPT-3.5), but...

-> 3 of @CohereAI models show up, including the runner up.

-> Surprised to see XLNet, a model that I can pull down from @huggingface, performs better than some of the popular #LLMs