Tim Carambat Profile picture
Jun 7, 2023 β€’ 8 tweets β€’ 4 min read β€’ Read on X
Announcing AnythingLLM. An open-source (MIT) full-stack app for chatting with... anything.

βœ… UI for managing documents
βœ… Uses @OpenAI , @pinecone & @LangChainAI

🚫 massive RAM requirements
🚫 LLM downloading or training
🚫 paying to re-embed documents

+ data tooling! twitter.com/i/web/status/1… Image
First, you can find AnythingLLM on Github here
github.com/Mintplex-Labs/…

Requirements:
- Python 3.8+
- npm and Node v16+

Thats it. No bulky CPU or GPU is required.

Chatting with your documents is the "hello world" of LLM use-cases, why not make it more accessible?
What is so special about AnythingLLM?

πŸ”₯ No crazy system requirements - runs fast and passively on your machine

🧰 Full data-collection tool suite. Collect anything
πŸ‘‰ Entire YouTube Channels
πŸ‘‰ Substacks
πŸ‘‰ Mediums
πŸ‘‰ Gitbooks
+ local document processing Image
⚑ Efficient vector-caching

Embed forever, pay once.

Embedding is low-cost using OpenAIs ada text embedding, but over thousands of tokens - why pay more than once?

AnythingLLMs vector caching allows you to use the same document across workspaces and pay once. Image
πŸ’Ž Persistent and Useable
Chatting and managing documents is all done from a web-browser UI.

Shut down the app and start it later - all your documents, chats, and more are still present. Picking up right where you left off.

The database is locally saved on your machine. Image
πŸ”‘ Bring-Your-Own-Keys

Use your own OpenAI API key and Pinecone (free) instance and you are already on the way to managing documents with ease.

This keeps overhead low by just using what is existing, easy and accessible. Image
AnythingLLM is MIT Licensed so go crazy. Read more about AnythingLLM on Medium at:
medium.com/rampp/anything…
Just merged in @trychroma for all the Chroma-homies who are down to use more OSS tools

github.com/Mintplex-Labs/…

β€’ β€’ β€’

Missing some Tweet in this thread? You can try to force a refresh
γ€€

Keep Current with Tim Carambat

Tim Carambat Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @tcarambat

Feb 7, 2024
Excited to announce our public beta of @AnythingLLM Desktop!

A privacy-focused, fully customizable, and accessible AI document chatbot all wrapped up in a single installable application you can run offline.

read on πŸ‘‡Image
AnythingLLM Desktop is totally free, can run fully offline, and can be set up to any degree of privacy you are personally comfortable with.

useanything.com/download
We support whatever LLM you are using
- @OpenAI chat & fine-tunes
- @AnthropicAI Claude
- @Google Gemini
- @huggingface inferencing
- @togethercompute chat models
- @MistralAI API chat

or opt for private & offline LLMs powered by
- @ollama
- @LocalAI_API
- @LMStudioAI Image
Read 6 tweets
Jul 27, 2023
Introducing VectorAdmin an open-source, universal GUI for vector databases.

βœ… Atomically manage embeddings in @trychroma or @pinecone
βœ… Upload documents straight to your vector db
βœ… Update single embeddings on the fly
βœ… Clone entire namespaces at no cost
+ dev tools!! https://t.co/HJ8jZHRHBgtwitter.com/i/web/status/1…
Image
First, you can run this tool yourself on GitHub here:


Requirements:
- Python 3.9
- Nodejs
- A @pinecone or @trychroma database

We do everything else for you. Whether it's 10 vectors or 100,000 - VectorAdmin is the tool for the job.github.com/Mintplex-Labs/…
When using @LangChainAI for splitting and uploading to a vector DB you very quickly realize that you lose control of what's actually in your vector database.

This is unacceptable for a startup or a business using vector databases for unlocking more powerful LLM applications Image
Read 6 tweets
Oct 7, 2021
My newest NFT project:
"SocialProof" trading cards. We have seen the top tier cards like NBA Top Shot and otherwise but my 1 major question is "why is the content not updating"

Like we have all this tech and opportunity and our trading cards are still static? The plan πŸ‘‡
So i don't know anyone in the NFL/NCAA/NBA that could get me licensing, but there is another angle here.

Cards for your favorite people on the internet!!

Be it Youtube, Twitch, Twitter, or elsewhere. Each platform has unique stats to them, but the stats update over time!
The thing about trading cards is they are out of date the second you buy one. With these cards, they will update daily/weekly/monthly.

For example, here is one for @shroud (just a concept)
But here is the big "ah ha!" moment...
Read 6 tweets
Oct 6, 2021
We since @MekaVerse's discord bot isnt verifiying ill place this here. The Vue app that runs their frontend is themekaverse.com and is dumping all the ENV vars to the frontend.

Nothing serious since its mostly testnet stuff, but...
you can view the test contract on rinkeby that has the symbol FSD and name 'MyCustomContract'
rinkeby.etherscan.io/address/0xcdA2…
Since you cannot know the ABI for this custom contract, but it being on @opensea means its at least ERC721 or ERC1115 so you can just import a default ERC721 contract and interact with the rinkeby address via the "load from address" action while on rinkeby...
Read 12 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(