Although already quite popular but a lot of folks are yet to try this!
A framework for creating web applications for data science and machine learning projects, allowing for easy and interactive data viz & model deployment.
Let's build a 100% local RAG app, featuring ⌘R, a self-hosted vector
database, a fast embedding library & a reranker:
Before we begin, take a look at what we're building today!
And here's what you'll learn:
- @Ollama for serving ⌘R
- @Streamlit for building the UI
- @Llama_Index for orchestration
- @qdrant_engine to self-host a vector db
- @LightningAI for development & hosting
Let's go! 🚀
The architecture diagram presented below illustrates some of the key components & how they interact with each other!
What's new❓
- Self hosting a vector db
- Faster embedding
- Using a reranker
It will be followed by detailed descriptions & code for each component: