Simplifying LLMs, AI Agents, RAGs and Machine Learning for you! β’ Co-founder @dailydoseofds_β’ BITS Pilani β’ 3 Patents β’ ex-AI Engineer @ LightningAI
21 subscribers
Jan 16 β’ 13 tweets β’ 4 min read
Let's build a pipeline to evaluate and monitor a RAG application, using a 100% open-source tool:
Before we start here's a quick demo what we're building:
Tech Stack:
- @Cometml's Opik for eval and observability
- @Llama_Index to build a RAG app
Track everything from, LLM calls to chunking, embedding, generation and evaluation!
- @llama_index for orchestration.
- @qdrant_engine as VectorDB (with Binary Quantization).
- @SambaNovaAI for blazing fast LLM inference
This video shows what we are building.
Let's go! π
Jan 7 β’ 11 tweets β’ 3 min read
Let's build an Agentic RAG, step-by-step with code (100% local):
Before we begin, take a look at what we're about to create!
Here's what you'll learn:
- @CrewAIInc for multi-agent orchestration
- @qdrant_engine to self-host a vector DB
- @firecrawl_dev for web search
Let's go! π
Jan 5 β’ 12 tweets β’ 4 min read
Let's build a Chat with docs RAG app, featuring ModernBERT (100% local):
Before we begin, take a look at what we're about to create!
Here's what you'll learn:
- @Llama_Index for orchestration
- @ollama for locally serving Llama 3.2
- @qdrant_engine to self-host a vector DB
- @nomic_ai for ModernBERT embeddings
Let's go! π
Jan 1 β’ 8 tweets β’ 3 min read
I've been coding in Python for 9 years now. β³
If I were to start over today, here's a roadmap:
1οΈβ£ freeCodeCamp
4 hours Python bootcamp!!
What you'll learn:
- Installing Python
- Setting up an IDE
- Basics Syntax
- Variables & Datatypes
- Looping in Python
- Exception handling
- Modules & pip
- Mini hands-on projects π₯
Check this out π
Dec 30, 2024 β’ 7 tweets β’ 2 min read
Eigenvalues and eigenvectors, clearly explained:
The concept of eigenvalues & eigenvectors is widely known yet poorly understood!
Today, I'll clearly explain their meaning & significance.
Let's go! π
Dec 25, 2024 β’ 10 tweets β’ 3 min read
f-strings in Python clearly explained:
f-strings were introduced in Python 3.6 and have since become a favorite among developers for their simplicity and readability.
Today, we'll start with the basics and dive into all the ninja tricks of using f-strings.
Let's go! π
Dec 17, 2024 β’ 9 tweets β’ 3 min read
Multithreading in Python clearly explained:
Ever felt like your Python code could run fasterβ
Multithreading might be the solution you're looking for!
Today, I'll simplify it for you in this step-by-step guide.
Let's go! π
Dec 14, 2024 β’ 11 tweets β’ 4 min read
Let's build a multi-agent AI news generator using Cohere's new βR 7B:
Before we begin, take a look at what we're building!
The app takes a user query, searches the web for it, and turns it into a well-crafted news article, with citations!
Stack:
- @Cohere ultra-fast βR 7B as LLM
- @CrewAIInc for multi-agent orchestration
Let's go! π
Dec 7, 2024 β’ 11 tweets β’ 4 min read
Let's build a RAG app using MetaAI's Llama-3.3 (100% local):
Before we begin, take a look at what we're about to create!
Here's what you'll learn:
- @Llama_Index for orchestration
- @qdrant_engine to self-host a vector DB
- @Ollama for locally serving Llama-3.3
- @LightningAI for development & hosting
Let's go! π
Dec 5, 2024 β’ 9 tweets β’ 3 min read
Decorators in Python, clearly explained:
Decorators are one of the most powerful feature of Python! π₯
However, understanding them can be a bit overwhelming!
Today, I'll clearly explain how decorators work!
Let's go! π
Dec 4, 2024 β’ 18 tweets β’ 5 min read
15 cheat sheets you shouldn't miss as a data scientist:
1. Pandas β Polars β SQL β PySpark Translations.
Master data wrangling by understanding how these frameworks relate to one another. Here's your go-to translation guide for smooth transitions!
Dec 3, 2024 β’ 11 tweets β’ 3 min read
Let's build a real-time AI voice assistant, step-by-step:
Before we start, here's a quick demo of what we're building!
Tech stack:
- @AssemblyAI to convert speech to text in real-time.
- @OpenAI's GPT-4o to generate intelligent responses.
- @elevenlabsio to convert text responses back to speech.
Let's go! π
Nov 21, 2024 β’ 12 tweets β’ 4 min read
Let's build a multi-agent financial analyst using Microsoft's Autogen and Llama3-70B:
Before we start, here's a demo and walkthrough of what we're building today.
Tech stack:
- Microsoft's Autogen for multi-agent collaboration
- @Qualcomm's Cloud AI 100 ultra for serving Llama 3:70B
Let's go! π
Nov 20, 2024 β’ 7 tweets β’ 2 min read
5 open-source agentic frameworks that will give you superpowers as an AI engineer:
1οΈβ£ Dymamiq
@DynamiqAGI is like a Swiss army knife for AI Engineers, it supports:
- RAG applications.
- Multi agent orchestration
- And managing complex LLM workflows
Let's build a PerplexityAI-like personal research assistant using multi-agent orchestration:
Before we dive in, let's see what we're about to create!
We'll use:
- @SwarmZeroAI for multi-agent orchestration
- @Serp_api for real-time search
- @FireCrawl_dev for LLM-ready web scraping
Let's go! π
Nov 12, 2024 β’ 10 tweets β’ 3 min read
How LLMs understand relative positions of input words, clearly explained:
RoPE (Rotary Positional Embeddings) revolutionised the way positional information is encoded in LLMs and it's widely used by models like Llama-3.
Today, I'll clearly explain what they are & how positional embeddings evolved over time.
Let's go! π
Nov 9, 2024 β’ 12 tweets β’ 5 min read
10 great Python packages for Data Science not known to many:
1οΈβ£ CleanLab
You're missing out on a lot if you haven't started using Cleanlab yet!
Cleanlab helps you clean data and labels by automatically detecting issues in a ML dataset.
How LLMs work, clearly explained:
Before diving into LLMs, we must understand conditional probability.
Let's consider a population of 14 individuals:
- Some of them like Tennis πΎ
- Some like Football β½οΈ
- A few like both πΎ β½οΈ
- And few like none
Here's how it looks π
Nov 5, 2024 β’ 6 tweets β’ 2 min read
Python *args & **kwargs clearly explained:
*args allows you to pass a variable number of non-keyword arguments to a function.
It collects all non-keyword arguments passed to the function and stores them as a tuple.
Consider the following example:
Nov 4, 2024 β’ 9 tweets β’ 3 min read
Self-attention in transformers, explained as a directed graph:
Self-attention is at the heart of transformers, the architecture that led to the LLM revolution that we see today.
In this post, I'll clearly explain self-attention & how it can be thought of as a directed graph.