Joris de Jong Profile picture
Jun 21, 2023 12 tweets 6 min read Read on X
Did you know you can use ChatGPT to summarize your (online) meetings?

With @LangChainAI, and a couple of lines of code, you can!

Let me show you how in 6 simple steps🧵

#AI Image
Before we dive in, this is day 2 of my '7 days of LangChain'.

Every day, I'll introduce you to a simple project that will guide you through the basics of LangChain.

Follow @JorisTechTalk to stay up-to-date.

If there's anything you'd like to see, let me know!

Let's dive in:
High level overview of what's happening:

1️⃣ Load your audio file
2️⃣ Speech-to-text with Whisper
3️⃣ Split the transcript into chunks
4️⃣ Summarize the transcript

Let's dive into the code ⬇️ Image
1. Open your audio file.

Whisper works on files with a maximum duration of approximately 20 minutes.

Longer file?

Split it up by using PyTube and handle each chunk seperately. Image
2. Call the Whisper API

Of course, you can use any speech-to-text API you prefer. I like Whisper for its accuracy and ease of use.

Any open-source alternatives with quality output? Image
3. Splitting the transcript into chunks

With the new OpenAI GPT 16k model, you can fit a large amount of context into one chunk. This is amazing for the model to 'understand' the full context and make connections.

Use some overlap in order for context to not be lost. Image
4. Prompting

Prompting is key. It determines your output more than anything else.

Be as concise as you can be. Instruct the model on how you want the output to look. You could include bullet points, main takeaways, follow-up actions and much more. ImageImage
5. Initialize and run the summary chain

I'm using the refine summarization chain. This is great when you're working with large files.

It generates an initial summary based on the first chunk and updates it with the subsequent chunks. Image
6. Export the summary to a text file

Your meeting is summarized and you're ready to take action!

Once again, try to play around with the prompts you're using. This will greatly impact the resulting summarization. Image
7. Possible future implementations

You can go wild with this. You could use a Zapier integration to send the summarized meeting in an email, create appointments in your schedule and much more.

Let me know what you're going to add.
That concludes day 2 of '7 days of @LangChainAI'

Tomorrow's project: Creating mindmaps with @LangChainAI and @XmindHQ.

Follow @JorisTechTalk to stay up-to-date.

What else would you like to see?
@LangChainAI @XmindHQ Day 2 of '7 days of @LangChainAI' ✅

Tomorrow's project will be exciting: generating mindmaps for studying!

What else do you want to see?

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Joris de Jong

Joris de Jong Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @JorisTechTalk

Sep 19, 2023
Remember that moment when you first heard about Generative AI?

One of the first things that caught my attention was the ability to 'talk' with PDF files.

Let's go back to the @LangChainAI basics and talk about why chunking is important for Retrieval Augmented Generation. 🧵 Image
@LangChainAI I'll show you how you can create a simple Q&A bot in a couple of lines of code.

In step 4, I'll go a bit deeper on why smaller chunk sizes are important for Retrieval Augmented Generation.

Check the last message for GitHub Repo. Image
@LangChainAI Step 1 - Environment Setup:

Start by configuring your environment.

Load essential variables from your .env file.

This includes your all-important OpenAI API Key. Image
Read 16 tweets
Aug 25, 2023
Want to learn with YouTube, but don't have the time to watch videos?

AI's got you covered.

With 8 simple lines of @LangChainAI code, you've got yourself a YouTube Summarizer.

Here's how ⬇️

(GitHub Repo down below.) Image
@LangChainAI 0/7 Install packages

For this code to work, you only need to install 4 packages:

- LangChain
- YouTube Transcript API
- OpenAI
- TikToken

Make sure to import dependencies in your Python file.

Next up: Loading the YouTube Transcript.
Image
Image
@LangChainAI 1/7 Loading Transcript.

The LangChain Document Loaders help you with a wide variety of tasks.

YoutubeLoader takes in a YouTube URL and returns the transcript.

You can even specify your preferred language! Image
Read 9 tweets
Aug 4, 2023
Are you using ChatGPT to learn a subject?

Great.

But you can do better.

Today's mission: Create a Smart Studdy Buddy using @LangChainAI & @streamlit.

Let me show you how (code included) 🧵

#AI Image
Before we dive in, this is day 4 of my LangChain Unchained series.

Each day, I'll implement a small LangChain project in Streamlit.

Follow @JorisTechTalk to stay up-to-date.

If there's anything you'd like to see, let me know!

Let's dive in:
Preparing for an exam?

Use your own study material to get practice questions and answers!

A high-level overview:

1️⃣ Extract text from PDF
2️⃣ Generate questions
3️⃣ Generate answers

It's a simple app.

Now for the code: ⬇️
Read 32 tweets
Jul 25, 2023
Mircrosoft Copilot and ChatGPT will be great for transcribing meetings.

But I don't have the patience to wait for the launch.

Today's mission: build a meeting/voice-note summarizer with @LangChainAI, @streamlit, and OpenAI's Whisper.

Let me show you how 🧵

GitHub Link ⬇️

#AI Image
Before we dive in, this is day 3 of my LangChain Unchained series.

Each day, I'll implement a small LangChain project in Streamlit.

Follow @JorisTechTalk to stay up-to-date.

If there's anything you'd like to see, let me know!

Let's dive in:
A high-level overview:

1️⃣ Record audio
2️⃣ Transcribe audio through OpenAI's Whisper
3️⃣ Summarize transcription

It's a simple app.

Now for the code: ⬇️
Read 12 tweets
Jul 18, 2023
Working with ChatGPT feels like magic.

But did you know you can create AI-tools like ChatGPT yourself?

Unleash the potential by merging @LangChainAI and @streamlit.

Today's mission: craft a 4-hour workday blueprint based on @thedankoe's video.

Let me show you how 🧵 Image
Before we dive in, this is day 1 of my LangChain Unchained series.

Each day, I'll implement a small LangChain project in Streamlit.

Follow @JorisTechTalk to stay up-to-date.

If there's anything you'd like to see, let me know!

Let's dive in:
A high-level overview:

1️⃣ Load YouTube transcript
2️⃣ Split transcript into chunks
3️⃣ Use summarization chain to create a strategy based on the content of the video.
4️⃣ Use a simple LLM Chain to create a detailed plan based on the strategy.

And now for the code ⬇️ Image
Read 22 tweets
Jun 28, 2023
ChatGPT can give you a kick-start when learning new skills.

But I like to learn through YouTube videos.

With the power of @LangChainAI, you can generate a personalized YouTube study schedule based on a skill you'd like to learn.

Let me show you how: 🧵

#AI
Before we dive in, this is day 7 of my '7 days of LangChain'.

Every day, I've introduced you to a simple project that will guide you through the basics of LangChain.

Today's a longer one.

Follow @JorisTechTalk to stay up-to-date on my next series.

Let's dive in:
High level overview of what's happening:

1️⃣ Generate list of video id's from favorite YT channels
2️⃣ Load all transcripts
3️⃣ Split the transcript
4️⃣ Extract skills
5️⃣ Vectorize
6️⃣ Generate skillset
7️⃣ Find relevant videos.

Let's dive into the code ⬇️
Read 23 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(