LoRA (Low-Rank Adaptation) is one of the most powerful techniques when it comes to Fine-Tuning LLMs.
Today I’ll explain:
• What is Lora❓
• How it works ❓
• Followed by a hands-on coding tutorial❗️
But before we do that, let's understand what finetuning means...👇
Fine-tuning is a well-established method in machine learning that leverages the general knowledge the model has learned during its initial training & adapts it to a particular use case.
Here’s a typical representation of traditional Fine-Tuning 👇