Today, we released PEFT v0.19.0 and it's a big one. Not only did we add 9 new PEFT methods, the release also contains a bunch of improvements to make PEFT more useful. Check the thread for details:
The release contains new functions to convert non-LoRA weights into LoRA weights. This allows them to be used in packages like Diffusers and vLLM that only support LoRA. Find more details here: huggingface.co/docs/peft/main…
Jun 27, 2023 • 5 tweets • 2 min read
With ZeroShotClassifier and FewShotClassifier from skorch, you can perform classification with LLMs.
Use any LLM from @huggingface 🤗 with a scikit-learn API – fit, predict, and predict_proba just work 🔥
The snippet below shows how to grid search the model and prompt:
🧵1/5
Because we build on Hugging Face transformers, you have the choice among thousands of models. It also means that your Large Language Model runs locally and skorch can perform some optimizations under the hood to speed things up.