Pan Lu Profile picture
Jun 12 7 tweets 4 min read Twitter logo Read on Twitter
🎉Exciting news: LLaMA-Adapter is now fully unlocked! 🧵6

1⃣ As a general-purpose #multimodal foundation model, it integrates various inputs like images, audio, text, video, and 3D point clouds, while providing image, text-based, and detection outputs. It uniquely accepts the… twitter.com/i/web/status/1… Image
🧵1/6 Experience the magic of LLaMA-Adapter! Transforming real-world inputs like text, images, videos, audio, and 3D point clouds into engaging text. The reality you know, reimagined through AI.
🖼️📽️🔉🌐➕📝 ➡️➡️🦙➡️➡️ 📝 ImageImageImageImage
🧵2/6 LLaMA-Adapter goes beyond creating text! It's also capable of generating detection results, bringing a new dimension to understanding and interacting with the world.
🖼➕📝 ➡️➡️🦙➡️➡️ 📝➕🔍 Image
🧵3/6 Meet the wizardry of LLaMA-Adapter! From 3D point clouds or audio, it can conjure up a vivid and stunning visual world 🎨🌍. It's more than data processing - it's creating art from raw inputs.
🌐🔉➕📝 ➡️➡️🦙➡️➡️ 🖼️ ImageImage
🧵4/6 Emulating human interaction, LLaMA-Adapter listens to sounds 🎧, watches videos 📽️, and generates text 📝, thus fostering a deeper connection with the world 🌍. A leap forward in AI communication!
📝➕🔉➕📽️ ➡️➡️🦙➡️➡️ 📝 Image
🧵5/6 Even more astonishingly, given just a 3D point cloud and background audio, the LLaMA-Adapter can reconstruct a mirror image of the real world. A breakthrough in immersive experiences!
🌐➕🔉➕📝 ➡️➡️🦙➡️➡️ 🖼️ Image
🧵6/6 Empowered by @LangChainAI, LLaMA-Adapter not only communicates with humans but also unlocks limitless potential in AI interactions.

For a sneak peek into its capabilities, explore our Jupyter Notebook demo:
github.com/OpenGVLab/LLaM…
🖼️📽️🔉🌐📝 ➡️➡️🦜🦙➡️➡️ 🖼️📽️🔉🌐📝 Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Pan Lu

Pan Lu Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @lupantech

Mar 29
🔥Excited to release LLaMA-Adapter! With only 1.2M learnable parameters and 52K instruction data, LLaMA-Adapter turns a #LLaMA into an instruction-following model within ONE hour, delivering high-quality responses!

🚀Paper: arxiv.org/abs/2303.16199
🚀Code: github.com/ZrrSkywalker/L…
We adopt learnable adaption prompts and prepend them to the input text tokens at higher transformer layers. A zero-init attention mechanism with zero gating adaptively injects the new instructional cues into LLaMA, while effectively preserving its pre-trained knowledge.
With efficient training, LLaMA-Adapter generates high-quality responses, comparable to Alpaca with fully fine-tuned 7B parameters.
Read 5 tweets
Nov 2, 2022
🚨Struggling to select examples for GPT-3? Try our PromptPG, the first work that applies RL to select in-context examples for GPT-3! PromptPG achieves a gain of 5.31% on TabMWP, a new dataset of tabular math word problems! Check out data and codes:👇
promptpg.github.io 🧵1/7
Resources are all available now!
📄Paper: arxiv.org/abs/2209.14610
🔖Project page: promptpg.github.io
💻Code: github.com/lupantech/Prom…
🧐Explore: promptpg.github.io/explore.html
🪜Leaderboard: promptpg.github.io/leaderboard.ht…
🔗Data: github.com/lupantech/Prom… 🧵2/7
🚨We propose a new dataset for math word problems, TabMWP, containing 38,431 problems with tabular contexts.

Each problem is annotated with a natural language solution to reveal the multi-step reasoning process.
Curious about TabMWP?

Explore here:
promptpg.github.io/explore.html 🧵3/7 Image
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(