Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Pan Lu Profile picture
@lupantech
Jun 12, 2023 • 7 tweets • 4 min read • Read on X
Scrolly
🎉Exciting news: LLaMA-Adapter is now fully unlocked! 🧵6

1⃣ As a general-purpose #multimodal foundation model, it integrates various inputs like images, audio, text, video, and 3D point clouds, while providing image, text-based, and detection outputs. It uniquely accepts the… twitter.com/i/web/status/1… Image
🧵1/6 Experience the magic of LLaMA-Adapter! Transforming real-world inputs like text, images, videos, audio, and 3D point clouds into engaging text. The reality you know, reimagined through AI.
🖼️📽️🔉🌐➕📝 ➡️➡️🦙➡️➡️ 📝 ImageImageImageImage
🧵2/6 LLaMA-Adapter goes beyond creating text! It's also capable of generating detection results, bringing a new dimension to understanding and interacting with the world.
🖼➕📝 ➡️➡️🦙➡️➡️ 📝➕🔍 Image
🧵3/6 Meet the wizardry of LLaMA-Adapter! From 3D point clouds or audio, it can conjure up a vivid and stunning visual world 🎨🌍. It's more than data processing - it's creating art from raw inputs.
🌐🔉➕📝 ➡️➡️🦙➡️➡️ 🖼️ ImageImage
🧵4/6 Emulating human interaction, LLaMA-Adapter listens to sounds 🎧, watches videos 📽️, and generates text 📝, thus fostering a deeper connection with the world 🌍. A leap forward in AI communication!
📝➕🔉➕📽️ ➡️➡️🦙➡️➡️ 📝 Image
🧵5/6 Even more astonishingly, given just a 3D point cloud and background audio, the LLaMA-Adapter can reconstruct a mirror image of the real world. A breakthrough in immersive experiences!
🌐➕🔉➕📝 ➡️➡️🦙➡️➡️ 🖼️ Image
🧵6/6 Empowered by @LangChainAI, LLaMA-Adapter not only communicates with humans but also unlocks limitless potential in AI interactions.

For a sneak peek into its capabilities, explore our Jupyter Notebook demo:
github.com/OpenGVLab/LLaM…
🖼️📽️🔉🌐📝 ➡️➡️🦜🦙➡️➡️ 🖼️📽️🔉🌐📝 Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
　

Keep Current with Pan Lu

Pan Lu Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @lupantech

Pan Lu Profile picture
Jul 8
#TextGrad now features multimodal reasoning!

🔬 ScienceQA (multimodal scientific reasoning)
- Error rate drops by 20%, achieving the highest zero-shot performance we know of.

📊 MathVista (multimodal math reasoning)
- Boosting the score from 63.8% to 66.1% on GPT-4o!

Explore more:
💻 Code:
📄 Doc:
🌐 Project: 🧵github.com/zou-group/text…
github.com/zou-group/text…
textgrad.comImage
🧵1/n Here's an example from ScienceQA: . TextGrad reviews the multimodal question and provides evaluations to “propagate” the initially incorrect answer to the correct one. scienceqa.github.io
Image
🧵2/n TextGrad refines misinterpretations in the final conclusion for this biology question through automatic “differentiation” via text. Image
Read 8 tweets
Pan Lu Profile picture
Mar 29, 2023
🔥Excited to release LLaMA-Adapter! With only 1.2M learnable parameters and 52K instruction data, LLaMA-Adapter turns a #LLaMA into an instruction-following model within ONE hour, delivering high-quality responses!

🚀Paper: arxiv.org/abs/2303.16199
🚀Code: github.com/ZrrSkywalker/L…
We adopt learnable adaption prompts and prepend them to the input text tokens at higher transformer layers. A zero-init attention mechanism with zero gating adaptively injects the new instructional cues into LLaMA, while effectively preserving its pre-trained knowledge.
With efficient training, LLaMA-Adapter generates high-quality responses, comparable to Alpaca with fully fine-tuned 7B parameters.
Read 5 tweets
Pan Lu Profile picture
Nov 2, 2022
🚨Struggling to select examples for GPT-3? Try our PromptPG, the first work that applies RL to select in-context examples for GPT-3! PromptPG achieves a gain of 5.31% on TabMWP, a new dataset of tabular math word problems! Check out data and codes:👇
promptpg.github.io 🧵1/7
Resources are all available now!
📄Paper: arxiv.org/abs/2209.14610
🔖Project page: promptpg.github.io
💻Code: github.com/lupantech/Prom…
🧐Explore: promptpg.github.io/explore.html
🪜Leaderboard: promptpg.github.io/leaderboard.ht…
🔗Data: github.com/lupantech/Prom… 🧵2/7
🚨We propose a new dataset for math word problems, TabMWP, containing 38,431 problems with tabular contexts.

Each problem is annotated with a natural language solution to reveal the multi-step reasoning process.
Curious about TabMWP?

Explore here:
promptpg.github.io/explore.html 🧵3/7 Image
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

Send Email!

:(