PhD Candidate @CS_UCLA | Intern @MSFTResearch
Prev @Tsinghua_Uni @allen_ai @Adobe @Microsoft
#NLPoc: Reasoning, MathAI, ScienceAI, Education, Multi-modalities
🧵1/6 Experience the magic of LLaMA-Adapter! Transforming real-world inputs like text, images, videos, audio, and 3D point clouds into engaging text. The reality you know, reimagined through AI.
We adopt learnable adaption prompts and prepend them to the input text tokens at higher transformer layers. A zero-init attention mechanism with zero gating adaptively injects the new instructional cues into LLaMA, while effectively preserving its pre-trained knowledge. 
