Kalyan KS Profile picture
NLP Consultant & Researcher. AIxFunda newsletter for the latest LLM, Agents and RAG updates.
Aug 13, 2021 9 tweets 7 min read
#1 AMMUS- A Survey of Transformer-based Pretrained Language Models #nlproc #nlp #bert #survey
Paper link: arxiv.org/abs/2108.05542 #2 presents a brief overview of various pretraining corpora #nlproc #nlp #survey