The size of #NLP models have increased enormously, growing to millions, or even billions, of parameters, along with a significant increase in the financial cost and carbon emissions. The cost associated with training large models limits the #AIresearch community's ability to innovate, because a research project often needs a lot of experimentation.