We're excited to open-source Mistral 🚀 - a codebase for accessible large-scale LM training, built as part of Stanford's CRFM (crfm.stanford.edu).
We're releasing 10 GPT-2 Small & Medium models with different seeds & 600+ checkpoints per run!
github.com/stanford-crfm/… [1/4]
We're releasing 10 GPT-2 Small & Medium models with different seeds & 600+ checkpoints per run!
github.com/stanford-crfm/… [1/4]
At 10:20 PDT, @laurel_orr1 and I will be talking at the Workshop for #FoundationModels (crfm.stanford.edu/workshop.html) about Mistral, as well as our journey towards transparent and accessible training.
We hope to see you there - bring your questions! [2/4]
We hope to see you there - bring your questions! [2/4]
This was developed by a brilliant team - Jason Bolton, @Tianyi_Zh, @krandiash, @Avanika15, @RishiBommasani, @deepakn94, Tony Lee.
We're also grateful to @tatsu_hashimoto, @jurafsky, @chrmanning, @ChrisGPotts, @HazyResearch, @percyliang!
@StanfordHAI @StanfordAILab [3/4]
We're also grateful to @tatsu_hashimoto, @jurafsky, @chrmanning, @ChrisGPotts, @HazyResearch, @percyliang!
@StanfordHAI @StanfordAILab [3/4]
We're building this codebase for the community; we really want your engagement on how to "open up" training so that it's more accessible.
We're holding office hours twice a month to hear from all of you - we'd love to see you (github.com/stanford-crfm/…)! [4/4]
We're holding office hours twice a month to hear from all of you - we'd love to see you (github.com/stanford-crfm/…)! [4/4]
• • •
Missing some Tweet in this thread? You can try to
force a refresh
