https://twitter.com/aidangomezzz/status/1651053357719535622First, I've seen that one of the most common responses is that anyone criticising the original post clearly doesn't understand it and is ignorant of how language models work.
https://twitter.com/fastdotai/status/1545128129198313472Where things got slow is if you imported `fastcore.xtras`, which is a module that wraps a bunch of python stdlib functionality into some convenient interfaces. It's used by `fastcore.net`, `fastcore.parallel`, and `fastcore.utils`, so it comes up a lot.
https://twitter.com/fastdotai/status/1538329524571557888Here's all you need to train imagewoof with xresnet50 and mixup augmentation, on multiple GPUs. Run with `accelerate launch distrib.py`