Alexandre Ramé Profile picture
PhD student at Sorbonne University in Paris. Information theory and data augmentations for deep-ensembles, mostly applied to computer vision.
Sep 9, 2021 4 tweets 2 min read
Surprised #deeplearning methods were not massively used to detect Covid? Some tried, but most failed: e.g. they rely on patients' age instead of 'truly' analyzing the medical scans. This is because networks learn correlation and not causation. Our preprint Fishr tackles this. 1/4 When dealing with multiple datasets, we intuited that the learning should unfold consistently across those: i.e., the gradient distributions should be independent of the dataset. After a few approximations, we simply bring closer the dataset-level gradient variances! 2/4