Discover and read the best of Twitter Threads about #LatentDiffusionModel
Most recents (1)
🎉 #StableDiffusion can be fine-tuned to generate medical images, and the outputs can be controlled using natural language text prompts!
In our latest work, we use SD to create synthetic chest xrays and insert pathologies like pleural effusions.
🧵 #Radiology #AI #StanfordAIMI
In our latest work, we use SD to create synthetic chest xrays and insert pathologies like pleural effusions.
🧵 #Radiology #AI #StanfordAIMI
#stablediffusion is a #LatentDiffusionModel and performs its generative tasks efficiently on low-dimensional representations of high-dimensional training inputs. SD's VAE latent space preserves relevant information contained in CXR; they can be reconstructed with high fidelity.
#StableDiffusion’s output can be controlled at inference time by using text prompts, but it is unclear how much medical imaging concepts SD incorporates. Simple text prompts show how hard it can be to get realistic-looking medical images out-of-the-box without specific training.
