Diffusion models like Midjourney have been marketed primarily as a cheap way to produce images. And that's a problem, because in many cases they are more a means of re-production that exploits and devalues human labor. But what if we use them as tools to study images? 1/9
What's most troubling about these models from a creative viewpoint seems to be their most interesting aspect from a scholarly perspective: they are extremely good at identifying, synthesizing, and reinforcing visual patterns and stereotypes. They're basically cliché detectors 2/9
This, I'd argue, makes them potentially very powerful tools for art history. Since the early 1900s, the days of Warburg, Wölfflin, and Riegl, art history has been interested not only in the grand narrative of masterpieces, but also in the anonymous patterns of visual culture 3/9
Understood as the history of seeing, art history has always attempted to synthesize the common features among very different images of a given period. The notion of »style«, in this sense, meant a pattern of looking at the world through images, a form of visual world-making 4/9
With diffusion models, such patterns can now be synthesized in the form of images. And what becomes visible in this way is more than just a visual »style,« but rather a certain »vibe,« an atmospheric quality shared by images that seem to inhabit the same aesthetic »world« 5/9
At the same time, these images make visible the persistent biases and stereotypes that pervade the history of visual culture, and the limits of the imagination that govern our visual world-making, then and now (just look at the gender roles in most of these images) 6/9
It may seem far-fetched and speculative, but diffusion models could, among other things, open a path to a history of vibes and biases as captured in masses of images. However, there are methodological problems – not the least of which is the ahistoricity of these models 7/9
As impressive as they are at synthesizing and visualizing certain historical vibes, they have no model for historical consistency. If you ask Midjourney for a picture of the Pope from around 1980, it will capture the historical atmosphere, but show you todays's Pope 8/9
Thus, from a scholarly perspective, these models are, at least for the moment, more toys than tools. But, if you ask me, they open up conceptual questions that will be relevant to future research in the history of images, in and beyond art history 9/9
• • •
Missing some Tweet in this thread? You can try to
force a refresh
If the default #PlatformRealism of AI image synthesis tools can essentially be described as a second-order aesthetic of generic images, it's particularly revealing what #Midjourney does when asked to generate the image of something specific, say a famous building. A thread … 1/6
You' probably recognized the building depicted above as New York's Guggenheim Museum. However, it's far from an accurate representation of Frank Lloyd Wright's famous design. It’s faithful only in the most recognizable features, while all details are treated quite generously 2/6
This seems true to most images in this thread: What they depict is less a specific building than its reproducible cliché. However, this transformation took place long before AI: The more images of a famous landmark circulate, the more it has already become a generic icon 3/6
With each update, tools like #Midjourney promise us more and more »realistic« representations – but the »reality« these images represent has little to do with the one we live in. Rather, they are best described as #PlatformRealism: a second-order aesthetic of generic images 1/9
In an age of networked online content, generic images are ubiquitous. No online text, no web page, and hardly any social media post seems complete without at least one accompanying image, even if it provides no additional information (of course, this thread also has images) 2/9
Such images are not mere illustrations, but attractors supposed to make content more visible, shareable & likable. Mostly redundant text-image combinations are the default format of online visuality; content management systems even expect you to provide images for each entry 3/9
Recently, #Midjourney introduced a new parameter called »weird«, which aims to make results more »unexpected«. This is notable for a several reasons, not least because it highlights what the company considers »expected« and thus »normal«: images like this one, for example 1/6
According to MJ, the image above, depicting an all-white 1950s nuclear »family enjoying a picnic,« represents the degree zero of »weirdness«. Pump up the algorithmically generated »weirdness« to 50, and the nostalgic vibe goes down a notch, but whiteness remains the default 2/6
Next Step: »Weirdness« at 100 – some funny things going on here, but we're still in a white middle-class dream world, just a little bit quirkier. Increased »weirdness« doesn't seem to affect MJ's ideological baseline so much as it allows for less conventional compositions 3/6
So far, I've largely stayed out of the debates about whether or not AI can produce art - for me, that's just not the most interesting question about AI image generation. But as the discussion has progressed, I've developed some thoughts that I'd like to share in this thread
1/14
There’s a simple answer to that question: AI cannot produce art, but of course it can be used to produce art – like (almost) anything else. Since Duchamp, Kaprow, and Sturtevant, anything can become art: a ready-made object, a social event, even a copy of someone else's work
2/14
Art in this sense is not about producing pretty pictures, it's a self-reflexive cultural practice and as such presupposes an intellectual understanding of art that machines simply don't have (and may never have). AI thus in no way challenges such a conceptual notion of art
3/14
The recent wave of pope-related AI images, and the accompanying hot takes about whether or not we've now finally left an era of »visual truth« made me think about the relationship between two modes of online image interpretation: #WildForensis and #InstantMemeification 1/9
Popular versions of image forensics have been a staple of social media for some time: People just love to speculate about whether or not a widely shared image has been manipulated, and to look for hidden clues of tampering. That’s what I call #WildForensis
2/9
AI images in their current form are a perfect object of such #WildForensis: Clues that an image was generated are now often so subtle that they're only visible at second glance. But you still don't need any technical skills to find them, they are usually hidden in plain sight
3/9
Giovanni Battista Piranesi, aus dem Zyklus: »Proposta del Ministero della Ricerca tedesco per riformare la legge sui contratti di lavoro a tempo determinato in ambito accademico«, 1753
Aus demselben Zyklus, ebenfalls 1753
Und hier noch ein weiteres Blatt, rückwärtig bezeichnet als »Assemblea delle parti interessate presso il ministero«