New preprint:
"Compression ensembles quantify aesthetic complexity and the evolution of visual art" 🎨🖼️📈
by @AndresKarjus @schichmax @sebastianahnert @mcanet @tillmannohm
🔓arxiv.org/abs/2205.10271
1/🧵 Image
2/7 How does it work? Take an image, run it through a large n of visual filters (blur, gray, edges, etc), compress the variants, record file sizes. Yields a vector where each value expresses some aspect of visual aesthetics, resulting in an explainable vector space. Simple&fast! Image
3/7 But does it... work? Test against human vis complexity ratings: correlates very well &outperforms plain compression. Also designed downstream tasks such as author identification: also works quite well. Again, no #deeplearning or pretrained models here, just image compression! Image
4/7 So it's cognitively valid & captures visual family resemblance. Let's do quant #arthistory on 70k artworks from last 500y. The space is high dim, but we can boil it down to a few interesting components using e.g. PCA. Trends correspond to narratives in art history quite well. Image
5/7 How about something contemporary? We mined the first few months of #hicetnunc for #NFT art and investigate its dynamics over time. We also show these vis #aesthetics estimates describe about 8% of variance in a linear model predicting NFT #sales prices. Image
6/7 We also look into artistic career trajectories, by quantifying "temporal resemblance", how distant in time a given artist's works are to their nearest artist neighbors in vector space. The model provides interesting insights, disambiguating careers with distinct trajectories. ImageImage
7/7. Others have used img compression to probe visual complexity before (in veery dif fields!), but our approach goes a step beyond, constructing an efficient model that works better than compression-only & where each dimension remains explainable via the transforms (unlike #ML). Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Andres Karjus

Andres Karjus Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(