0. I dont know the nearterm solution to online content being scraped & used in training AI, to the horror of many artists who fear for their livelihood, and to the excitement of those who find joy & liberation in this new medium.
1. ALL content uploaded online to be shared *publicly* is automatically recorded on a blockchain (& IPFS or similar). Yes like an N.F.T. But not for the purpose of selling or shilling. Instead, it's simply an immutable public proof-of-authorship.
2. This public proof-of-authorship is on an internet wide, distributed, public database (i.e. like a blockchain + IPFS - henceforth called "WWDB"), as opposed to multiple privately owned databases like ArtStation, DeviantArt, Instagram, Twitter, Facebook, Artbreeder, Tumblr etc.
3. All of those websites (ArtStation, DeviantArt, Instagram etc) can still have their own DBs, but they all either directly use, or cache, the content from the public WorldWideDB (similar to how current NFT websites work with various blockchains).
4. The creator/uploader can also set usage conditions, i.e. a license. Including allowing or not-allowing for training AI. I imagine @creativecommons licenses will be updated to provide more clarity on usage in training AI.
5. Any web scrapers, or any websites for that matter, can always trace back (through hash and/or visual search) the original image on the WWDB, and check the credits and license conditions.
6. The license could also dictate prices for being included in an AI dataset. Such that creators of AI models automatically pay the artists to use their works in TRAINING their models. Similar to stock image websites work today, but on a broader scale across entire internet/WWDB.
7. Alternatively (or as well as), royalties can be automatically paid during INFERENCE - by the service provider (e.g. Dalle, Midjourney), or the AI Image Creator, or shared between both. E.g. prompting "in the style of ABC", would send a tiny fee to the orig artist ABC.
8. Or, The AI Image Creator doesn't pay this usage fee to the original artist upon creation of a new AI image (bc they might want to try creating loads), but rather, on the monetization of the AI image - since that metadata will also exist in the WWDB regarding the new AI image.
9. Likewise prompting with an existing img as a style reference could send a royalty to the creator of the original image. Since all images are registered on this WWDB, the style image can be traced, the original creator of that image found, and credited accordingly.
10. This WWDB also solves the long standing 'inspiration / credit' issue, where there are millions of images floating on the web, on pinterest, on @archillect, on countless 'inspiration' platforms, of "found" images, where the source has been lost.
11. The key is that there is this internet wide, distributed, public database that records ALL content (provided the creator chooses this of course. If they choose not to participate, they won't get any of these benefits, but then they can't complain if their work is 'stolen' :).
12. Of course many blockchains already are "internet wide, distributed, public databases". But for the above to work, there has to be a "standard default" DB. Like TCP/IP, DNS, there has to be one standard WorldWideDB. (Or at least a standard protocol that bridges multiple DBs).
13. I'm sure there are many holes here that will be exploited by bad actors. This is just a start, and needs fleshing out. But if there is a public distributed proof-of-authorship in a WWDB, then at least we have the nessecary information, and then we can try to set policies.
14. I wish we wouldnt need something like this. I wish everyone could share everything freely, and we cld all draw inspiration from everywhere, and train AI on everything too. But we all know the profit-maximizing machine is a bulldozer that will plough thu everything it can.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
it's worth remembering that progress in generative (mostly image) AI has been insanely fast in last few yrs. And that's mostly in fundamental tech (GAN, CLIP, DDPM etc). Now that there is very promising proof-of-concept tech working, expect loads of funding & startups on tools.
you have a book that you want illustrated? it's going to be cheaper to use an automated service offered by some tech company to produce illustrations, than hire an illustrator. You have a film you want scored? It's going to be cheaper to use an automated service, than a musician.
there seems to be a rhetoric going around that "if you can be replaced by a machine, you're not rly an artist". Which is as sad as it is funny. Coincidentally, I RT this 👇 just few days ago. But clearly the term "artist" is causing some confusions...
The thousands of replies & QT to this thread is worth going through.
The job displacement that is abt to come in illustration, design, music, video editing, all creative sectors, is going to be very painful.
Current txt2img tech is already incredible, but is only the beginning.
My thoughts on automation of "creative" jobs haven't changed. But I didn't think it wld come so soon. Transformers rly were transformative!
All junior design roles are first to go. Only the most unique will survive. And ofc many new stars will be born.
While i believe that this tech does bring incredible opps - even "democratization" - to many around the world (think of the wonderful careers that have been made possible thx to "laptop music"), it will undoubtedly be abused by less benevolent actors - both corps & individuals.
Friends, something has been bugging me for a while. The world is burning. We have unsustainable habits that need to change. And changing old habits is hard, really hard. But has to be done. And yet, it seems we are also adapting *new* unsustainable habits ... 1/2
I find the rise of #cryptoart (& crypto-everything for that matter) mind-boggling. I've been looking for quantitative metrics re ecological cost - excluding production of works, & isolating minting, sales, transactions etc, but info seems sparse. I'm open to pters & thoughts 2/2
The fact that a single ETH transaction costs 25 kWh, and the fact that this is legal, seems to me a sign that we as a civilization just don't learn, or don't really care, and are doomed. digiconomist.net/ethereum-energ… /via @JakubValtar