{"id":7104,"date":"2022-06-18T21:51:04","date_gmt":"2022-06-18T21:51:04","guid":{"rendered":"http:\/\/kk.org\/thetechnium\/?p=7104"},"modified":"2022-06-18T21:51:04","modified_gmt":"2022-06-18T21:51:04","slug":"training-ais-to-make-art","status":"publish","type":"post","link":"https:\/\/tkdev.kk.org\/thetechnium\/training-ais-to-make-art\/","title":{"rendered":"Training AIs to Make Art"},"content":{"rendered":"<p>There are parallels\u00a0between how a human and a robot make art.<\/p>\n<p>A professional artist today will have spent their life viewing hundreds of thousands of images. In addition to the ocean of photographic images that floods their\u00a0eyeballs\u00a0in publications, movies, advertisements, there are the thousands of images of\u00a0&#8220;art&#8221;\u00a0they&#8217;ve seen in museums, galleries, art books and online. Their brains are scooping up all these images \u2014 each composed and framed by a photographer, or designer, or painter \u2014 and are using them to influence and guide their own artistic work. Out of the hundreds of thousands of images they take in and process, some they like more than others. It is not uncommon for someone making art and images to begin by making stuff heavily influence by their favorites.\u00a0Qualities about their favorite images\u00a0are reflected in their own art. This process is often unconscious,\u00a0and may even be invisible to them. However, others may notice that their art reminds them of someone elses. Over time, a new artist&#8217;s work may evolve to a point where their art is distinctive on its own, but it is very rare for new art not to resemble anything before it.\u00a0 In this way, a new image is created from a pool of millions of previous images. The new image, which did not exist an hour before, is produced in relation to and influenced by all those millions of existing images, and some particular images will influence it more than others.<\/p>\n<p>Todays image generating AIs or Machine Learning systems do the same. They view and digest millions of previous made images and then generate new images based on those\u00a0existing\u00a0images. The exact process by which they create a new image is not &#8220;visible&#8221;; it&#8217;s messy and hard to track since there are millions of possibilities enroute to the final image. But like a human artist, we can give the system some biases. We can ask the AI to create a picture of a steam locomotive &#8220;in the style of Picasso.&#8221;\u00a0 And it will generate an image of a steam locomotive in the style of Picasso. It can do this because it has been trained to detect the kind of image patterns that paintings by Picasso show. Certain curves of the line; certain colors he commonly used, his usual textures, brush stroke width, geometry. And it is trained to recognize the patterns that all steam locomotives show: cylindrical body, solid wheels, cab, piping, etc. Of course it has also detected patterns for all the millions of other objects, scenes, and styles of all the images in the world. It conceptually maps all these patterns into an abstract location-space. The AI then &#8220;finds&#8221;\u00a0an image that should exist\u00a0in the space of Picasso\u00a0and locomotive, and them it perceives it, which means it sees it by rendering it. It imagines it, in the way a human artist would imagine a scene.<\/p>\n<p>In both cases of human generated art and machine generated art, the process relies on the generator ingesting\u00a0thousands and thousands\u00a0of previous images to assist in the creation of a brand new image.<\/p>\n<p>In the traditional world of human art, if a person&#8217;s new art resided too close to the work of an existing artist, society would discount it. We&#8217;d say they were imitators. If the artist was trying to pass off the work as made by the famous artist, we&#8217;d call it fraud. But artists\u00a0with well-rewarded careers make art that\u00a0may be visibly &#8220;influenced&#8221; by another artist, or they\u00a0may be in\u00a0a specific &#8220;school&#8221; of style, influenced by a group of artist with related patterns. Being visibly influenced by another artist\u00a0is considered acceptable, even if it was never acknowledged.<\/p>\n<p>Today with AI art generators, it is trivially easy and amazingly precise to create an image in the style of X, or to be influenced by X. The exactitude of this influence is a marvel. The steam locomotive painted by Picasso absolutely looks like his work, and it can be created in seconds. We could call these fakes, since they are not created by a famous artist, but can surely look like they were. But why stop there. We can ask an AI to paint the locomotive in the style of Picasso and Andrew Wyeth, and get something strange, unique, and gloriously novel.\u00a0 We could ask the AI to make a picture of a bull in the style of Picasso but\u00a0render it\u00a0photo-realistic; and it will.<\/p>\n<p>But we now come to a novel question. The AI art generator is indiscriminate in is input; it has been fed all art and images possible.\u00a0It has in effect studied all the art images that have ever been posted online, including all the artwork of living artists.\u00a0 There are a few living artists who work are commonly used as an influence in AI generative art. Painters who work in a very realistic style are often invoked. It becomes trivially easy to create a fake image in their style, and sometimes the request is to render it on a subject that would make no sense for the original artist. The artist has no control over what happens with their style. The question is: should the original influencer artist have any say in what happens to\u00a0their influence? Should they get any value if the image has any value? Should they be able to remove their art from the training set? Can they withdraw from this new world, or get paid if they remain with great influence?<\/p>\n<p>It is clear that, in general, artists fear obscurity more than piracy. They prefer to be known and imitated rather than not known. I am aware of no artists who\u00a0have hidden their work from human students for fear that they were being imitated. They may go after an imitator with legal means, but they have not tried to hide their work.\u00a0 But in the realm of machines,\u00a0removing your work may be the only way to avoid\u00a0becoming a generative art prompt. There are legal, practical, and social hurdles that will make disappearing from the commons difficult. (One way that will be tried is to leave the images but remove the artist&#8217;s name; basically unlabel the image so the name cannot be used as a prompt.)<\/p>\n<p>There will be many reasons why participating in this commons would be beneficial, in a similar way that copyrighted material lives in a world of free copies. One idea is that every generative image should\u00a0carry with embedded in it the prompt that created it. If the prompt\u00a0contained another artist&#8217;s name, there might be some way to carry forward the credit, or even to compensate the artist. One could imagine a blockchain method to track the prompts.\u00a0 Artist may want to be included to have the AI assist them in creation. Depending on what they do, it might fill in details in their style, or even create works which they can claim for themselves. It might become a way for them to &#8220;extend their brand&#8221; as they say. There could be some artists who, instead of teaching, work with the AIs to refine and evolve their ability to be prompted. That is they could develop a style that is created\u00a0primarily to act as a prompt for millions of other non-artists.<\/p>\n<p>Training AIs to create art already shares some similarities to\u00a0training humans to create art. This will complicate how we treat generative art machines and the new powers they bring.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>There are parallels\u00a0between how a human and a robot make art. A professional artist today will have spent their life viewing hundreds of thousands of images. In addition to the ocean of photographic images that floods their\u00a0eyeballs\u00a0in publications, movies, advertisements, &hellip; <a href=\"https:\/\/tkdev.kk.org\/thetechnium\/training-ais-to-make-art\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[],"tags":[],"_links":{"self":[{"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/posts\/7104"}],"collection":[{"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/comments?post=7104"}],"version-history":[{"count":12,"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/posts\/7104\/revisions"}],"predecessor-version":[{"id":7116,"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/posts\/7104\/revisions\/7116"}],"wp:attachment":[{"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/media?parent=7104"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/categories?post=7104"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tkdev.kk.org\/thetechnium\/wp-json\/wp\/v2\/tags?post=7104"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}