Swanson MA279 Fall2022 topic3 - Rhea

The Birth of Ai Art and Quick Rundown

How is Ai Art Generated?

• General steps:
  • Text is processed and turned into usable data by the model, and the semantic elements are analyzed as well.
  • Text goes through a “diffusion process”, which essentially adds noise to the text, making it so the art generator will make a different thing every time.
  • AI uses the new data to create the art. The art is usually made using GAN(Generative adversarial networks), which is a style of algorithm which is made up of two parts, one part which creates something, and another part which judges it. The GAN creates a feedback loop where the creator makes a piece of art, then the judge decides whether or not the thing matches the prompt, and if it doesn’t the creator tries again based on the feedback and the process repeats until the judge decides that it matches the prompt.
  • The model will then take the k best images, where k is a number provided to the model, and how good an image is is determined by the judge, and provides the images as output.
• Additional Information:
  • Usually this process takes about 5 minutes on an average computer, so there are websites that do all the backend processing for you, making it a lot faster.
  • Models typically have at least 2 parts, the creator and judge, but sometimes they can have more. For example, a model might have an image encoder to turn images into numbers, a part that turns text into images(creator), and a part that judges the images(judge).
  • The process of transferring the art style of one piece to another piece is called NST(neural style transfer).

Specific Ai Art Example

Implications of Ai Art