dvschultz / intro-to-ml-art

July 2020 Artificial Images Class

Intro to ML Art with RunwayML

Week 1: ML Basics,Setup & Inspiration

Class documents:

• Week 1 Slides
• Week 1 Video

Links/Good things to check out:

• Putin Horse2Zebra (Pretty creepy looking FYI!)
• Runway also has an official Slack. This can be helpful for debugging technical issues or to see what others are making.

Homework:

• Please complete the poll for us to find a time for a co-working Q&A session.
• Play with the models in Runway
  • Find a model to explore
  • In the class Slack tell us the following:
    • What model you used
    • What the inputs and outputs were: text, image, etc.
    • What questions you have about the model
    • Show us what you made!
• Think about a bigger project you want to make
  • Look at the Runway Slack and social projects for inspiration (Runway YouTube)
  • Look at some of the models and consider what inputs you have available to you and what you want as outputs

Week 2: Inspiration, Special Input Types, Batch Exports

Class documents:

• Week 2 Slides
• Week 2 Video

Links/Good things to check out:

• A list of ML Art Colab notebooks
• A YouTube playlist of Colab demos
• Derrick's Neural-style-tf Colab Notebook
• Esteban Salgado’s StyleGAN work
• Nye Warburton’s YouTube page
• Pix2Pix training and testing videos on YouTube
• Lia’s upcoming webinar!
• In depth neural-style-tf discussion
• Downloading a StyleGAN model from Runway

Homework:

• Keep exploring models
  • We’ve covered a handful of models so far in class, but there are many more! Keep digging around. We’ve created a playlist of model videos to watch if you’re interested.
• Sign up for 1:1 sessions with Derrick or Lia
• If you’re interested in training... We won’t cover training in this 3-week course, but we do have videos from other classes that you can watch. Ask us questions!
  • Building Datasets
  • Training StyleGAN2 models in RunwayML

Week 3: Chaining, Plugins/Networks

Class documents:

• Week 3 Slides
• Week 3 Video
• Week 3 Class notes taken by Lia

Links/Good things to check out:

• Building Datasets
• Training StyleGAN2 models in RunwayML
• Splitting a video into frames
• Jason Levine, a musician that uses AI in his work
• Jukebox, by OpenAI
• Google Magenta, and AI lab devoted to music generation ML
• Holly Herndon and Mat Dryhurst’s Interdependence, a podcast that often discusses music and ML
• Downloading a StyleGAN model from Runway

Homework:

• Fill out the class survey!
• Sign up for 1:1 sessions with Derrick or Lia