— Elizabeth Swensen from UCSC’s AGPM department is giving a talk at the CM Seminar on Monday, January 6th in E2-192 at 12noon.

Slides:

— Introduction to the course
— Discussion on research & Project 1 overview

Readings:

— You and Your Research, Richard Hamming
— Catching Crumbs from the Table, Ted Chiang
— Psychopolitics, Byung-Chul Han, chapters 1, 2, 9, 10
— Creativity Support Tools, Ben Shneiderman
— Sustaining Social Creativity, Gerhard Fischer and Elisa Giaccardi (pg 28)
— New Media Arts and the Future of Technologies, Linda Candy (pg 30)
— Toward a Critical Technical Practice: Lessons Learned in Trying to Reform AI, Philip Agre

Project Code & Readings:

— The Wavefunction Collapse Algorithm Explained Very Clearly, Robert Heaton
— WaveFunctionCollapse is Constraint Solving in the Wild, Isaac Karth and Adam M. Smith
— Addressing the Fundamental Tension of PCGML with Discriminative Learning, Isaac Karth and Adam M. Smith
— Infinite Procedurally Generated City with the Wave Function Collapse Algorithm, Marian Kleineberg
— Generating Paths with WFC, Hugo Scurti and Clark Verbrugge
— Generating Worlds With Wave Function Collapse, Joseph Parker
— WaveFunctionCollapse, Maxim Gumin
— Even Simpler Tiled Model, Robert Heaton
— Infinite City WFC, Marian Kleineberg
— Notable ports, forks and spinoffs

Assignments:

— Responses, due 1/13 at 9pm
— Project 1, due 1/23 before class

— Jesse Harder of Electronic Arts is giving a talk at the CM Seminar on Monday, January 13th in E2-192 at 12noon.
— CM Ph.D. student Isaac Karth is visiting class on Tuesday to discuss the Wave Function Collapse algorithm.

Slides:

— Wave Function Collapse
— Sense, Interpretation, Inference

Readings & Links:

— Eulerian Video Magnification for Revealing Subtle Changes in the World, Hao-Yu Wu, Michael Rubinstein, Eugene Shih, John Guttag, Frédo Durand, and William T. Freeman
— The Visual Microphone: Passive Recovery of Sound from Video, Abe Davis, Michael Rubinstein, Neal Wadhwa, Gautham Mysore, Fredo Durand, and William T. Freeman
— Micromigrations, Dennis Hylynsky
— Psychopolitics, Byung-Chul Han, chapter 11
— Permanent Record, Edward Snowden, chapters 17–21, 23–25
— Lawfare’s collection of Snowden Revelations

Assignments:

— Responses, due 1/20 at 9pm

— Infinite Photogrammetry, Aviv Elor
— Find Henry, Chun-Liang Yang and Kehua Lei
— Ultima 5EVER, Lee Taber, Kevin Weatherwax, and Sean Fernandes
— Super Mario Bros. WFC, Jared Pettitt
— Constellations, Tessa Eagle, John Diez, and Montana Fowler
— MIDI WFC, Henry Zhou, Dustin Palea, and Wilson Mui
— Atlantis, Jeffrey Weekley and Kapil Gupta
— Monster Compiler, Anna Sofia Frattini and Alejandro Calderon
— Timbral Generator, Tamara Duplantis, Alexander Mayben, and Celeste Jewett

Readings & Videos:

— Rats and Slaves: Buying Hacked Computers, Anthony van der Meer
— Meet Brittany Kaiser, Cambridge Analytica Whistleblower Releasing Troves of New Files from Data Firm, Democracy Now!
— Twelve Million Phones, One Dataset, Zero Privacy, Stuart A. Thompson and Charlie Warzel
— Anatomy of a Killing, BBC News / Africa Eye
— Why the World Needs WikiLeaks, Julian Assange talks to TED’s Chris Anderson
— How the Police Use Facial Recognition, and Where It Falls Short, Jennifer Valentino-DeVries
— Colleges are Turning Students’ Phones into Surveillance Machines, Drew Harwell
— Sentences on Conceptual Art, Sol LeWitt
— Liquid Architectures in Cyberspace, Marcos Novak
— From Wetware to Tilt Brush, Cécile B. Evans, Jenna Sutela, Jonathan Yeo, Tiffany Funk, Luba Elliott, and Anna Ridler
— Aesthetics of Neural Network Art, Aaron Hertzmann
— Generative Art Theory, Philip Galanter
— Ten Questions Concerning Generative Art, Jon McCormack, Oliver Bown, Alan Dorin, Jonathan McCabe, Gordon Monro, and Mitchell Whitelaw
— What is Generative Art?, Margaret A. Boden and Ernest A. Edmonds
— A Generative Framework of Generativity, Kate Compton and Michael Mateas

Assignments:

— Responses, due 1/27 at 9pm

— Dan Russel of Google is giving a talk at the CM Seminar on Monday, January 27th in E2-192 at 12noon.
— CM Ph.D. student Manu Mathew Thomas is visiting class on Thursday to introduce TensorFlow.

Slides:

— Deep Learning Projects
— Introduction to Machine Learning and TensorFlow, part 1

Links:

— TensorFlow Tutorials
— TensorFlow.js is a Library for Machine Learning in JavaScript
— PyTorch, An Open Source Machine Learning Framework
— RunwayML, Machine Learning for Creators + video tutorials
— ml5.js, Friendly Machine Learning for the Web
— Beginner’s Guide to Machine Learning in JavaScript, Daniel Shiffman
— The Unreasonable Effectiveness of Recurrent Neural Networks, Andrej Karpathy
— Better Language Models and Their Implications, Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever
— AI Dungeon 2: Creating Infinitely Generated Text Adventures with Deep Learning Language Models, Nick Walton
— Talk to Transformer (online GPT-2 example), Adam King
— Understanding Searches Better Than Ever Before, Pandu Nayak
— TensorFlow for Poets 2
— An Interactive Node-Link Visualization of Convolutional Neural Networks, Adam Harley
— What Neural Networks See, Gene Kogan
— 3Blue1Brown’s Intro to Neural Network Series (4 episodes), Grant Sanderson
— CV-Trick’s Image Classifier Tutorial
— TensorFlow 2 Tutorial: Get Started in Deep Learning With tf.keras, Jason Brownlee
— Hvass Laboratories’ CNN Video Tutorial
— A Beginner’s Guide To Understanding Convolutional Neural Networks, Adit Deshpande
— Stanford’s CS231n: Convolutional Neural Networks for Visual Recognition
— MIT’s 6.S191: Introduction to Deep Learning

Assignments:

— No responses are due for Tuesday’s class, but please attend the CM Seminar and explore the links to deep learning projects and tutorials above.
— Project 2, due 2/13 before class

— Diane Pawar, founder of the ImmersED Virtual & Augmented Reality K-12 Education Summit, is giving a talk at the CM Seminar on Monday, February 3rd in E2-192 at 12noon.
— CM M.S. student Sarah Frost is visiting class on Thursday to introduce two of her recent machine learning projects.

Slides:

— Introduction to Machine Learning and TensorFlow, part 2
— Generative Adversarial Networks
— Creative AI

Links:

— Generative Adversarial Nets, Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio
— GAN Breeder, Joel Simon
— How Three French Students Used Borrowed Code to Put the First AI Portrait In Christie’s, James Vincent
— Robbie Barrat and Ronan Barrot’s Infinite Skulls, Jason Bailey
— All About the GAN, Jonathan Jeon
— GAN Timeline, Zheng Liu
— GANimal PetSwap demo, Ming-Yu Liu, Xun Huang, Arun Mallya, Tero Karras, Timo Aila, Jaakko Lehtinen, and Jan Kautz
— GauGAN, Taesung Park, Ming-Yu Liu, Ting-Chun Wang, and Jun-Yan Zhu
— Learning to See, Memo Akten
— Generating Handwritten Digits with DCGAN, TensorFlow
— Image Completion with Deep Learning in TensorFlow, Brandon Amos
— Interactive Image Translation with pix2pix-tensorflow, Christopher Hesse
— Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, Christian Ledig, Lucas Theis, Ferenc Huszar, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, and Wenzhe Shi
— A Style-Based Generator Architecture for Generative Adversarial Networks (with TensorFlow code), Tero Karras, Samuli Laine, and Timo Aila
— Imaginary Worlds Dreamed by BigGAN, Janelle Shane
— Generating Videos with Scene Dynamics, Carl Vondrick, Hamed Pirsiavash, and Antonio Torralba
— Image-to-Image Translation with Conditional Adversarial Networks, Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros
— Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks, Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A. Efros
— Deep Illumination, Manu Thomas and Angus Forbes
— Everybody Dance Now, Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A. Efros
— SC-FEGAN : Face Editing Generative Adversarial Network with User’s Sketch and Color, Youngjoo Jo and Jongyoul Park

— #COLA4All

— Project Butterfly, Aviv Elor
— Emotion Project, Tessa Eagle, John Diez, and Montana Fowler
— Make Good Food, Chun-Liang Yang and Kehua Lei
— Cyclons’ Personalities, Lee Taber, Kevin Weatherwax, and Sean Fernandes
— Sim Life (Movie), Wilson Mui
— Training Neural Network for Creative Tasks, Jeffrey Weekley and Alexander Mayben
— Lyrics and Music, Anna Sofia Frattini and Alejandro Calderón
— Is It Frasier?, Jared Pettitt and Celeste Clark Jewett

Events:

— CM Postdoc Dr. Oskar Elek is visiting class on Thursday to discuss his current research in simulation and graphics.

Assignments:

— Project 3, discussions and presentations due in class Weeks 9 and 10, write-up due 3/20.

— Meet throughout week in small groups to discuss final project

— COVID-19

— Style Transfer via Object Detection & write-up, Chun-Liang Yang and Kehua Lei
— Truman, Or How I Learned to Stop Worrying and Love Simulated Social Media & write-up, Lee Taber, Kevin Weatherwax, Alex Mayben, and Sean Fernandes
— Project Butterfly, Aviv Elor
— Tweet Like Gamer Girls & write-up, Tessa Eagle, John Diez, and Wilson Mui
— LayoutLand: An Intelligent, Computer-aided Layout Decision Support System for iPhones & write-up, Montana Fowler and Jeffrey Weekley
— Transformer Bard: Music and Poem Generation Using Transformer Models & write-up, Dustin Palea, Hongwei (Henry) Zhou, and Kapil Gupta
— Piano Teacher, Jared Pettitt, Celeste C. Jewett, and Tamara Duplantis