art_and_ai_--_how_machines_think_and_see_ii [Felix Stalder, Prof. DfA]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
===== Course preview =====

Artificial intelligence (AI) is all around us, transforming the way we see the world and the world sees us. Sometimes, we barely notice, sometimes, the results of AI can be very impressive, though sometimes so impressively bad, that Hito Steyrl and others started to talk about “Artificial Stupidity”. But almost always, the actual procedures of AI remain mysterious, locked away in a black box.

In this module, we will look at a recent wave of artistic and theoretical work that tries to open this black box, creating a language and an aesthetics for critical engagement. In particular, we will look at image recognition AI, what the artist Trevor Paglen calls “predatory vision” and the data scientist Joy Buolamwini calls the “coded gaze”, referring to gender and racial biases in these systems.

We will also use some web-based image recognition systems to get a first-hand impression of the capacities of these technologies as tools for artistic investigation.

===== Course logistics =====

**Date:** Week 17, April 20-24, 2020

**Time:** 10:00 - 17:00

The course takes place online:

Connect through the Zoom app, ID: 7890997001

or through a web browser

[[https://zhdk.zoom.us/j/7890997001]]

The password is sent to you by email.

Course requirements:

  * active participation in group activity
  * active individual work (via pad)
  * fictional short story, 2-3 pages, to be handed until Sunday, April 26. ([[https://paul.zhdk.ch/course/view.php?id=975|Upload to Paul]])

===== Course Materials =====

**Pad:** [[http://pad.vmk.zhdk.ch/p/art_ai_imagerecognition]]

===== Monday Morning =====

**Similarity & Difference**

  * !Mediengruppe Bitnik [[https://wwwwwwwwwwwwwwwwwwwwww.bitnik.org/samesame/|SAME SAME. WATCHING ALGORITHMS - CABARET VOLTAIRE EDITION]] 2015
  * Mario Klingemann & Simon Doury [[https://experiments.withgoogle.com/x-degrees-of-separation|X Degrees of Separation]], 2018

**How Image Recognition works, technically**

  * [[https://www.youtube.com/watch?v=2-Ol7ZB0MmU|A friendly introduction to Convolutional Neural Networks and Image Recognition]], 2017, 32 Min.
  * [[https://openai.com/blog/introducing-activation-atlases|Activation Atlas]], 2019
  * [[https://www.youtube.com/watch?v=76jZkqlGIMY| Understanding image models and predictions using an Activation Atlas]], Google AI Adventures, 2019, 7:49

**Joy Buolamwini** The coded gaze

  * [[https://www.youtube.com/watch?v=QxuyfWoVV98|AI, Ain't I A Woman?]], 2018, 3:33
  * [[https://www.notflawless.ai]], see stories there,
  * [[http://gendershades.org/overview.html]]
  * [[https://www.ted.com/talks/joy_buolamwini_how_i_m_fighting_bias_in_algorithms?language=en#t-111018| How I am fighting Bias in Algorithms.]] TEDx Talk, 2017
  * [[https://www.safefacepledge.org|Safe Face Pledge]]
  * [[https://www.ajlunited.org| Algorithmic Justice League]]

Another form of Bias:

  * !Mediengruppe Bitnik! [[https://wwwwwwwwwwwwwwwwwwwwww.bitnik.org/sor/|Dada. State of the Reference]], 2017

Further Reading:

  * Eubanks, Virginia. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. First Edition. New York, NY: St. Martin’s Press, 2017.
  * Noble, Safiya Umoja. Algorithms of Oppression: How Search Engines Reinforce Racism. New York: New York University Press, 2018

===== Monday Afternoon =====

  * Graham, Mark, Rob Kitchin, Shannon Mattern, and Joe Shaw. How to Run a City like Amazon, and Other Fables, 2019. [[https://issuu.com/meatspacepress/docs/how_to_run_a_city_like_amazon_and_other_fables|issu.com]], [[https://meatspacepress.com/go/how-to-run-a-city-like-amazon|PDF]]
  * Select one story, read it. Write short summary in the pad and how the story relates to the actual company, add your name to the entry

  * short research on image recognition. Select one news story that you fund interesting. Enter the link to the pad and write why you selected this story. Add your name to the entry

===== Tuesday Morning =====

**Adam Harvey** [[https://ahprojects.com|Art projects about privacy, computer vision, and surveillance]]

  *  Rejecting the automated gaze: [[https://ahprojects.com/camoflash|Camoflash]], 2008-10 [[https://ahprojects.com/cvdazzle/|CV Dazzle]], 2010-2014, [[https://ahprojects.com/stealth-wear/|Stealth Wear]], 2012-13, [[https://ahprojects.com/hyperface/|Hyper Face]], 2017-18
  * Exploring data sets: [[https://ahprojects.com/megapixels-glassroom|MegaPixels: Faces]] [[https://elevate.at/en/details/news/machine-learning-city|Machine Learning City]] Interview with Adam Harvey, 2018
  * Research: The unstoppable [[https://megapixels.cc/msceleb/|Microsoft Celeb (MS-Celeb-1M) Data Set]]
  * [[https://www.youtube.com/watch?v=bfhcco9gS30|From 1 to 100 pixels]], Adam Harvey, TEDxVilnius, 2017, 18:29

  * Tero Karras, Samuli Laine, Timo Aila. [[https://thispersondoesnotexist.com|This Persons doesn't exist]]

More anti-image recognition / urban camouflage fashion projects

  * [[https://adversarialfashion.com|Adversarial fashion]]
  * [[https://www.cc-app.net/unlabeled|A++ Fashion x Computatinal Creativity]]
  * [[https://urbanarmor.org/|Urban Armor]]
  * [[https://yr.media/tech/guide-to-anti-surveillance-fashion/|GUIDE TO ANTI-SURVEILLANCE FASHION]]
  * [[https://www.youtube.com/watch?v=_PoudPCevN0|Wearable Face Projector]]
  * [[http://www.urmesurveillance.com/|URME Surveillance]]
  * [[https://www.vice.com/en_us/article/nz4mbb/anti-surveillance-coat-netherlands|Anti-Surveillance Coat]], 2016

**ClearView AI**

  * [[https://www.nytimes.com/2020/01/18/technology/clearview-privacy-facial-recognition.html|The Secretive Company That Might End Privacy as We Know It]]. NYT, 20.01.2020
  * [[https://onezero.medium.com/i-got-my-file-from-clearview-ai-and-it-freaked-me-out-33ca28b5d6d4|I Got My File From Clearview AI, and It Freaked Me Out]]. 24.03.2020
  * [[https://gizmodo.com/clearview-ai-lured-rich-investors-by-letting-them-rumma-1842128226|Clearview AI Lured Rich Investors by Letting Them Rummage Around in Its Creepy Face Recognition App]], 05.03.2020
  * [[https://www.huffpost.com/entry/clearview-ai-facial-recognition-alt-right_n_5e7d028bc5b6cb08a92a5c48|The Far-Right Helped Create The World’s Most Powerful Facial Recognition Technology]] Huffington Post, 07.04.2020

===== Afternoon Tuesday =====

Trevor Paglen

Is Photography Over?, 4 Parts, Fotomuseum Winterthur, 03.2014

  - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26977_is_photography_over|Is Photography Over?]]
  - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26978_seeing_machines|Seeing Machines]]
  - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26979_scripts|Scripts]]
  - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26980_geographies_of_photography|Geographies of Photography]]

  * Read these four short parts. Select four sentences that you find interesting and copy them to the pad. Please organize them in the pad according to the section.

  *  Select one news story or artwork and add it to the pad. Write a short note, why this story/Work is interesting.

===== Wednesday Morning =====

Trevor Paglen & Cate Crawford

  * [[https://www.hkw.de/en/app/mediathek/video/69622|Datafication of Science]] Lecture at HKW, Jan 12, 2019. 32 Min
  * [[https://www.hkw.de/en/app/mediathek/video/69578||Discussion with Kate Crawford, Trevor Paglen, Felix Stalder]] HKW, Jan 12, 2019, 14Min
  * Kate Crawford and Trevor Paglen, [[https://www.excavating.ai/Excavating|AI. The Politics of Images in Machine Learning Training Sets]] 
  * [[http://www.fondazioneprada.org/project/training-humans/?lang=en|Fondazoione Prada: Training Humans]], Fondazione Prada, Venice, 12 Sep 2019 – 24 Feb 2020 [[https://we-make-money-not-art.com/training-humans-how-machines-see-and-judge-us|Review]], we-make-money-not-art.com, Dec. 16.2019
  * Paglen, Trevor. [[https://thenewinquiry.com/invisible-images-your-pictures-are-looking-at-you/|“Invisible Images (Your Pictures Are Looking at You).”]] The New Inquiry (blog), December 8, 2016

  * [[https://www.paulekman.com/resources/universal-facial-expressions| Paul Eckman: Seven Universal Facial Expressions]]
  * [[https://www.bbc.com/future/article/20180510-why-our-facial-expressions-dont-reflect-our-feelings|Why our facial expressions don’t reflect our feelings]], BBC, 10.05.2018

====== Wednesday Afternoon ======

Research and select the aspect of image recognition, based either on the news story or on art work, on which you want to base your fictional story. Make a first sketch of your story.

===== Thursday: Morning =====

Guest Marco Spitzbarth talks about how he uses image recognition on his platform. About hidden processes, algorithms, and black boxes. Questions he stumbled over on the way, his research, and technics he uses. The presentation will be held online.

  * [[https://ibulla.com/memory/| Ayumu, short memory game]]
  * [[https://wwwwwwwww.jodi.org/| hidden code in net art by jodi]]
  * [[https://tattookurier.ch/motive| klick and ink with Tattookurier]]
  * [[https://1milliondrawings.com/|platform to draw and analize, 1milliondrawings]]
  * [[https://www.youtube.com/watch?v=WXuK6gekU1Y|Alpha Go, full documentary]]
  * [[https://quickdraw.withgoogle.com/| Quick draw, A.I. experiment]]

**Further Material**

  * Hito Steyerl. [[https://www.e-flux.com/journal/72/60480/a-sea-of-data-apophenia-and-pattern-mis-recognition|A Sea of Data: Apophenia and Pattern (Mis-)Recognition]] e-flux, Journal #72 - April 2016
  * Hito Steyerl. [[https://www.hkw.de/en/app/mediathek/video/69577|The Language of Broken Glass]] Talk, HKW, Jan 12, 2019, 26 Min.

===== Thursday  Afternoon =====

Down the rabbit hole, let’s find some edge cases, anomalies, strange or misleading output.

  - Write in one or two sentences what you were looking for, e.g: How does the output differs if we use the same picture and tweak some colors?
  - Make some screenshots of your results.
  - Write some words about your research.

  * [[https://cloud.google.com/vision/|image recognition Google]]
  * [[https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/#product-overview|image recognition Microsoft]]
  * [[https://imagga.com/auto-tagging-demo|image recognition imagga]]

**The human labor hidden in automation**

  * [[https://theartofgooglebooks.tumblr.com|The Art of Google Books]]
  * Benjamin Shaykin [[https://cargocollective.com/bshaykin/Google-Hands|Google Hands]], 2009

**Andrew Norman Wilson**

  * [[http://www.andrewnormanwilson.com/WorkersGoogleplex.html|Workers Leaving the Googleplex]], 2011, 11 min
  * [[http://www.andrewnormanwilson.com/ScanOps.html| Scan Ops]], 2012-ongoing

[[https://www.theverge.com/2018/1/21/16916380/sundance-2018-the-cleaners-movie-review-facebook-google-twitter|The Cleaners]], 2017, 92 Min

===== Friday Morning =====

Collection of News Stories and ideas of short stories

===== Friday Afternoon =====

Individual writing of short stories

Possibility of individual mentoring.