Both sides previous revision Previous revision | |
art_and_ai_--_how_machines_think_and_see_ii [2020/12/14 11:09] – [Course preview] fstalder | art_and_ai_--_how_machines_think_and_see_ii [2020/12/14 11:32] (current) – [Course preview] fstalder |
---|
| |
We will also use some web-based image recognition systems to get a first-hand impression of the capacities of these technologies as tools for artistic investigation. | We will also use some web-based image recognition systems to get a first-hand impression of the capacities of these technologies as tools for artistic investigation. |
| |
| |
===== Course logistics ===== | ===== Course logistics ===== |
| |
| |
**Date:** Week 17, April 20-24, 2020 | **Date:** Week 17, April 20-24, 2020 |
**Time:** 10:00 - 17:00 | **Time:** 10:00 - 17:00 |
| |
The course takes place online: | The course takes place online: |
| |
Connect through the Zoom app, ID: 7890997001 | Connect through the Zoom app, ID: 7890997001 |
or through a web browser | or through a web browser |
| |
https://zhdk.zoom.us/j/7890997001 | [[https://zhdk.zoom.us/j/7890997001]] |
| |
The password is sent to you by email. | The password is sent to you by email. |
| |
Course requirements: | Course requirements: |
| |
* active participation in group activity | * active participation in group activity |
* active individual work (via pad) | * active individual work (via pad) |
* fictional short story, 2-3 pages, to be handed until Sunday, April 26. ([[https://paul.zhdk.ch/course/view.php?id=975|Upload to Paul]]) | * fictional short story, 2-3 pages, to be handed until Sunday, April 26. ([[https://paul.zhdk.ch/course/view.php?id=975|Upload to Paul]]) |
| |
| |
| |
===== Course Materials ===== | ===== Course Materials ===== |
| |
**Pad:** http://pad.vmk.zhdk.ch/p/art_ai_imagerecognition | **Pad:** [[http://pad.vmk.zhdk.ch/p/art_ai_imagerecognition]] |
| |
===== Monday Morning ===== | ===== Monday Morning ===== |
| |
| |
**Similarity & Difference** | **Similarity & Difference** |
* Mario Klingemann & Simon Doury [[https://experiments.withgoogle.com/x-degrees-of-separation|X Degrees of Separation]], 2018 | * Mario Klingemann & Simon Doury [[https://experiments.withgoogle.com/x-degrees-of-separation|X Degrees of Separation]], 2018 |
| |
| **How Image Recognition works, technically** |
| |
**How Image Recognition works, technically** | |
* [[https://www.youtube.com/watch?v=2-Ol7ZB0MmU|A friendly introduction to Convolutional Neural Networks and Image Recognition]], 2017, 32 Min. | * [[https://www.youtube.com/watch?v=2-Ol7ZB0MmU|A friendly introduction to Convolutional Neural Networks and Image Recognition]], 2017, 32 Min. |
* [[https://openai.com/blog/introducing-activation-atlases|Activation Atlas]], 2019 | * [[https://openai.com/blog/introducing-activation-atlases|Activation Atlas]], 2019 |
* [[https://www.youtube.com/watch?v=76jZkqlGIMY| Understanding image models and predictions using an Activation Atlas]], Google AI Adventures, 2019, 7:49 | * [[https://www.youtube.com/watch?v=76jZkqlGIMY| Understanding image models and predictions using an Activation Atlas]], Google AI Adventures, 2019, 7:49 |
| |
| **Joy Buolamwini** The coded gaze |
| |
**Joy Buolamwini** The coded gaze | |
* [[https://www.youtube.com/watch?v=QxuyfWoVV98|AI, Ain't I A Woman?]], 2018, 3:33 | * [[https://www.youtube.com/watch?v=QxuyfWoVV98|AI, Ain't I A Woman?]], 2018, 3:33 |
* https://www.notflawless.ai, see stories there, | * [[https://www.notflawless.ai]], see stories there, |
* http://gendershades.org/overview.html | * [[http://gendershades.org/overview.html]] |
* [[https://www.ted.com/talks/joy_buolamwini_how_i_m_fighting_bias_in_algorithms?language=en#t-111018| How I am fighting Bias in Algorithms.]] TEDx Talk, 2017 | * [[https://www.ted.com/talks/joy_buolamwini_how_i_m_fighting_bias_in_algorithms?language=en#t-111018| How I am fighting Bias in Algorithms.]] TEDx Talk, 2017 |
* [[https://www.safefacepledge.org|Safe Face Pledge]] | * [[https://www.safefacepledge.org|Safe Face Pledge]] |
| |
Another form of Bias: | Another form of Bias: |
| |
* !Mediengruppe Bitnik! [[https://wwwwwwwwwwwwwwwwwwwwww.bitnik.org/sor/|Dada. State of the Reference]], 2017 | * !Mediengruppe Bitnik! [[https://wwwwwwwwwwwwwwwwwwwwww.bitnik.org/sor/|Dada. State of the Reference]], 2017 |
| |
Further Reading: | Further Reading: |
| |
* Eubanks, Virginia. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. First Edition. New York, NY: St. Martin’s Press, 2017. | * Eubanks, Virginia. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. First Edition. New York, NY: St. Martin’s Press, 2017. |
* Noble, Safiya Umoja. Algorithms of Oppression: How Search Engines Reinforce Racism. New York: New York University Press, 2018 | * Noble, Safiya Umoja. Algorithms of Oppression: How Search Engines Reinforce Racism. New York: New York University Press, 2018 |
===== Tuesday Morning ===== | ===== Tuesday Morning ===== |
| |
| **Adam Harvey** [[https://ahprojects.com|Art projects about privacy, computer vision, and surveillance]] |
| |
**Adam Harvey** [[https://ahprojects.com|Art projects about privacy, computer vision, and surveillance]] | |
* Rejecting the automated gaze: [[https://ahprojects.com/camoflash|Camoflash]], 2008-10 [[https://ahprojects.com/cvdazzle/|CV Dazzle]], 2010-2014, [[https://ahprojects.com/stealth-wear/|Stealth Wear]], 2012-13, [[https://ahprojects.com/hyperface/|Hyper Face]], 2017-18 | * Rejecting the automated gaze: [[https://ahprojects.com/camoflash|Camoflash]], 2008-10 [[https://ahprojects.com/cvdazzle/|CV Dazzle]], 2010-2014, [[https://ahprojects.com/stealth-wear/|Stealth Wear]], 2012-13, [[https://ahprojects.com/hyperface/|Hyper Face]], 2017-18 |
* Exploring data sets: [[https://ahprojects.com/megapixels-glassroom|MegaPixels: Faces]] [[https://elevate.at/en/details/news/machine-learning-city|Machine Learning City]] Interview with Adam Harvey, 2018 | * Exploring data sets: [[https://ahprojects.com/megapixels-glassroom|MegaPixels: Faces]] [[https://elevate.at/en/details/news/machine-learning-city|Machine Learning City]] Interview with Adam Harvey, 2018 |
| |
More anti-image recognition / urban camouflage fashion projects | More anti-image recognition / urban camouflage fashion projects |
| |
* [[https://adversarialfashion.com|Adversarial fashion]] | * [[https://adversarialfashion.com|Adversarial fashion]] |
* [[https://www.cc-app.net/unlabeled|A++ Fashion x Computatinal Creativity]] | * [[https://www.cc-app.net/unlabeled|A++ Fashion x Computatinal Creativity]] |
* [[http://www.urmesurveillance.com/|URME Surveillance]] | * [[http://www.urmesurveillance.com/|URME Surveillance]] |
* [[https://www.vice.com/en_us/article/nz4mbb/anti-surveillance-coat-netherlands|Anti-Surveillance Coat]], 2016 | * [[https://www.vice.com/en_us/article/nz4mbb/anti-surveillance-coat-netherlands|Anti-Surveillance Coat]], 2016 |
| |
| |
**ClearView AI** | **ClearView AI** |
| |
* [[https://www.nytimes.com/2020/01/18/technology/clearview-privacy-facial-recognition.html|The Secretive Company That Might End Privacy as We Know It]]. NYT, 20.01.2020 | * [[https://www.nytimes.com/2020/01/18/technology/clearview-privacy-facial-recognition.html|The Secretive Company That Might End Privacy as We Know It]]. NYT, 20.01.2020 |
* [[https://onezero.medium.com/i-got-my-file-from-clearview-ai-and-it-freaked-me-out-33ca28b5d6d4|I Got My File From Clearview AI, and It Freaked Me Out]]. 24.03.2020 | * [[https://onezero.medium.com/i-got-my-file-from-clearview-ai-and-it-freaked-me-out-33ca28b5d6d4|I Got My File From Clearview AI, and It Freaked Me Out]]. 24.03.2020 |
| |
===== Afternoon Tuesday ===== | ===== Afternoon Tuesday ===== |
| |
| |
Trevor Paglen | Trevor Paglen |
| |
Is Photography Over?, 4 Parts, Fotomuseum Winterthur, 03.2014 | Is Photography Over?, 4 Parts, Fotomuseum Winterthur, 03.2014 |
| |
- [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26977_is_photography_over|Is Photography Over?]] | - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26977_is_photography_over|Is Photography Over?]] |
- [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26978_seeing_machines|Seeing Machines]] | - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26978_seeing_machines|Seeing Machines]] |
- [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26979_scripts|Scripts]] | - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26979_scripts|Scripts]] |
- [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26980_geographies_of_photography|Geographies of Photography]] | - [[https://www.fotomuseum.ch/en/explore/still-searching/articles/26980_geographies_of_photography|Geographies of Photography]] |
| |
* Read these four short parts. Select four sentences that you find interesting and copy them to the pad. Please organize them in the pad according to the section. | * Read these four short parts. Select four sentences that you find interesting and copy them to the pad. Please organize them in the pad according to the section. |
| |
===== Wednesday Morning ===== | ===== Wednesday Morning ===== |
| |
| Trevor Paglen & Cate Crawford |
| |
Trevor Paglen & Cate Crawford | |
* [[https://www.hkw.de/en/app/mediathek/video/69622|Datafication of Science]] Lecture at HKW, Jan 12, 2019. 32 Min | * [[https://www.hkw.de/en/app/mediathek/video/69622|Datafication of Science]] Lecture at HKW, Jan 12, 2019. 32 Min |
* [[https://www.hkw.de/en/app/mediathek/video/69578||Discussion with Kate Crawford, Trevor Paglen, Felix Stalder]] HKW, Jan 12, 2019, 14Min | * [[https://www.hkw.de/en/app/mediathek/video/69578||Discussion with Kate Crawford, Trevor Paglen, Felix Stalder]] HKW, Jan 12, 2019, 14Min |
* Paglen, Trevor. [[https://thenewinquiry.com/invisible-images-your-pictures-are-looking-at-you/|“Invisible Images (Your Pictures Are Looking at You).”]] The New Inquiry (blog), December 8, 2016 | * Paglen, Trevor. [[https://thenewinquiry.com/invisible-images-your-pictures-are-looking-at-you/|“Invisible Images (Your Pictures Are Looking at You).”]] The New Inquiry (blog), December 8, 2016 |
| |
| * [[https://www.paulekman.com/resources/universal-facial-expressions| Paul Eckman: Seven Universal Facial Expressions]] |
* [[https://www.paulekman.com/resources/universal-facial-expressions | Paul Eckman: Seven Universal Facial Expressions]] | |
* [[https://www.bbc.com/future/article/20180510-why-our-facial-expressions-dont-reflect-our-feelings|Why our facial expressions don’t reflect our feelings]], BBC, 10.05.2018 | * [[https://www.bbc.com/future/article/20180510-why-our-facial-expressions-dont-reflect-our-feelings|Why our facial expressions don’t reflect our feelings]], BBC, 10.05.2018 |
| |
| |
====== Wednesday Afternoon ====== | ====== Wednesday Afternoon ====== |
| |
Research and select the aspect of image recognition, based either on the news story or on art work, on which you want to base your fictional story. Make a first sketch of your story. | Research and select the aspect of image recognition, based either on the news story or on art work, on which you want to base your fictional story. Make a first sketch of your story. |
| |
| |
===== Thursday: Morning ===== | ===== Thursday: Morning ===== |
| |
**Further Material** | **Further Material** |
| |
* Hito Steyerl. [[https://www.e-flux.com/journal/72/60480/a-sea-of-data-apophenia-and-pattern-mis-recognition|A Sea of Data: Apophenia and Pattern (Mis-)Recognition]] e-flux, Journal #72 - April 2016 | * Hito Steyerl. [[https://www.e-flux.com/journal/72/60480/a-sea-of-data-apophenia-and-pattern-mis-recognition|A Sea of Data: Apophenia and Pattern (Mis-)Recognition]] e-flux, Journal #72 - April 2016 |
* Hito Steyerl. [[https://www.hkw.de/en/app/mediathek/video/69577|The Language of Broken Glass]] Talk, HKW, Jan 12, 2019, 26 Min. | * Hito Steyerl. [[https://www.hkw.de/en/app/mediathek/video/69577|The Language of Broken Glass]] Talk, HKW, Jan 12, 2019, 26 Min. |
| |
Down the rabbit hole, let’s find some edge cases, anomalies, strange or misleading output. | Down the rabbit hole, let’s find some edge cases, anomalies, strange or misleading output. |
| |
- Write in one or two sentences what you were looking for, e.g: How does the output differs if we use the same picture and tweak some colors? | - Write in one or two sentences what you were looking for, e.g: How does the output differs if we use the same picture and tweak some colors? |
- Make some screenshots of your results. | - Make some screenshots of your results. |
- Write some words about your research. | - Write some words about your research. |
| |
* [[https://cloud.google.com/vision/|image recognition Google]] | * [[https://cloud.google.com/vision/|image recognition Google]] |
* [[https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/#product-overview|image recognition Microsoft]] | * [[https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/#product-overview|image recognition Microsoft]] |
* [[https://imagga.com/auto-tagging-demo|image recognition imagga]] | * [[https://imagga.com/auto-tagging-demo|image recognition imagga]] |
| |
| |
**The human labor hidden in automation** | **The human labor hidden in automation** |
| |
**Andrew Norman Wilson** | **Andrew Norman Wilson** |
| |
* [[http://www.andrewnormanwilson.com/WorkersGoogleplex.html|Workers Leaving the Googleplex]], 2011, 11 min | * [[http://www.andrewnormanwilson.com/WorkersGoogleplex.html|Workers Leaving the Googleplex]], 2011, 11 min |
* [[http://www.andrewnormanwilson.com/ScanOps.html| Scan Ops]], 2012-ongoing | * [[http://www.andrewnormanwilson.com/ScanOps.html| Scan Ops]], 2012-ongoing |
[[https://www.theverge.com/2018/1/21/16916380/sundance-2018-the-cleaners-movie-review-facebook-google-twitter|The Cleaners]], 2017, 92 Min | [[https://www.theverge.com/2018/1/21/16916380/sundance-2018-the-cleaners-movie-review-facebook-google-twitter|The Cleaners]], 2017, 92 Min |
| |
| ===== Friday Morning ===== |
| |
===== Friday Morning ====== | |
Collection of News Stories and ideas of short stories | Collection of News Stories and ideas of short stories |
| |
| |
Possibility of individual mentoring. | Possibility of individual mentoring. |
| |
| |
| |
| |
| |
| |