immersive art space

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Inspiration ======

===== VR =====

  * 2019 [[https://www.youtube.com/watch?v=qYsaAOOl6FQ|AYAHUASCA]]
  * 2019 [[https://uploadvr.com/afterlife-branching-narratives-live-actors-vr|Afterlife: Combining Branching Narratives With Live Actors In VR]]
  * 2017 [[https://vimeo.com/235319208#_=_|Alice - The Virtual Reality Play]]

===== Overview UnityTeam Digital Human Rigging & Shading =====

A general overview of some of the tools and workflows used and applied by the Unity Team for the creation of their state of the art Digital Human, Gawain.

==== Maya File ====

=== Rig ===

They used two different rig hierarchies. One for the body the other for the head.

==Body Rig== 
Classical full body game rig. Skin weights up to the torso.
Corrective blendshapes for the hands and the back.

==Head Rig==
Combination of Joint hierarchy and over 200 Blendshapes.

=== Model ===

Non-deforming body parts like the gum don't have an optimized topology.

All the hair consists of cards. Hair is exported as a separated object and is not part of the head mesh. It's attachment to the deforming mesh happens in Unity.

==== Unity Files ====

=== Attachment Tools ===

The Unity Team developed a set of very useful tools to attach elements to a deforming mesh in realtime. You can implement those tools in your own project by getting them [[https://github.com/Unity-Technologies/com.unity.demoteam.digital-human| here]]. 

First an empty dataset is created in the Assets Window. (right click -> Digital Human -> skin attachment data )

Then in the outliner you select the object you want to have attached to the deforming mesh.
Add a 'Skin Attachment Target'-Script to it's Inspector and specify the dataset you just added.

Select the mesh driving the deformation, add a 'Skin Attachment'-Script to its inspector and specify the targets. (This only works if you insert the script after the 'Skinned Mesh Renderer'/'Mesh Renderer' )

Go back to the inspector of the target and fill in the dataset with the required mesh information. 

As for now these tools only work with meshes being deformed by the GPU.


=== Shading & Rendering ===

The skin and eyes are using a dedicated shader connected to a set of dedicated scripts.

The eyes can easily be customized to fit the needs of the required reference model.  

We're still looking into the skin shader, particularly the system they applied to blend 82 different textures based on the faceshape.


==== Links ====

For further insight into this project, please refer to these links:

=== Readings ===
[[ https://blogs.unity3d.com/2020/06/10/making-of-the-heretic-digital-human-character-gawain/ | Blog with emphasis on artistic aspects]]

[[https://blogs.unity3d.com/2020/07/10/making-of-the-heretic-digital-human-tech-package/ | Blog with emphasis on the technical aspects]]

=== Code and Material ===
[[https://github.com/Unity-Technologies/com.unity.demoteam.digital-human.sample | Unity Digital Human Assets]]

[[https://github.com/Unity-Technologies/com.unity.demoteam.digital-human | Unity Digital Human Tools]]
 

===== RealTime PreViz =====

  * 2018 [[https://www.youtube.com/watch?v=9owTAISsvwk|Siren (Unreal)]] [[https://youtu.be/JrT6stflY_c|Siren with Actress]]

  * 2018 [[https://www.youtube.com/watch?v=J3ue35ago3Y|Reflections (Unreal)]]
  * 2018 [[https://www.youtube.com/watch?time_continue=2&v=DDsRfbfnC_A|ForestScene (Unity)]]
  * 2018 [[https://www.youtube.com/watch?v=TxErDzsIdKI|Andy Serkis Face to Face (Unreal)]]
  * 2019 [[https://www.ted.com/talks/doug_roble_digital_humans_that_look_just_like_us|Ted Talk about Digital Humans with real time character]]

===== Dance =====

  * 2014 [[https://vimeo.com/173139879|Peking Opera]]
  * 2017 [[https://vimeo.com/221538677|Exisdance (Unity)]]
  * 20xx [[https://www.augmentedperformance.com|Huge collection of dance performances]]

===== Scenography / Dance =====

  * 2014 [[https://www.youtube.com/watch?v=qAYAuJ9dIlE|HAKANAI by Adrien M / Claire B]]
  * 2018 [[https://vimeo.com/205071534|Dökk (OpenFrameWorks)]]
  * 2019 [[https://www.youtube.com/watch?v=qYsaAOOl6FQ|Das Totale Tanztheater - 100 Jahre Bauhaus - Palais Populaire]]

===== Projection Mapping & Dance =====

  * 2014 [[https://vimeo.com/nobumichiasai/omote|OMOTE]]
  * 2017 [[https://vimeo.com/210599507|INORI (Prayer)]] [[https://vimeo.com/210565827|Making-of]]

===== Scenography / Theatre & Opera =====

  * 2002 [[https://artcom.de/project/mediales-buehnenbild/|Jude von Malta by Art+Com]]
  * 2010 [[http://vracollective.com/en/art-page/iam4mime/|IAM4Mime]]
  * 2016 [[http://www.peppersghost.org/main/manipulation/|Manipulation | Pepper's Ghost]]
  * 2017 [[https://www.youtube.com/watch?time_continue=2&v=3bjrx0xlPMg|The Tempest | Royal Shakespeare Company]]

===== Tradeshow examples =====

  * 2017 [[https://www.youtube.com/watch?v=QzppfCSJodY|Dynamic Projection Mapping]]

====== Technology ======

  * [[https://www.youtube.com/watch?v=bL6hp8BKB24|Why CG sucks / or not (Essay)]]

==== AI ====

  * [[https://www.youtube.com/watch?v=ohmajJTcpNk|Realtime Face Reenactment]]
  * [[https://www.youtube.com/watch?v=3AIpPlzM_qs|Image Synthesis through semantic manipulation]]
  * [[https://www.youtube.com/watch?v=ayPqjPekn7g|Interactive AI rendered 3d World]]
  * [[https://www.youtube.com/watch?v=gg0F5JjKmhA|Reconstructing Images]]
  * [[https://motherboard.vice.com/en_us/article/xwvz9a/watch-an-algorithm-turn-winter-into-summer-in-any-video-image-to-image-translation| Tranform Video from Winter to Summer / Day to night]]
  * [[https://www.youtube.com/watch?v=dMF2i3A9Lzw|Reflections on deep fakes]]
  * [[https://www.newscientist.com/article/mg24232292-000-true-ai-creativity-is-coming-and-will-reveal-the-minds-of-machines/|creative AI in the arts]]

==== FilmSets ====

  * [[https://www.youtube.com/watch?v=5gZWna6RnCA|Realtime Compositing]]

==== Film VFX ====

  * [[https://youtu.be/Oitr_eYcJk0|The Social Network VFX Breakdown]]
  * [[https://youtu.be/fV34mT5m0bM|Rachel in Blade Runner 2049]]
  * [[https://youtu.be/ZSD6VFUVbsQ|VFX Oscar Winners from 1929-2018]]
  * [[https://www.youtube.com/watch?v=KCnayCnM6Zk|The Lion King 2019 - Making Of - How it was filmed in a realistic way]]

==== Robotics ====

  * [[https://vimeo.com/291694284|Uncanny Valley/Unheimliches Tal by Stefan Kaegi with robot-avatar as double of the author Thomas Melle]]
  * [[https://www.artsy.net/article/artsy-editorial-artists-love-eerie-sensation-characters-human|Why Artists Love the Eerie Sensation of Characters That Look Almost Human]]

===== Old Style =====

==== Scenography ====

  * [[https://www.facebook.com/steve.gilliam.75/videos/10156987128758689/|Opera Scene change]]

==== Film / Animation ====

  * [[https://youtu.be/QE9Q_7bfHsM|Loving Vincent Making of / Rotoscope]]
  * [[https://youtu.be/mHRmLKnKJPo|Loving Vincent Rotoscope Painting in Time Lapse]]

===== Companies =====

  * [[https://www.luxmc.com|LuxMachina]]
  * [[http://stillerstudios.com/|Stiller Studios]]
  * [[https://meowwolf.com/|Meow Wolf]]

====== Volumetric ======

  *  [[https://newsroom.intel.com/tag/intel-studios/|Intel Studio]]