John Gaeta
John C. Gaeta (born 1965) is a designer and inventor best known for his work on the Matrix film trilogy, where he advanced methods and formats known as Bullet Time, Volumetric Cinematography and Universal Capture (UCAP). He is also known for exploring emergent and expressive new media platforms such as Photo Anime, NUI, HoloCinema and the Magicverse.
Career
John Gaeta was born in New York City and grew up in Shoreham, Long Island. He eventually grew an interest in photography and the films of Stanley Kubrick and Ridley Scott. He entered New York University's Tisch School of the Arts to study film, and acquired a BFA degree with honors in 1989. He was introduced to the industry as a staff production assistant for the Saturday Night Live film unit, as well as doing camera and lighting work for a variety of media types and makers.[1] Some of these early work experiences included holography with Jason Sapan, stop-motion animation with Peter Wallach, motion control with Bran Ferren, nature documentary, filming birdlife for National Geographic Explorer, timelapse and experimental photography in Namibia, Africa on Miramax's first feature, Dust Devil.[2]
A few years later, Gaeta heard from a friend that visual effects innovator Douglas Trumbull was founding a new company in Massachusetts and needed technicians based on the East Coast. Gaeta went on to be drafted into the camera department of the newly formed Trumbull Company, where he was introduced and educated in a spectrum of innovative film formats such as 48fps VistaVision, 70mm Showscan, IMAX, OMNIMAX and stereo CGI, to create the ambitious simulator Back to the Future: The Ride for Universal Parks & Resorts.[2]
Following this special venue period (1991–1994), Gaeta became interested in applying computer-generated animation as a means of visualizing content and visual effects concepts for directors as well as for custom camera-path planning. This led to experimentation with emerging forms of space analysis including photogrammetry, stereo and laser radar. Trumbull Company was renamed Mass Illusion and started feature film effects for movies.
After co-supervising development for 3-D paint effect stylizations and LIDAR laser scanning(Reality Capture) for What Dreams May Come (1998 Visual Effects Oscar winner), Gaeta began his first solo effects supervision project for The Wachowskis' science fiction film, The Matrix.
Designing and testing The Matrix bullet time effects began in early 1996. This work directly overlapped R&D for What Dreams May Come. Shortly after the release of the original Matrix in 1999, Gaeta continued his exploration of content design through CGI visualization with longtime colleague Kim Libreri (Lucasfilm, Current CTO of Epic Games) by developing fully "virtual" scene and action layouts for use in realtime interactive composition. Scenes ran on the GS Cube, a machine consisting of 16 parallel processors each based on a PlayStation 2 and rendering at, then groundbreaking, HD resolution. The research was demonstrated at SIGGRAPH 2000. Later, he partnered with colleague Rudy Poat (Microsoft, Amazon VR), returning to real time cinema experimentation by inserting, possibly the first ever, real time composed and rendered, full resolution/2k content into a theatrically released movie, Trapped Ashes.
In 2000, Gaeta was brought on as the senior visual effects supervisor to complete the Matrix trilogy including The Matrix Reloaded and The Matrix Revolutions. This pair of films were created in parallel and featured over 2000 visual effects shots. Many photographed and post processed at a custom built complex called ESC, located at the Alameda Naval Base near San Francisco. Overall conceptual design as well as research and development was initiated for the final two installments in January 2000. There were a wide range of effects content from large-scale man vs. machine-type battles, to anime-styled hyper-real moments. The centerpiece innovations and new methodologies presented through the Matrix universe was the creation of "Virtual Cinematography" and "Virtual Effects," phrases coined by Gaeta in 1999 and 2000.[3]
In fully synthetic scenes within The Matrix sequels, all aspects including principal characters, elaborate performances, dynamic events, and deep surrounding scenery were computer generated by way of customized "image based" rendering techniques. Content components were constructed from "universal capture" sources based upon real actors, production design and cinematography, in a "sample cinema" type process more analogous to producing virtual reality than to film making. Impact, evolution and expansion of these once emergent content forms can be seen in later breakthrough films such as The Curious Case of Benjamin Button and Avatar as well as ongoing interactive research happening in games and military simulation.[4]
The years 2005–2008 marked a deepening of the pursuit of sample cinema with new ground covered in the feature Speed Racer. The advent of a new genre type, dubbed "Photo Anime", was the centerpiece of a retro-modern universe in which optimistic pop art design ("Poptimisitic") threaded through dramatic collage based editing and motion graphic heavy kung fu car action. Inspired in part by the production attitude of Sin City, the expressive animated cinema of Hayao Miyazaki and Andy Warhol, the Wachowskis focused Gaeta's sensibilities once more toward new forms of post cinematography, deploying end to end high definition pipelines, comprehensive greenscreen/virtual set processes, fully computer generated race worlds, "2 and 1/2 D" layering methodologies, "faux lensing" as applied to VR location photography (360 degree spherical capture) and "techno color" in pursuit of a different movie experience. In addition to visual effects design for the film, Gaeta was additionally enlisted to creatively produce the Wii game counterpart.[5]
Since 2000, Gaeta has been an avid proponent of image based universal capture, also known as volumetric capture and deploying it within next generation of immersive entertainment.
In 2009 he had formed a new type of development company, FLOAT (hybrid) and was its acting Chief Creative Officer from 2009-2012. Float (hybrid) specializes in discovering and developing intuitive "Natural and Human Interfaces" in an effort to change the way people engage, relate to and interact with live generated entertainment.
Working directly with the future media labs at Microsoft that birthed the prototype technology that led to the Kinect and Hololens, his focus was on discovering new forms of “experiences” within emergent "Natural User Interface" (NUI) paradigms. First of kind advancements were made toward intuitive, multi modal, full body gesture based navigation of characters through spatially complex and virtually tactile(reactive) worlds.
Nuiscopic (Natural User Vision) and Nuvie (NU Movie, Natural User Movie) were terms Gaeta coined during this period to describe a new form of gesture and spatial proximity driven real time perspective control and a creative target for it: interactive and navigable storytelling. Float prototypes were often conducted in connected “living room labs" or special venues and often utilized sensors, capture and tracking technologies, proto mobile device hardware, immersive projection, virtual reality hmds (military, pre oculus/vive), augmented and blended reality proto tech.
In late 2012, at the onset of Walt Disney's acquisition of Lucasfilm, John Gaeta was invited to join at the invitation of Kathleen Kennedy(President of Lucasfilm) to help catalyze next generation creative innovation. He would do so in collaboration with Rick Carter (Academy Award-winning Production Designer), Kiri Hart (SVP Development, Head of Story Group), Doug Chiang (SVP Head of Creative), Kim Libreri (Chief Strategy Officer) and the remarkable talent of Industrial Light and Magic during the next contemporary expansion of Star Wars.
John Gaeta is a founding member and Executive Creative Director of Lucasfilm's new Immersive Entertainment division: ILMxLAB, a joint venture between the Lucasfilm Story Group, Industrial Light and Magic and Skywalker Sound. ILMxLAB was launched in 2015 with a mission to develop, produce and release premium Star Wars Immersive Entertainment within emergent platforms. Other founding members include Vicki Dobbs Beck(Executive in Charge) and Rob Bredow(Lucasfilm CTO).
State of the art formats under the umbrella of "Immersive Entertainment" include Real Time and Interactive Cinema, HoloCinema (Holographic Cinema), Virtual Reality, Mixed Reality, Theme Parks 2.0, and other Experimental Platforms. Part lab, part content creator, ILMxLAB also has connections to Disney Imagineering, Disney Research, Disney Corporate / Innovation and Disney Studios.
During this time, ILMxLAB developed a multitude of advanced Star Wars based prototypes that would go on to become releasable products including the VOID experience titled Star Wars: Secrets of the Empire as well as the development of a VR Story Series titled Vader Immortal. Vader Immortal's original premise and innovative format was first conceived of by David Goyer and John Gaeta under the guidance of Lucasfilm/Star Wars head of Story, Kiri Heart. Gaeta would leave Lucasfilm to take on a new role at Magic Leap before Vader Immortal was greenlit and published by Facebook Oculus with Goyer acting as its showrunner/writer and with ILMXLAB in charge of formal development and execution. Both of these accomplishments mark a milestone for Lucasfilm/Disney as it evolved "immersive entertainment" from incubation labs to producing first of kind products for mainstream media audiences.
In October 2017, as a direct report to CEO Rony Abovitz, John Gaeta took on the executive role of SVP of Creative Strategy at Magic Leap with a mission focus to collaboratively conceive and advise corporate direction on mid term emergent spatial computing, spatial web, massive xr platform strategies and premium content/worlds.
Some areas included multi platform "co presence" formats, giga-smart city scaled holo(hunger games like xr mmo) interfaces, high fidelity "cinematic reality" for persistent living immersive content layers, premium xr world creative ip development and the advanced envisioning of The Magicverse. The latter initiative was first unveiled by Neal Stephensen(Snowcrash Author), Rony Abovitz and John Gaeta at Magic Leap's 2018 conference. Magicverse envisioning is conducted through a special projects/moonshot division he initiated called IPL which produces strategic analysis, concept, visualization/simulation and leading edge prototypes which depict future use cases, experimental interface and compelling human experiences.
Awards
- 2000 Academy Award for Visual Effects, for The Matrix
- 2000 BAFTA Awards for Best Achievement in Special Effects, for The Matrix
- Above two shared with Steve Courtley, Janek Sirrs, Jon Thum
- 2000 MTV Movie Award, Best Action
- 2003 Visual Effects Society Award for Best Single Visual Effect of the Year in Any Medium, for The Matrix Reloaded (trailer "Top Crash"), shared with Dan Glass, Adrian De Wet, Greg Juby
- 2003 Visual Effects Society Award for Outstanding Visual Effects Photography in a Motion Picture for The Matrix Reloaded (U-cap facial photography), shared with Kim Libreri, George Borshukov, Paul Ryan
- Hollywood Film Festival: Hollywood Visual Effects Award, 2003
- Nominated, 2003 Visual Effects Society Award for Outstanding Visual Effects in a Visual Effects Driven Motion Picture for The Matrix Revolutions, shared with Kim Libreri, George Murphy, Craig Hayes
- 2014 Palo Alto International Film Festival, Muybridge Award for Innovation
References
- "Matrix2: Bullet Time was just the beginning. F/x guru John Gaeta reinvents cinematography with The Matrix Reloaded." (Wired, May 2003)
- "Artist Profile: John Gaeta". Archived from the original on 2016-04-07. Retrieved 2016-03-27.
- "'The Matrix' Revealed: An Interview with John Gaeta" (VFXPro, March 9, 2004)
- "Archived copy". Archived from the original on 2014-04-06. Retrieved 2014-04-25.CS1 maint: archived copy as title (link)
- CGSociety - John Gaeta
- https://www.theverge.com/2015/8/13/9131805/ilm-ilmxlab-interview-virtual-reality-star-wars-movies
- https://www.fxguide.com/featured/sci-tech-winners-ucap-mova/
- https://www.engadget.com/2016/01/29/star-wars-holographic-cinema-sundance/
- https://techcrunch.com/2016/03/03/augmented-reality-is-conquering-new-frontiers-with-star-wars/
- http://voicesofvr.com/294-john-gaeta-on-ilmxlab-immersive-storytelling/
- http://www.billdesowitz.com/?p=1969
- https://web.archive.org/web/20080621064601/http://features.cgsociety.org/story_custom.php?story_id=4564
- Interview: Float Hybrid Plugs Into The Matrix With Kinect
- Eclectic Pioneer in Photography Connects Art and Science
- New Speed Racer Technology Could Be a Radical Innovation
- http://anm.sagepub.com/cgi/reprint/1/1/25
- http://www.darmogul.com/Qtimes/experimental/full/DL%20The%20Matrix%20-%20%2796%20Green%20Light%20Test.mov%5B%5D
- https://web.archive.org/web/20061114032125/http://www.braintrustdv.com/essays/image-future.html
- Eadweard Muybridge and The Matrix
- "One Against Many: A stunning showdown in Reloaded improves upon bullet time" (Premiere)
- "The Matrix Resolution" (Computer Graphics World)
- "Entertainment Beyond The Matrix" (Wired News, October 20, 2003)
- "A Celebration of Effects" (Cinefex Weekly Update, February 24, 2004)
External links
- John Gaeta at IMDb