Open Access Te Herenga Waka-Victoria University of Wellington

File(s) stored somewhere else

Please note: Linked content is NOT stored on Open Access Te Herenga Waka-Victoria University of Wellington and we can't guarantee its availability, quality, security or accept any liability.

Art-directing Appearance using an Environment Map Latent Space

conference contribution
posted on 2023-05-24, 06:57 authored by Lohit Petikam, Andrew Chalmers, Ken Anjyo, Taehyun Rhee
In look development, environment maps (EMs) are used to verify 3D appearance in varied lighting (e.g., overcast, sunny, and indoor). Artists can only assign one fixed material, making it laborious to edit appearance uniquely for all EMs. Artists can artdirect material and lighting in film post-production. However, this is impossible in dynamic real-time games and live augmented reality (AR), where environment lighting is unpredictable. We present a new workflow to customize appearance variation across a wide range of EM lighting, for live applications. Appearance edits can be predefined, and then automatically adapted to environment lighting changes. We achieve this by learning a novel 2D latent space of varied EM lighting. The latent space lets artists browse EMs in a semantically meaningful 2D view. For different EMs, artists can paint different material and lighting parameter values directly on the latent space. We robustly encode new EMs into the same space, for automatic look-up of the desired appearance. This solves a new problem of preserving art-direction in live applications, without any artist intervention.


Computational Media Innovation and Entrepreneurship (CMIE) Programme | Funder: TERTIARY EDUCATION COMMISSION


Preferred citation

Petikam, L., Chalmers, A., Anjyo, K. & Rhee, T. (2021, October). Art-directing Appearance using an Environment Map Latent Space.

Contribution type

Published Paper

Publication or Presentation Year


Publication status


Usage metrics

    Conference papers


    Ref. manager