Open Access Te Herenga Waka-Victoria University of Wellington
Browse

File(s) stored somewhere else

Please note: Linked content is NOT stored on Open Access Te Herenga Waka-Victoria University of Wellington and we can't guarantee its availability, quality, security or accept any liability.

Art-directing Appearance using an Environment Map Latent Space

conference contribution
posted on 2023-05-24, 06:57 authored by Lohit Petikam, Andrew Chalmers, Ken Anjyo, Taehyun RheeTaehyun Rhee
In look development, environment maps (EMs) are used to verify 3D appearance in varied lighting (e.g., overcast, sunny, and indoor). Artists can only assign one fixed material, making it laborious to edit appearance uniquely for all EMs. Artists can artdirect material and lighting in film post-production. However, this is impossible in dynamic real-time games and live augmented reality (AR), where environment lighting is unpredictable. We present a new workflow to customize appearance variation across a wide range of EM lighting, for live applications. Appearance edits can be predefined, and then automatically adapted to environment lighting changes. We achieve this by learning a novel 2D latent space of varied EM lighting. The latent space lets artists browse EMs in a semantically meaningful 2D view. For different EMs, artists can paint different material and lighting parameter values directly on the latent space. We robustly encode new EMs into the same space, for automatic look-up of the desired appearance. This solves a new problem of preserving art-direction in live applications, without any artist intervention.

Funding

Computational Media Innovation and Entrepreneurship (CMIE) Programme | Funder: TERTIARY EDUCATION COMMISSION

History

Preferred citation

Petikam, L., Chalmers, A., Anjyo, K. & Rhee, T. (2021, October). Art-directing Appearance using an Environment Map Latent Space. https://doi.org/10.2312/pg.20211386

Contribution type

Published Paper

Publication or Presentation Year

2021-10-20

Publication status

Published

Usage metrics

    Conference papers

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC