Open Access Te Herenga Waka-Victoria University of Wellington
Browse

File(s) stored somewhere else

Please note: Linked content is NOT stored on Open Access Te Herenga Waka-Victoria University of Wellington and we can't guarantee its availability, quality, security or accept any liability.

Real-time mixed reality rendering for underwater 360° videos

conference contribution
posted on 2021-11-30, 03:35 authored by S Thompson, Andrew Chalmers, Taehyun Rhee
We present a novel mixed reality (MR) rendering and composition solution that illuminates and blends virtual objects into underwater 360° videos (360-video) in real-time. Real-time underwater lighting (caustics, god rays, fog, and particulates) were developed to improve the overall lighting and blending quality. We also provide a MR toolkit, an interface to tune the parameters of the underwater lighting so the user can match the lighting observed in the 360-video. Our image based lighting provides automatic ambient and high frequency underwater lighting. This ensures that the virtual objects are lit and blend similarly to each frame of the video semi-automatically and in real-time. We conducted a user study by having participants rate our method based on the visual quality and presence using a five point Likert Scale. The results show that our underwater lighting is preferred over no underwater effects or using naive ambient lighting. We also have a few takeaways on what elements of our underwater lighting and interaction have a significant impact on visual quality and presence in underwater MR.

History

Preferred citation

Thompson, S., Chalmers, A. & Rhee, T. (2019, October). Real-time mixed reality rendering for underwater 360° videos. In Proceedings - 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (00 pp. 74-82). IEEE. https://doi.org/10.1109/ISMAR.2019.00-24

Conference name

2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Conference start date

2019-10-14

Conference finish date

2019-10-18

Title of proceedings

Proceedings - 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019

Volume

00

Publication or Presentation Year

2019-10-01

Pagination

74-82

Publisher

IEEE

Publication status

Published

Usage metrics

    Conference papers

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC