News

Abstract

We present a thorough study to evaluate different light field editing interfaces, tools and workflows from a user perspective. This is of special relevance given the multidimensional nature of light fields, which may make common image editing tasks become complex in light field space. We additionally investigate the potential benefits of using depth information when editing, and the limitations imposed by imperfect depth reconstruction using current techniques. We perform two different experiments, collecting both objective and subjective data from a varied number of point-based editing tasks of increasing complexity: In the first experiment, we rely on perfect depth from synthetic light fields, and focus on simple edits. This allows us to gain basic insight on light field editing, and to design a more advanced editing interface. This is then used in the second experiment, employing real light fields with imperfect reconstructed depth, and covering more advanced editing tasks. Our study shows that users can edit light fields with our tested interface and tools, even in the presence of imperfect depth. They follow different workflows depending on the task at hand, mostly relying on a combination of different depth cues. Last, we confirm our findings by asking a set of artists to freely edit both real and synthetic light fields.

Downloads

Bibtex

@article{Jarabo:SIG14, author = {Jarabo, Adrian and Masia, Belen and Bousseau, Adrien and Pellacini, Fabio and Gutierrez, Diego}, title = {How Do People Edit Light Fields?}, journal = {ACM Transactions on Graphics (SIGGRAPH 2014)}, volume = {33}, number = {4}, year = {2014}, }
Related Bibtex
@inproceedings{Ao:PFM2015, author = {Hongbo Ao and Yongbing Zhang and Adrian Jarabo and Belen Masia and Yebin Liu and Diego Gutierrez and Qionghai Dai}, title = {Light Field Editing Based on Reparameterization}, booktitle = {Pacific Rim Conference on Multimedia 2015}, year = {2015} }
@inproceedings{Masia:CGVCVIP14, author = {Belen Masia and Adrian Jarabo and Diego Gutierrez}, title = {Favored Workflows in Light Field Editing}, booktitle = {Proc. of the 8th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2014}, series = {CGVCVIP 2014}, year = {2014}, location = {Lisbon, Portugal}, }
@inproceedings{Jarabo:SIACG2011, author = {Adrian Jarabo and Belen Masia and Diego Gutierrez}, title = {Efficient Propagation of Light Field Edits}, booktitle = {Proc. of the V Ibero-American Symposium in Computer Graphics}, series = {SIACG 2011}, year = {2011}, isbn = {978-972-98464-6-5}, location = {Faro, Portugal}, pages = {75--80}, numpages = {6} }

Related

Acknowledgements

We want to thank the reviewers for their insightful comments, the participants of the experiments (in particular Sara Lopez, Patrick Moosebrugger, Carlos Aliaga and Jose I. Echevarria), Chia-Kai Liang for his help with the Lytro SDK, the models in the captured light fields (Paz Hernando, Julio Marco, Laura Serra and Raul Buisan), and the members of the Graphics and Imaging Lab and the REVES Group for valuable discussions and feedback. We also want to thank the authors of [Kim et al. 2013a] and [Wanner and Goldluecke 2012] for sharing their light fields, Guillermo Leal Llaguno for the San Miguel scene, Emmanuelle Chapoulie and the AIM@SHAPE project for vase, and Infinite Realities for the head data. This research has been partially funded by the European Commission, 7th Framework Programme, through projects GOLEM (Marie Curie IAPP, grant: 251415), VERVE (ICT, grant: 288914) and TROPIC (ICT, grant: 318784 ), the Spanish Ministry of Science and Technology (TIN2010-21543), project TAMA, Intel Corporation and Adobe. Belen Masia has additionally been supported by an Nvidia Graduate Fellowship.