News

• August, 2017: Final paper in press.

Abstract

Light field imaging has emerged as a technology allowing to capture richer visual information from our world. As opposed to traditional photography, which captures a 2D projection of the light in the scene integrating the angular domain, light fields collect radiance from rays in all directions, demultiplexing the angular information lost in conventional photography. On the one hand, this higher dimensional representation of visual data offers powerful capabilities for scene understanding, and substantially improves the performance of traditional computer vision problems such as depth sensing, post-capture refocusing, segmentation, video stabilization, material classification, etc. On the other hand, the high-dimensionality of light fields also brings up new challenges in terms of data capture, data compression, content editing, and display. Taking these two elements together, research in light field image processing has become increasingly popular in the computer vision, computer graphics, and signal processing communities. In this paper, we present a comprehensive overview and discussion of research in this field over the past 20 years. We focus on all aspects of light field image processing, including basic light field representation and theory, acquisition, super-resolution, depth estimation, compression, editing, processing algorithms for light field display, and computer vision applications of light field data.

Downloads

• Paper [6.1 MB]

Bibtex

Related

• 2014: How Do People Edit Light Fields?
@Article{Jarabo2014how, author = {Jarabo, Adrian and Masia, Belen and Bousseau, Adrien and Pellacini, Fabio and Gutierrez, Diego}, title = {How Do People Edit Light Fields?}, journal = {ACM Transactions on Graphics (SIGGRAPH 2014)}, volume = {33}, number = {4}, year = {2014}, }
• 2017: Analyzing Interfaces and Workflows for Light Field Editing
@Article{Ortin2017analyzing, author = {Marta Ortin and Adrian Jarabo and Belen Masia and Diego Gutierrez}, title = {Analyzing Interfaces and Workflows for Light Field Editing}, journal = {IEEE Journal of Selected Topics in Signal Processing}, year = {2017}, volume = {11}, number = {7}, }
• 2015: Light Field Editing Based on Reparameterization
@inproceedings{Ao2015light, author = {Hongbo Ao and Yongbing Zhang and Adrian Jarabo and Belen Masia and Yebin Liu and Diego Gutierrez and Qionghai Dai}, title = {Light Field Editing Based on Reparameterization}, booktitle = {Pacific Rim Conference on Multimedia 2015}, year = {2015} }
• 2014: Favored Workflows in Light Field Editing
@inproceedings{Masia:CGVCVIP14, author = {Belen Masia and Adrian Jarabo and Diego Gutierrez}, title = {Favored Workflows in Light Field Editing}, booktitle = {Proc. of the 8th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2014}, series = {CGVCVIP 2014}, year = {2014}, location = {Lisbon, Portugal}, }
• 2011: Efficient Propagation of Light Field Edits
@inproceedings{Jarabo:SIACG2011, author = {Adrian Jarabo and Belen Masia and Diego Gutierrez}, title = {Efficient Propagation of Light Field Edits}, booktitle = {Proc. of the V Ibero-American Symposium in Computer Graphics}, series = {SIACG 2011}, year = {2011}, isbn = {978-972-98464-6-5}, location = {Faro, Portugal}, pages = {75--80}, numpages = {6} }

Links

• Publishers version

Acknowledgements

This work was supported by the National Key Foundation for exploring scientific instrument No.2013YQ140517, the National NSF of China grant No.61522111 and No.61531014. It was also partially supported by the Spanish Ministry of Economy and Competitiveness (TIN2016-79710-P), and the European Research Council (Consolidator Grant, project CHAMELEON, ref. 682080). This work is also supported by Science and Technology Planning Project of Guangdong Province, China (2015B010105004).