Compressive Epsilon Photography for Post-Capture Control in Digital Imaging


Compressive epsilon photography enables post-capture freedom from a few carefully selected photographs of a scene. Lurking among the gamut of photographs that can be obtained by varying camera parameters are a few photographs that can truly capture the aesthetics of a scene. In this paper, we enable complete post-capture freedom in changing camera parameters by estimating the entire gamut of photographs from a few select photographs at pre-determined camera parameters (marked in blue). Notice the fine features of hair being accurately reconstructed since our algorithms are per-pixel.

Abstract

A traditional camera requires the photographer to select the focus,ISO, exposure and aperture at capture time. While advances inn light field photography has enabled for post-capture control of focus and perspective, they suffer from several limitations including lower spatial resolution, need for hardware modifications,and restrictive choice of f-numbers and focal lengths. In this paper, we propose Compressive Epsilon Photography a technique for achieving complete post-capture control of focus and aperture in a traditional camera by acquiring a carefully selected set of images(about 16) and computationally reconstructing images corresponding to all other focus-aperture settings. Our approach has the following distinct contributions: first, we learn the statistical redundancies in a complete focal-aperture stack data using a Gaussian Mixture Model; second, we derive a greedy sampling strategy for selecting the best focus-aperture settings and third, we develop an algorithm for reconstructing the entire focal-aperture stack data from a few captured images. As a consequence, at capture time, only a burst of images with carefully selected focal-aperture settings are acquired. Post-capture, the user can then select any focalaperture setting of choice and the corresponding image can be rendered using our algorithm. We show extensive results on several real data sets captured using an SLR camera.

Get your own valid XHTML YouTube embed code

Files

Citation

A. Ito, S. Tambe, K. Mitra, A. Sankaranarayanan, A. Veeraraghavan. Compressive Epsilon Photography for Post-Capture Control in Digital Imaging. Proc. of SIGGRAPH 2014 (ACM Transactions on Graphics), 2014.

Bibtex

@article{Ito2014CompEpsilon,
title={Compressive Epsilon Photography for Post-Capture Control in Digital Imaging},
author={Ito, Atsushi and Tambe, Salil and Mitra, Kaushik and Sankaranarayanan, Aswin and Veeraraghavan, Ashok},
year={2014}
organization={ACM} }