Can we Beat Hadamard Multiplexing? Data-driven Design and Analysis for Computational Imaging Systems

Description

Computational Imaging (CI) systems that exploit optical multiplexing and algorithmic demultiplexing have been shown to improve imaging performance in tasks such as motion deblurring, extended depth of field, light field and hyper-spectral imaging. Design and performance analysis of many of these approaches tend to ignore the role of image priors. It is well known that utilizing statistical image priors significantly improves demultiplexing performance. In this paper, we extend the Gaussian Mixture Model as a data-driven image prior proposed by Mitra et. al, 2014 to under-determined linear systems and study compressive CI methods such as light-field and hyper-spectral imaging. Further, we derive a novel algorithm for optimizing multiplexing matrices that simultaneously accounts for (a) sensor noise (b) image priors and (c) CI design constraints. We use our algorithm to design data-optimal multiplexing matrices for a variety of existing CI designs, and we use these matrices to analyze the performance of CI systems as a function of noise level. Our analysis gives new insight into the optimal performance of CI systems, and how this relates to the performance of classical multiplexing designs such as Hadamard matrices.

Publications

  1. K. Mitra, O. Cossairt and A. Veeraraghavan, “Can we Beat Hadamard Multiplexing? Data-driven Design and Analysis for Computational Imaging Systems”, IEEE International Conference on Computational Photography (ICCP), 2014.

Related publications

  1. K. Mitra, O. Cossairt and A. Veeraraghavan, “A Framework for Analysis of Computational Imaging Systems: Role of Signal Prior, Sensor Noise and Multiplexing”, IEEE Transactions on Pattern Analysis and Machine Learning (TPAMI), 2014.

  2. O. Cossairt, A. Veeraraghavan, K. Mitra and M. Gupta, “Performance Bounds for Computational Imaging”, Imaging and Applied Optics Technical Papers, OSA, 2013.

  3. K. Mitra, O. Cossairt and A. Veeraraghavan, “To Denoise or Deblur: Parameter Optimization for Imaging Systems”, SPIE Electronic Imaging, 2014.