Fine Depth Resolution

Because of the limitation of the searching range in stereo match algorithm as well as the size of pixel, the depth rendering is confined within a specific range of disparity. DERS can tolerate the disparity within 100 pixels, so the larger the pitch of lens array is, the farther positions can be rendered correctly. On the other hand, if the objects is remote from the camera, the disparity smaller than one pixel will not be recorded. As a result, given the size of pixel and the pitch of lens array, the bounded depth range can be calculated as the following equations.

(39)

where p and g are the pitch and the gap between lens array and sensor respectively, and d is depth from lens array. Because the disparity limit is from 1 pixel to 100 pixels, so the depth range becomes

(40) Accordingly, we can design a system to generate a depth map with fine depth resolution by adjusting the pitch as shown in Figure 5-3 and Figure 5-4. We can use three columns of elemental images (say column3 to column5) to render one HDDR depth map and change

85

another set of three columns of elemental images (say column2, column4, and column6) to render another HDDR depth map. For example, if HDDR-2 region in Figure 5-3 is the conventional range of one depth map with 8-bit gray levels, every object in HDDR-3 region would be regarded as no depth different because they don’t have disparity. However, if we can zoom in the scene along the depth, the objects in HDDR-3 region is no more at the same depth. Accordingly, we can use this technique to generate “high definition” depth maps and resize the depth as conventional 2D images.

Figure 5-3 Horizontal scheme of fine depth resolution design

Figure 5-4 Distribution of lens array with different rendering depth ranges

86

Reference

[1] http://en.wikipedia.org/wiki/Digital_camer [2] http://en.wikipedia.org/wiki/Pulfrich_effect

[3] H. Murata, et al., “A Real-Time 2-D to 3-D Image Conversion Technique Using Computed Image Depth”, SID SYM, Vol. 29, pp. 919-922, 1998.

[4] P. Harman, et al., “ Rapid 2D to 3D Conversion”, In Proc. SPIE, Stereoscopic Displays and Virtual Reality Systems IX, Vol. 4660, pp. 78-86, 2002.

[5] S. Battiato, et al., “Depth-Map Generation by Image Classification”, In Proc. SPIE, Three-Dimensional Image Capture and Applications VI, Vol. 5302, pp. 95-104, 2004.

[6] J. Li, et al., “A Novel Image-Based Rendering System with a Longitudinal Aligned Camera array”, EUROGRAPHICS, 2000.

[7] R. Furukawa, et al., “One-shot entire shape acquisition method using multiple projectors and cameras”, In Fourth (PSIVT) of IEEE Computer Society, pp. 107-114, 2010.

[8] R. Furukawa, et al., “Multiview Projectors/Cameras System for 3D Reconstruction of Dynamic Scenes”, In 4DMOD-Workshop on Dynamic Shape Capture and Analysis 2011, hal-00675085, version 1, 2012.

[9] C. Zhou, et al., “Focal Sweep Camera for Space-Time Refocusing”, Columbia University Computer Science Tech. Reports, 2012.

[10] O. Cossairt and S. Nayar, “ Spectral Focal Sweep: Extended Depth of Field from Chromatic Aberrations”, IEEE Conference on Computational Photography, pp. 1-8.

[11] http://en.wikipedia.org/wiki/Plenoptic_illumination_function

[12] E. H. Adelson and J. Y. A. Wang, “Single Lens Stereo with a Plenoptic Camera”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, No. 2, pp. 99-106, 1992.

[13] R. Ng, et al., “Light Field Photography with a Hand-held Plenoptic Camera”, Stanford Tech Report, CTSR 2005-02, 2005.

[14] A. Stern and B. Javidi, “Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging”, In Proc. IEEE, Vol. 94, No. 3, 2006.

[15] J. Arai, et al., “Gradient-index lens-array method based on real-time integral photography for three-dimensional images”, Applied Optics, Vol. 37, No. 11, 1998.

[16] A. Stern and B. Javidi, “Three-dimensional imaging sensing, visualization, and

processing using integral imaging”, In Proc. IEEE on 3-D technologies for imaging and display, 2006.

[17] Y. T. Lim, et al., “Analysis on enhanced depth of field for integral imaging microscope”, Optics Express, Vol. 20, No. 21, 2012.

[18] J. S. Jang and B. Javidi, “Large depth-of-focus time-multiplexed three-dimensional

87

integral imaging by use of lenslets with nonuniform focal lengths and apture sizes”, Optics Letters, Vol. 28, No. 20, 2003.

[19] M. C. Rau´l, et al., “Progress in 3-D Multiperspective Display by Integral Imaging”, In Proc. IEEE, Vol. 97, No. 6, 2009.

[20] http://www.wisegeek.com/what-is-the-difference-between-monocular-and-binocular- vision.htm

[21] N. Holliman, “3D Display System”, 2005.

[22] L. Hill, et al., “Invited paper: 3-D Liquid Crystal Displays and Their Applications”, IEEE, Vol. 94, No. 3, 2006.

[23] J. Mansson, “Stereovision: A model of human stereopsis”, Lund University Cognitive Science, Tech. Report., 1998.

[24] E. Edirisinghe, et al., “Stereo image, an emerging technology”, SSGRR, L’Aquila, Italy, 2000.

[25] http://www.vision3d.com/stereo.html

[26] G. Woodgate, et al., “Flat panel autostereoscopic displays-characterization and

enhancement”, In Proc. SPIE, Stereoscopic Displays and Virtual Reality Systems VII, Vol. 3957, pp. 153-164, 2000.

[27] H. Morishima, et al., “Rear cross lenticular 3D display without eyeglasses”, In Proc.

SPIE, Stereoscopic Displays and Virtual Reality Systems VII, Vol. 3295, pp. 193-202, Apr. 1998.

[28] Y. Schechner and N. Kiryati, “Depth from Defocus vs. Stereo: How Different Really Are They?”, IEEE International Journal of Computer Vision, Vol. 39, No. 2, pp. 141-162, 2000.

[29] C. Zhou, et al., “Coded Aperture Pairs for Depth from Defocus”, IEEE International Conference on Computer Vision, 2009.

[30] J. Hong, et al., “Three-dimensional display technologies of recent interest: principles, status, and issues. [Invited]”, Applied Optics, Vol. 50, No. 34, 2011.

[31] http://ucalgary.ca/pip369/mod4/depthperception/oculomotor

[32] T. C. Shen, “Autostereoscopic 2D-3D Switching Display with Multi-Electrically Driven Cylindrical Liquid Crystal Lens”, Master, Institute of Electro-Optical Engineering, National Chiao Tung University, Hsinchu, Taiwan, ROC, 2009.

[33] http://ucalgary.ca/pip369/mod4/depthperception/monocular/pictorial [34] http://ucalgary.ca/pip369/mod4/depthperception/movement

[35] http://en.wikipedia.org/wiki/Microscopy

[36] W. J. Smith, “Modern Optical Engineering”, Fourth edition, McGraw-Hill, New York, 2008.

[37] C.M. Sparrow, “On Spectroscopic Resolving Power”, Astrophysical Journal, Vol. 44, pp.76-86, 1916.

88

[38] E. Hecht, “Optics”, Fourth edition, Addison Wesley, San Francisco, 2002.

[39] C. A. Bennett, “Principle of PHYSICAL OPTICS”, 吳忠義等譯，滄海書局，台中，民 國九十八年。

[40] http://en.wikipedia.org/wiki/Hyperfocal_distance

[41] http://en.wikipedia.org/wiki/Compound_microscope#Compound_microscope [42] http://en.wikipedia.org/wiki/Dynamic_range

[43] F.. Houlmann and S. Metz, “High Dynamic Range Rendering in OpenGL”, UTBM.

[44] http://en.wikipedia.org/wiki/Dodging_and_burning

[45] J. Kuang, et al., “Evaluating HDR Rendering Algorithm”, Munsell Color Science Laboratory, Rochester Institute of Technology, Rochester, New York, 2006.

[46] K. Devlin, “A review of tone reproduction techniques”, Tech. Report CSTR-02-005, Department of Computer Science, University of Bristol, 2002.

[47] http://en.wikipedia.org/wiki/HDRI

[48] J. W. Goodman, “Fourier Optics”, Third edition, ROBERTS & COMPANY, Colorado, 2005.

[49] C. Fehn, “Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV”, In Proc. SPIE, Stereoscopic Displays and Virtual Reality System XI, 2004.

[50] http://mpeg.chiariglione.org/about

[51] O. Stankiewicz, et al., “A soft segmentation matching in Depth Estimation Reference Software (DERS) 5.0”, MPEG, M17049, 2009.

[52] A. Olofsson, “Modern Stereo Correspondence Algorithms: Investigation and evaluation”, Master, Institute of systemteknik, Linköping University, Linköping, Sweden, 2010.

[53] Gonzales and Woods, “Digital image processing, 3/e”, 繆紹綱譯，台灣培生教育出版股 份有限公司，台北，民國九十八年。

[54] S. Lӧsch, “Depth from Blur-Combining Image Deblurring and Depth Estimation”, Master, Department of computer science, Saarland University, Saarbrücken, Germany, 2009.

[55] http://www.cse.yorku.ca/~sizints/ctf_stereo/ctf_stereo_main.html [56] http://www.vdwoxford.org/ourwork/#lenstech

[57] http://biomedicalcomputationreview.org/content/3d-angiogenesis-modeled