Chapter 5 Conclusion and Future Work
5.2 Future work
There are some extensions about this dissertation. The first one is about demosaicking strategy. If the performance improvement between recursive approach and bilinear interpolation is fewer in particular region, we can just use bilinear interpolation. That is to say, while process in flat region which does not have high-frequency component, we can simply run bilinear interpolation. When encounter the artifacts-prone area, and then use more complicate and more useful algorithm.
According to this skill, we can be able to save lots of computation time and reduce the complexity. But the question is how to recognize between the low-frequency and
high-frequency region? This is another research material.
The second one is about the narrow-band gastrointestinal image endoscopic system.
Our ideal is to display color NBI. But the current combination way is designed so that 415nm image is assigned to B and G plane and 540 nm image is assigned to R plane.
However, the color of this image is pseudo-color. If we capture the image by emitting white light and NB light simultaneously [see Fig. 5.1], we can obtain the normal color which human perceived normally while demosaicking. But the influences of emitting white light and NB light at the same time are being ambiguous. This problem is left as a future work.
Fig. 5.1 Expected sensor structure capsule endoscope system
References
[1] B. E. Bayer, ”Color imaging array,” U.S. Patent 3 971 065, July 1976.
[2] B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schafer, and R. M. Mersereas,
“ Demosaicking: color filter array interpolation,” IEEE Signal Process. Mag., vol.
22, no. 1, pp. 44-54, Jan. 2005.
[3] R. Kimmel, “Demosaicing: image reconstruction from color CCD samples,”
IEEE Trans. Image Processing, vol. 7, no. 3, pp. 1221-1228, Sep. 1999.
[4] D. Cok, “Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal,” U.S. Patent 4 642 678, Feb. 1987.
[5] J. E. Adams, “Interactions between color plane interpolation and other image processing functions in electronic photography,” Proc. SPIE, vol. 2416, pp.
144-151, Feb. 1995
[6] T. Kuno, H. Sugiura, and N. Matoba, “New interpolation method using discriminated color correlation for digital still cameras,” IEEE Trans. Consumer Electron., vol. 45, no. 1, pp. 259-267, Feb. 1999.
[7] T. Usui et al., “Studies on image coding using correlation between lightness and chrominance,” Color forum JAPAN ’98, 10-3, 133-136, 1998.
[8] T. W. Freeman, “Median filter for reconstructing missing color samples,” U.S.
Patent 4 724 395, 1988.
[9] S. Moriya et al., “Advanced demosaicking method based on the changes of colors in a local region,” IEEE Trans. Consumer Electron., vol. 52, no. 1, pp.
206-214, Feb. 2006
[10] W. Lu and Y. P. Tan, “Color filter array demosaicking: new method and performance measures,” IEEE Trans. Image Processing, vol. 12, no. 10, pp.
1194-1210, Oct. 2003
[11] C. Laroche and M. Prescott, “Apparatus and method for adaptively interpolation a full color image utilizing chrominance gradients,” U.S. Patent 5 373 322, Dec.
1994.
[12] J. Hamilton and J. Adams, “Adaptive color plane interpolation in single sensor color electronic camera,” U.S. Patent 5 629 734, May 1997.
[13] J. Adams, “Design of practical color filter array interpolation algorithms for digital cameras,” Proc SPIE, vol. 3028, pp. 117-125, Feb. 1997
[14] X. Li and M. T. Orchard, “New edge-directed interpolation,” IEEE Trans. Image Processing, vol. 10, no. 10, pp. 1521-1527, Oct. 2001
[15] B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, “Color plane interpolation using alternating projections,” IEEE Trans. Image Processing, vol. 11, no. 9, pp.
997-1013, Sep. 2002.
[16] H. A. Chang and H. H. Chen, “Stochastic color interpolation for digital cameras,”
IEEE Trans. Circuit and systems for video technology, vol. 17, no. 8, pp. 964-973, Aug. 2007.
[17] H. J. Trussell and R. E. Hartwig, “Mathematics for demosaicking,” IEEE Trans.
Image Processing, vol. 3, no. 4, pp. 485-492, Apr. 2002.
[18] L. Zhang and X. Wu, “Color demosaicking via directional linear minimum mean square-error estimation,” IEEE Trans. Image Processing, vol. 14, no. 12, pp.
2167-2178, Dec. 2005
[19] D. D. Muresan and T. W. Parks, “Adaptively quadratic (AQua) image interpolation,” IEEE Trans. Image Processing, vol. 13, no. 5, pp. 690-698, May 2004.
[20] X. Li, “Demosaicing by successive approximation,” IEEE Trans. Image Processing, vol. 14, no. 3, pp. 370-379, Mar. 2005.
[21] X. Wu and L. Zhang, “Temporal color video demosaicking via motion estimation and data fusion,” IEEE Trans. Circuit Syst Video Technl, vol. 16, no. 2, pp.
231-240, Feb. 2006.
[22] K. Hirakawa and T. W. Parks, “Adaptive homogeneity-directed demosaicking algorithm,” IEEE Trans. Image Processing, vol. 14, no. 3, pp. 360-369, Mar.
2005.
[23] D. Alleysson, S. Süsstrunk and J. Hérault, “Linear demosaicing inspired by the human visual system,” IEEE Trans. Image Processing, vol. 14, no. 4, pp.
439-449, Apr. 2005.
[24] “Recommendations of uniform color space, color difference equations, psychrometric color terms,” CIE, Supplement no. 2 to CIE publication no.
15(E.-1 31) 1971/(TC-1.3), 1978.
[25] M. Mahy, E. Van, and O. A., “Evaluation of uniform color spaces developed after the adoption of CIELAB and CIELUV,” Color Res. Application, vol. 19, no. 2, pp. 105-121, 1994.
[26] [Online] Available: http://www.cs.technion.ac.il/~ron/Demosaic/
[27] K. Gono, “Multifunctional endoscopic imaging system for support of early cancer diagnosis,” IEEE Journal of Selected Topics in Quantum Electronics, vol.
14, no. 1, pp. 62-69, Jan.-Feb. 2008.
[28] K. Gono, K. Yamazaki, N. Doguchi, T. Obi, M. Yamagichi, N. Ohyama, H.
Machida, Y. Saono, S. Yoshida, Y. Hamamoto, and T. Endo, “Endoscopic observation of tissue by narrowband illumination,” Opt. Rev., vol. 10, pp.
211-215, 2003.
[29] K. Gono, T. Obi, M. Yamaguchi, N. Ohyama, H. Machida, Y, Sano, S. Yoshida, Y.
Hamamoto, and T. Endo, “Appearance of enhanced tissue features in narrowband endoscopicimagine,” J. Biomed. Opt., vol. 9, pp. 568-577, May/Jun. 2004.
[30] D. L. MacAdam, Selected Papers on Colorimetry Fundamentals, SPIE Milestone Series, Bellingham, WA, USA, 1993.
[31] E. R. Kandal, J. H. Schwartz and T. M. Jessell, Principle of Neutral Science, 4th ed., pp. 507-513, McGraw-Hill, NY, USA, 2000.
[32] R. C. Gonzalez and R. E. Woods, Digital Image Processing, 3rd ed., pp. 395, Pearson Prentice-Hall, Inc., USA, 2007.
[33] G. Sharma and H. J. Trussell, “Digital color imaging,” IEEE Trans. Image Processing, vol. 6, no. 7, pp. 901-932, July, 1997.
[34] J. Guild, “The colorimetric properties of the spectrum,” Philosophical Trans. of the Royal Society of London, vol. 230, pp. 149-187, 1931.
[35] A. C. Harris and I. L. Weatherall, “Objective evaluation of colour variation in the sand-burrowing beetle Chaerodes trachyscelides White (Coleoptera:
Tenebrionidae) by instrumental determination of CIELAB values,” Journal of the Royal Society of New Zealand, vol. 20, no. 3, pp. 253-259, Sep. 1990.
[36] [Online] Available: http://www.color.org/sRGB.xalter
[37] M. S. Kiver, Color Television Fundamentals, pp. 323, McGraw-Hill, NY, USA, 1964.
[38] [Online] Available: http://www.fho-emden.de/~hoffmann/ciexyz29082000.pdf [39] Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, “Image quality
assessment: From error visibility to structural similarity,” IEEE Trans. Image Proc., vol. 13, no. 4, pp. 600-612, Apr. 2004.
[40] B. Girod, “What’s wrong with mean-squared error,” in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp.207-220.
[41] A. M. Eskicioglu and P. S. Fisher, “Image quality measures and their performance,” IEEE Trans. Commun., vol. 43, pp. 2959-2965, Dec. 1995.
[42] [Online] Available: http://www.ece.uwaterloo/%7Ez70wang/research/ssim/
[43] K. Topfer, J. E. Adams and B. W. Keekan, “Modulation transfer functions and aliasing patterns of CFA interpolation algorithms,” Proc. IS&T PICS, pp.
367-370, Portland, OR, 1998.
[44] R. Lyon and P. Hubel, “Eyeing the camera: Into the next century,” IS&T/TSID 10th Color Imaging Conf. Proceedings, pp. 349-355, Scottsdale, AZ, USA, 2002.
[45] [Online] Available: http://www.brucelindbloom.com/index.html?ColorCheckerC alculator.html
[46] R. B. Merrill, “Color separation in an active pixel cell imaging array using a triple-well structure,” U.S. Patent 5 965 875, Oct. 1999.