Augmented Reality

The augmented reality (AR) technology offers the users a more flexible way to interact with digital contents. With the help of AR techniques, the rendering of a scanned object can update according to the environment surrounded or controlled by a user. For example, the view of a digital model can be determined by computing the homography transformation between the camera pixels and the feature points of fiducial markers. That way the object can be viewed from different directions by changing the pose of camera relative to the markers.

Combing with AR, the reconstructed objects can be used for entertaining or educational purposes.

Bibliography

[1] J. Morris, R. Haeusler, R. Jiang, K. Jawed, R. Kalarot, T. Khan, W. Khan, S. Manoharan, S. Morales, T. Vaudrey, J. Wiest, and R. Klette, “Current work in the .enpeda.. project,”

Image and Vision Computing New Zealand, 2009. IVCNZ '09. 24th International Conference, 2009, pp. 130-135.

[2] B.K. Horn, Shape from Shading: a Method for Obtaining the Shape of a Smooth Opaque Object from One View, Massachusetts Institute of Technology, 1970.

[3] R. Zhang, P. Tsai, J.E. Cryer, and M. Shah, “Shape from Shading: A Survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, 1999, pp. 690-706.

[4] A. Criminisi, M. Kemp, and A. Zisserman, “Bringing pictorial space to life: computer techniques for the analysis of paintings,” Proc. Computers and the History of Art (CHArt), 2002, pp. 77-99.

[5] R.J. Woodham, “Photometric method for determining surface orientation from multiple images,” Shape from shading, MIT Press, 1989, pp. 513-531.

[6] R. Klette and K. Schlüns, “Height Data From Gradient Fields,” Proceedings of machine vision applications, architectures, and systems integration, vol. 2908, 1996, pp. 204-215.

[7] Z. Wu and L. Li, “A line-integration based method for depth recovery from surface normals,” Computer Vision, Graphics, and Image Processing, vol. 43, Jul. 1988, pp.

53-66.

[8] R. Klette, K. Schluns, and A. Koschan, Computer Vision: Three-Dimensional Data from Images, Springer, 1998.

[9] Y. Furukawa and J. Ponce, “Accurate, Dense, and Robust Multi-View Stereopsis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, 2010, pp. 1362-1376.

[10] M. Ribo and M. Brandner, “State of the art on vision-based structured light systems for 3D measurements,” International Workshop on Robotic Sensors: Robotic and Sensor Environments, 2005., Ottawa, ON, Canada: , pp. 2-7.

[11] H.J. Chien, C.Y. Chen, and C.F. Chen, “Reconstruction of Cultural Artifact Using

Structured Lighting with Densified Stereo Correspondence,” Arts and Technology, 2010, pp. 239-246.

[12] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, “Three-Dimensional Face Recognition,” International Journal of Computer Vision, vol. 64, 2005, pp. 5-30.

[13] N.S. Ali, “Reverse Engineering of Automotive Parts Applying Laser Scanning and Structured Light Techniques,” Master thesis, University of Tennessee, 2005.

[14] G. Zhang, Z. Wei, and X. Li, “3D Double-Vision Inspection Based on Structured Light,”

Journal of Manufacturing Science and Engineering, vol. 125, 2003, pp. 617-623.

[15] C. Liebe, C. Padgett, J. Chapsky, D. Wilson, K. Brown, S. Jerebets, H. Goldberg, and J.

Schroeder, “Spacecraft hazard avoidance utilizing structured light,” Aerospace Conference, 2006 IEEE, 2006, p. 10 pp.

[16] “InSpeck 3D Mega Capturor II from ThingLab UK,” URL:

"http://www.thinglab.co.uk/scanning_product.php?

URL_=product_digiscan_inspeck_megacapturor_2&SubCatID_=31".

[17] “3D3 Solution - HDI 3D Models,” URL:

"http://www.3d3solutions.com/products/hardware/model.php".

[18] J. Godbaz, M. Cree, and A. Dorrington, “Undue influence: Mitigating range-intensity coupling in AMCW ‘flash’ lidar using scene texture,” Image and Vision Computing New Zealand, 2009. IVCNZ '09. 24th International Conference, 2009, pp. 304-309.

[19] Y.Y. Chung, “3D model reconstruction with adjustable colors and resolution light source based on regions of interest,” Master thesis, I-Shou University, 2007.

[20] R. Singh, D.P. Chapman, and K.B. Atkinson, “CCD-based active triangulation for rock surface measurement,” Sep. 1995.

[21] V. De Wansa Wickramaratne, V. Ryazanov, and A. Vinogradov, “Analysis of a 3D face-scanning system by active triangulation,” Pattern Recognition and Image Analysis, vol.

19, Mar. 2009, pp. 78-83.

[22] R. Furukawa and H. Kawasaki, “Dense 3D Reconstruction with an Uncalibrated Stereo System using Coded Structured Light,” Computer Vision and Pattern Recognition Workshop, Los Alamitos, CA, USA: IEEE Computer Society, 2005, p. 107.

[23] R. Hartley and P. Sturm, Triangulation, General Electric CRD, Schenectady, New York:

1995.

[24] F. Gabriel, H. Natalia, and M. Joan, Plane-based calibration of a projector-camera system, 2008.

[25] A.M. Bronstein, M.M. Bronstein, E. Gordon, and R. Kimmel, High-resolution structured light range scanner with automatic calibration, Department of Computer Science, Technion, Israel, .

[26] H. Zollner and R. Sablatnig, Comparison of methods for geometric camera calibration using plane calibration targets, Vienna University of Technology, Pattern and Image Processing Group (PRIP), 2004.

[27] M. Ashdown, M. Flagg, R. Sukthankar, J. Rehg, M. Ashdown, M. Flagg, R. Sukthankar, and J.M. Rehg, “A Flexible Projector-Camera System for Multi-Planar Displays,” In proceedings of computer vision and pattern recognition, vol. 2, 2003, pp. 165--172.

[28] R.R. Jeroen, J. Vanbaar, and P. Beardsley, “Display Grid: Ad-hoc Clusters of Autonomous Projectors.”

[29] J.C. Lee, J.C. Lee, P.H. Dietz, P.H. Dietz, D. Maynes-Aminzade, D. Maynes-aminzade, S.E. Hudson, and S.E. Hudson, “Automatic Projector Calibration with Embedded Light Sensors,” In proceedings of UIST 2004, vol. 1, 2004, pp. 123--126.

[30] D.B. Nathaniel, “Calibration and Component Placement in Structured Light Systems for 3D Reconstruction Tasks,” University of Minnesota, 2009.

[31] X. Chen, J. Xi, Y. Jin, and J. Sun, “Accurate calibration for a camera-projector measurement system based on structured light projection,” Optics and Lasers in Engineering, vol. 47, pp. 310-319.

[32] G.G. Mateos, A Camera Calibration Technique Using Targets of Circular Features, Department of Computer Science and Systems, University of Murcia: 2000.

[33] Zhan Song and R. Chung, “Use of LCD Panel for Calibrating Structured-Light-Based Range Sensing System,” IEEE Transactions on Instrumentation and Measurement, vol.

57, 2008, pp. 2623-2630.

[34] S. Zhang and P.S. Huang, “Novel method for structured light system calibration,”

Optical Engineering, vol. 45, 2006, pp. 083601-8.

[35] W. Gao, L. Wang, and Z. Hu, “Flexible Calibration of a Portable Structured Light System through Surface Plane,” Acta Automatica Sinica, vol. 34, Nov. 2008, pp. 1358-1362.

[36] D. Cotting, I. Nebel, M. Gross, and H. Fuchs, Towards a Continuous, Unified Calibration of Projectors and Cameras, Zürich: ETH, 2007.

[37] D.G. Aliaga and Y. Xu, “Photogeometric Structured Light: A Self-Calibrating and Multi-Viewpoint Framework for Accurate 3D Modeling,” 2008.

[38] Y. Li and S.K. Lee, “Stratified Self-calibration and Metric Reconstruction of a Trinocular Structured Light Vision System,” Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007), Montreal, QC, Canada: 2007, pp. 328-336.

[39] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2004.

[40] A. Dipanda and S. Woo, “Towards a real-time 3D shape reconstruction using a structured light system,” Pattern Recognition, vol. 38, 2005, pp. 1632-1650.

[41] J. Salvi, J. Pagès, and J. Batlle, “Pattern codification strategies in structured light systems,” Pattern Recognition, vol. 37, Apr. 2004, pp. 827-849.

[42] A. Dipanda, S. Woo, F. Marzani, and J.M. Bilbault, “3-D shape reconstruction in an active stereo vision system using genetic algorithms,” Pattern Recognition, vol. 36, 2003, pp. 2143-2159.

[43] A.K. Wong, P. Niu, and X. He, “Fast acquisition of dense depth data by a new structured light scheme,” Computer Vision and Image Understanding, vol. 98, Jun. 2005, pp. 398-422.

[44] J. Pagès, J. Salvi, C. Collewet, and J. Forest, “Optimised De Bruijn patterns for one-shot shape acquisition,” Image and Vision Computing, vol. 23, Aug. 2005, pp. 707-720.

[45] C. Chen, Y. Hung, C. Chiang, and J. Wu, “Range data acquisition using color structured lighting and stereo vision,” Image and Vision Computing, vol. 15, Jun. 1997, pp. 445-456.

[46] T.P. Koninckx, I. Geys, T. Jaeggli, and L.V. Gool, “A Graph Cut based Adaptive Structured Light Approach for Real-Time Range Acquisition,” 3D Data Processing Visualization and Transmission, International Symposium on, Los Alamitos, CA, USA:

IEEE Computer Society, 2004, pp. 413-421.

[47] H.J. Chien, C.Y. Chen, C.F. Chen, Y.M. Su, and Y.Y. Chang, “Adaptive 3D

Reconstruction system with improved recovery of miscoded region to automatically adjust projected light patterns,” IVCNZ08, 2008, pp. 1-6.

[48] K. Fujii, M. Grossberg, and S. Nayar, “A projector-camera system with real-time photometric adaptation for dynamic environments,” 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), San Diego, CA, USA: 2005, pp. 814-821 vol. 1.

[49] J. Batlle, E. Mouaddib, and J. Salvi, “Recent progress in coded structured light as a technique to solve the correspondence problem: a survey, Pattern Recognition 31 (7,”

1998, pp. 963--982.

[50] R.A. Jarvis, “A Perspective on Range Finding Techniques for Computer Vision,” PAMI, vol. 5, Mar. 1983, pp. 122-139.

[51] M. Asada, H. Ichikawa, and S. Tsuji, “Determining Surface Orientation by Projecting a Stripe Pattern,” PAMI, vol. 10, Sep. 1988, pp. 749-754.

[52] Z. Wei, F. Zhou, and G. Zhang, “3D coordinates measurement based on structured light sensor,” Sensors and Actuators A: Physical, vol. 120, May. 2005, pp. 527-535.

[53] S.Y. Chen, Y.F. Li, S. Member, and J. Zhang, “Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light.”

[54] A. Kazantsev and E. Petriu, “Robust pseudo-random coded colored structured light technique for 3D object model recovery,” Robotic and Sensors Environments, 2008.

ROSE 2008. International Workshop on, 2008, pp. 150-155.

[55] C. Huang, “An improved method for the binarization in structured light 3D scanning systems,” Journal of Lunghwa University of Science and Technology, vol. 24, 2007.

[56] F. Remondino and C. Fraser, “Digital camera calibration methods: considerations and comparisons,” International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences,, 2006.

[57] B.K. Horn, Tsai's Camera Calibration Method Revisited, Massachusetts Institute of Technology, 2000.

[58] D. Lanman and G. Taubin, “Build your own 3D scanner: 3D photography for

beginners,” ACM SIGGRAPH 2009 Courses, New Orleans, Louisiana: ACM, 2009, pp.

1-94.

[59] J. Draréni, P. Sturm, and S. Roy, “Projector Calibration Using a Markerless Plane,”

Lisbon, Portugal: 2009, pp. 377-382.

[60] N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Transactions on Systems, Man and Cybernetics, vol. 9, Jan. 1979, pp. 66, 62.

[61] Y. Furukawa and J. Ponce, “Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment,” Int. J. Comput. Vision, vol. 84, 2009, pp. 257-268.

[62] F.M. Wahl, “A Coded Light Approach for Depth Map Acquisition,” Mustererkennung 1986, 8. DAGM-Symposium, Springer-Verlag, 1986, pp. 12-17.

[63] K. Sato and S. Inokuchi, “Three-dimensional surface measurement by space encoding range imaging,” 1985.

[64] S. D and L. A, “Range Image Acquisition of Objects with Non-Uniform Albedo Using Structured Light Range Sensor,” Proceedings of the International Conference on Pattern Recognition - Volume 1, IEEE Computer Society, 2000, p. 1778.

[65] E. Horn and N. Kiryati, “Toward Optimal Structured Light Patterns,” IMAGE AND VISION COMPUTING, vol. 17, 1997, pp. 87--97.

[66] L. Bergroth, H. Hakonen, and T. Raita, “A Survey of Longest Common Subsequence Algorithms,” Proceedings of the Seventh International Symposium on String Processing Information Retrieval (SPIRE'00), IEEE Computer Society, 2000, p. 39.

[67] T.P. Koninckx, P. Peers, P. Dutre, and L.V. Gool, “Scene-Adapted Structured Light,”

Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02, IEEE Computer Society, 2005, pp. 611-618.

[68] Y. Xu and D.G. Aliaga, “Robust pixel classification for 3D modeling with structured light,” Proceedings of Graphics Interface 2007, Montreal, Canada: ACM, 2007, pp.

233-240.

[69] R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, Wiley-Interscience, 2000.

[70] D. Cvetkovic, P. Rowlinson, and S. Simic, Eigenspaces of Graphs, Cambridge University Press, 1997.

[71] Z. Zhang, “Iterative point matching for registration of free-form curves and surfaces,”

International Journal of Computer Vision, vol. 13, Oct. 1994, pp. 119-152.

[72] “MeshLab,” URL: "http://meshlab.sourceforge.net".

[73] M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S.

Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk, “The digital Michelangelo project: 3D scanning of large statues,” Proceedings of the 27th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., 2000, pp. 131-144.