Computational Photography
Digital Visual Effects g Yung-Yu Chuang
with slides by Fredo Durand Ramesh Raskar Sylvain Paris Soonmin Bae Amit Agrawal with slides by Fredo Durand, Ramesh Raskar, Sylvain Paris, Soonmin Bae, Amit Agrawal, Ramesh Raskar
Computational photography
wikipedia:
C i l h h f b dl
Computational photography refers broadly to computational imaging techniques that enhance
t d th biliti f di it l h t h or extend the capabilities of digital photography.
The output of these techniques is an ordinary h t h b t th t ld t h b photograph, but one that could not have been taken by a traditional camera.
What is computational photography
• Convergence of image processing, computer vision computer graphics and photography vision, computer graphics and photography
• Digital photography:
– Simply mimics traditional sensors and recording by digital technology
I l l i l i i
– Involves only simple image processing
• Computational photography
– More elaborate image manipulation, more computation
– New types of media (panorama, 3D, etc.)
– Camera design that take computation into account
Computational photography
• One of the most exciting fields.
S i C i l Ph h d
• Symposium on Computational Photography and Video, 2005
• Full-semester courses in MIT, CMU, Stanford, GaTech, University of Delaware
• A new book by Raskar and Tumblin in SIGGRAPH 2007.
• IEEE International Conference on computational Photography San Francisco 2009
Photography, San Francisco, 2009.
Siggraph 2006 Papers (16/86=18.6%) gg p p ( )
Hybrid Images Drag-and-Drop Pasting
Two-scale Tone Management for Photographic Look Two scale Tone Management for Photographic Look Interactive Local Adjustment of Tonal Values Image-Based Material Editing
Flash Matting
Natural Video Matting using Camera Arrays Removing Camera Shake From a Single Photograph Coded Exposure Photography: Motion Deblurring Photo Tourism: Exploring Photo Collections in 3D Photo Tourism: Exploring Photo Collections in 3D AutoCollage
Photographing Long Scenes With Multi-Viewpoint Panoramas Projection Defocus Analysis for Scene Capture and Image Display M lti i R di l C t di t i I i f S C t
Multiview Radial Catadioptric Imaging for Scene Capture Light Field Microscopy
Fast Separation of Direct and Global Components of a Scene Using High Frequency Illumination
Siggraph 2007 Papers (23/108=21.3%) gg p p ( )
Image Deblurring with Blurred/Noisy Image Pairs Photo Clip Art
Scene Completion Using Millions of Photographsp g g p
Soft Scissors: An Interactive Tool for Realtime High Quality Matting Seam Carving for Content-Aware Image Resizing
Detail-Preserving Shape Deformation in Image Editing Veiling Glare in High Dynamic Range Imaging Veiling Glare in High Dynamic Range Imaging
Do HDR Displays Support LDR content? A Psychophysical Evaluation Ldr2hdr: On-the-fly Reverse Tone Mapping of Legacy Video and Photographs Rendering for an Interactive 360-Degree Light Field Display
Multiscale Shape and Detail Enhancement from Multi light Image Collections Multiscale Shape and Detail Enhancement from Multi-light Image Collections Post-Production Facial Performance Relighting Using Reflectance Transfer Active Refocusing of Images and Videos
Multi-aperture Photography
Dappled Photography: Mask-Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing
Image and Depth from a Conventional Camera with a Coded Aperture Capturing and Viewing Gigapixel Images
Efficient Gradient-Domain Compositing Using Quadtrees Image Upsampling via Imposed Edges Statistics Joint Bilateral Upsampling
Factored Time-Lapse Videop Computational Time-Lapse Video
Real-Time Edge-Aware Image Processing With the Bilateral Grid
Siggraph 2009 Papers (17/78=21.8%)
Gaussian KD-Trees for Fast High-Dimensional Filtering Edge-Avoiding Wavelets and their Applications Multi-operator Media Retargeting
PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing Modeling Human Color Perception under Extended Luminance Levels
Moving Gradients: A Path-Based Method for Plausible Image Interpolation Optimizing Content-Preserving Projections for Wide-Angle Images Content-Preserving Warps for 3D Video Stabilization
Visio-lization: Generating Novel Facial Images Coordinates for Instant Image Cloning SkyFinder: Attribute-based Sky Image Search Paint Selection
Video SnapCut: Robust Video Object Cutout Using Localized Classifiers Invertible Motion Blur in Video
Dark Flash Photography
4D Frequency Analysis of Computational Cameras for Depth of Field Extension Bokode: Imperceptible Visual Tags for Camera-based Interaction from a Distance p p g
