• 沒有找到結果。

Computational Photography

N/A
N/A
Protected

Academic year: 2022

Share "Computational Photography"

Copied!
31
0
0

加載中.... (立即查看全文)

全文

(1)

Computational Photography

Digital Visual Effects Yung-Yu Chuang

with slides by Fredo Durand, Ramesh Raskar, Sylvain Paris,

Soonmin Bae, Amit Agrawal, Ramesh Raskar

(2)

Computational photography

wikipedia:

Computational photography refers broadly to computational imaging techniques that enhance or extend the capabilities of digital photography.

The output of these techniques is an ordinary

photograph, but one that could not have been

taken by a traditional camera.

(3)

What is computational photography

• Convergence of image processing, computer vision, computer graphics and photography

• Digital photography:

– Simply mimics traditional sensors and recording by digital technology

– Involves only simple image processing

• Computational photography

– More elaborate image manipulation, more computation

– New types of media (panorama, 3D, etc.)

– Camera design that take computation into account

(4)

Computational photography

• One of the most exciting fields.

• Symposium on Computational Photography and Video

, 2005

• Full-semester courses in MIT, CMU, Stanford, GaTech, University of Delaware

• A new book by Raskar and Tumblin in SIGGRAPH 2007.

• IEEE International Conference on computationa l Photography

, San Francisco, 2009.

(5)

Siggraph 2006 Papers (16/86=18.6%)

Hybrid Images

Drag-and-Drop Pasting

Two-scale Tone Management for Photographic Look Interactive Local Adjustment of Tonal Values

Image-Based Material Editing Flash Matting

Natural Video Matting using Camera Arrays

Removing Camera Shake From a Single Photograph Coded Exposure Photography: Motion Deblurring Photo Tourism: Exploring Photo Collections in 3D AutoCollage

Photographing Long Scenes With Multi-Viewpoint Panoramas Projection Defocus Analysis for Scene Capture and Image Display Multiview Radial Catadioptric Imaging for Scene Capture

Light Field Microscopy

Fast Separation of Direct and Global Components of a Scene Using High Frequency Illumination

(6)

Siggraph 2007 Papers (23/108=21.3%)

Image Deblurring with Blurred/Noisy Image Pairs Photo Clip Art

Scene Completion Using Millions of Photographs

Soft Scissors: An Interactive Tool for Realtime High Quality Matting Seam Carving for Content-Aware Image Resizing

Detail-Preserving Shape Deformation in Image Editing Veiling Glare in High Dynamic Range Imaging

Do HDR Displays Support LDR content? A Psychophysical Evaluation

Ldr2hdr: On-the-fly Reverse Tone Mapping of Legacy Video and Photographs Rendering for an Interactive 360-Degree Light Field Display

Multiscale Shape and Detail Enhancement from Multi-light Image Collections Post-Production Facial Performance Relighting Using Reflectance Transfer Active Refocusing of Images and Videos

Multi-aperture Photography

Dappled Photography: Mask-Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing

Image and Depth from a Conventional Camera with a Coded Aperture Capturing and Viewing Gigapixel Images

Efficient Gradient-Domain Compositing Using Quadtrees Image Upsampling via Imposed Edges Statistics

Joint Bilateral Upsampling Factored Time-Lapse Video

Computational Time-Lapse Video

Real-Time Edge-Aware Image Processing With the Bilateral Grid

(7)

Siggraph 2009 Papers (17/78=21.8%)

Gaussian KD-Trees for Fast High-Dimensional Filtering Edge-Avoiding Wavelets and their Applications

Multi-operator Media Retargeting

PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing Modeling Human Color Perception under Extended Luminance Levels

Moving Gradients: A Path-Based Method for Plausible Image Interpolation Optimizing Content-Preserving Projections for Wide-Angle Images

Content-Preserving Warps for 3D Video Stabilization Visio-lization: Generating Novel Facial Images

Coordinates for Instant Image Cloning

SkyFinder: Attribute-based Sky Image Search Paint Selection

Video SnapCut: Robust Video Object Cutout Using Localized Classifiers Invertible Motion Blur in Video

Dark Flash Photography

4D Frequency Analysis of Computational Cameras for Depth of Field Extension

Bokode: Imperceptible Visual Tags for Camera-based Interaction from a Distance

(8)

Scope

• We can’t yet set its precise definition. The following are scopes of what researchers are exploring in this field.

– Record a richer visual experience

– Overcome long-standing limitations of conventional cameras

– Enable new classes of visual signal

– Enable synthesis impossible photos

(9)

Scope

• Image formation

• Color and color perception

• Demosaicing

(10)

Scope

• Panoramic imaging

• Image and video registration

• Spatial warping operations

(11)

Scope

• High Dynamic Range Imaging

• Bilateral

filtering and HDR display

• Matting

(12)

Scope

• Active flash methods

• Lens technology

• Depth and defocus

No-flash

Flash

our

result

(13)

Removing Photography Artifacts using Gradient

Projection and Flash-Exposure Sampling

(14)

Continuous flash

Flash = 0.0

Flash = 0.3 Flash = 0.7 Flash = 1.4

Flash = 1.0

(15)

Flash matting

(16)

Depth Edge Detection and Stylized

Rendering Using a Multi-Flash Camera

(17)

Dark flash photography

(18)

Motion-Based Motion Deblurring

(19)

Removing Camera Shake from a

Single Photograph

(20)

Motion Deblurring using Fluttered Shutter

(21)

Scope

• Future cameras

• Plenoptic function and light fields

(22)

Scope

• Gradient image manipulation

(23)

Scope

• Non-parametric image synthesis, inpainting,

analogies

(24)

Scope

Motion

analysis

(25)

Image Inpainting

(26)

Object Removal by

Exemplar-Based Inpainting

(27)

Image Completion with

Structure Propagation

(28)

Lazy snapping

(29)

Grab Cut - Interactive Foreground

Extraction using Iterated Graph Cuts

(30)

Tools

• Graph cuts,

– Segmentation and mosaicing

• Gradient domain operations,

– Tone mapping, fusion and matting

• Bilateral filters,

– Denoising, image enhancement

參考文獻

相關文件

• It is a plus if you have background knowledge on computer vision, image processing and computer graphics.. • It is a plus if you have access to digital cameras

• Tone distribution and contrast ÎModified based on model

Two-scale Tone Management for Photographic Look Interactive Local Adjustment of Tonal Values Image-Based Material Editing..

BhaktiYoga Counseling and Training Centre Limited.. Kinesics and Context: Essays on Body Motion Communication. Philadelphia: University of Pennsylvania Press. Photo

• Johannes Kopf, Michael Cohen, Dani Lischinski, Matt Uyttendaele, Joint Bilateral Upsampling, SIGGRAPH 2007. • Jiawen Chen, Sylvain Paris, Fredo Durand, Real-time Edge-Aware

projected texture Active depth from defocus Active depth from defocus Photometric stereo Photometric stereo.. time of flight time

structure for motion: automatic recovery of camera motion and scene structure from two or more images.. It is a self calibration technique and called automatic camera tracking

• In Shutter-speed priority mode, photographers sets the shutter speed and the camera deduces the aperture. • In Program mode, the camera decides both exposure and shutter