This course is NOT about …

108  Download (0)

全文

(1)

Course overview

Digital Visual Effectsg Yung-Yu Chuang

(2)

Logistics

• Meeting time: 2:20pm-5:20pm, Wednesday

Cl CSIE R 104

• Classroom: CSIE Room 104

• Instructor: Yung-Yu Chuang (cyy@csie.ntu.edu.tw)

• Teaching assistants: 黃子桓

• Textbook: Readings from books journals and

• Textbook: Readings from books, journals and proceedings.

• Webpage: (user name/password)

• Webpage: (user name/password)

http://www.csie.ntu.edu.tw/~cyy/vfx M ili li t

• Mailing list: vfx@cmlab.csie.ntu.edu.tw subscribe via https://cmlmail.csie.ntu.edu.tw/mailman/listinfo/vfx/

(3)

This course is NOT about …

This course is NOT about …

(4)

It isn’t about photography

(5)

It isn’t about 3D animations

(6)

It isn’t about watching movies

(7)

It isn’t about physical effects

(8)

It’s not about industrial tricks

You will learn more about Taylor and Poisson than Lucas and Spielberg in this course If you hear Lucas in the class and Spielberg in this course. If you hear Lucas in the class, it is more likely to refer to Bruce Lucas, not George Lucas.

computer graphics computer

vision

graphics

image processing processing

(9)

Prerequisites

• It is a must that you have programming experiences

experiences.

• It is a must that you have basic knowledge on li l b d b bilit

linear algebra and probability.

• It is a plus if you have background knowledge on computer vision, image processing and

computer graphics.

• It is a plus if you have access to digital cameras and camcorders.

(10)

Warning from previous students

‧請學期初老師要多提醒這門課的困難 度請興趣或實力不足的同學勿修,否 則就會像我一樣停修 XD

則就會像我一樣停修 XD

(11)

This course is about …

This course is about …

(12)

Digital Visual Effects

(13)

Reality?

(14)

Retouching

(15)

Iraq War, LA Times, April 2003

Digital photomontage

(16)

Bush campaign’s TV AD, 2004

(17)

Texture synthesis and inpainting

(18)

Domestic example

The Liberty Times 2007 12 17

2007.12.17

(19)

Special effects

Special effects

(20)

Stop action

The execution of Mary 1895 The execution of Mary, 1895

(21)

Glass shot

(22)

Rear projection

stop motion

King Kong 1933 King Kong, 1933

(23)

Special effects (make-up)

(24)

Special effects (physical effects)

(25)

Special effects (miniature)

(26)

Special effects (matte painting)

(27)

Lord of the Rings

(28)

Illusion - forced perspective

(29)

Computer-generated model

(30)

Visual effects 100 Years

(31)

Production pipeline

Production pipeline

(32)

Production pipeline

Preproduction Production

Effects

Artwork Reference Stills Plates

Storyboard

Post-production

Editing

VFX g

Music Music

Sound

Film

(33)

Preproduction

Storyboard Storyboard

(34)

Preproduction

Artwork

(35)

Preproduction

Reference & Research Reference & Research

(36)

Production

Shooting Shooting

(37)

Post-production

(38)

Visual effects production

Preproduction Production

Effects

Artwork Reference Stills Plates

Scanning Storyboard

Post-production

Matchmove and Matchmodel Model Geometry

Effects Animation

Character Animation

Ski i

Lighting and Rendering Skeleton Textures

M i l

Skinning Rendering

Compositing

Assets Shots

Materials

Assets Shots

Film Recording

(39)

Visual effects post-production

(40)

A case study

A case study

(41)

405: The Movie

• This movie were created solely by two visual

effects artists in the year of 2000 It was a process effects artists in the year of 2000. It was a process that took over three months of nights, weekends and any spare moments that they could find.

and any spare moments that they could find.

• http://www.405themovie.com/

(42)

405: The Movie

(43)

Making of 405

Step 0: script and shooting plan

(44)

Making of 405

Step 1: shooting

two days with a Canon Optura DV camera with progressive mode.

 a 70-minute raw footage initial editing

 pickup shots

 pickup shots

(45)

Making of 405

Step 2: building CG world

total 62 shots, 42 enhanced with digital VFX.

19 shots are entirely digital creations.

plane, two cars, freeway background are digital

photo-based 3D environment

(46)

Making of 405

Real cars were used for close-up and interior shots

A low-resolution mesh scanned b b

by a cyberscanner.

Mapped with photographs.

(47)

Making of 405

DC-10 plane took a month to model in details for the to model in details for the needs of close-up shots.

59 objects, 142,439 polygons

reference modeling material painting

(48)

Making of 405

Step 3: traffic clearing clean plate

close-up shots

inpainting inpainting

(49)

Making of 405

Step 4: compositing

h t ith th hi l t di till i b k d shot with the vehicle standing still in a backyard

(50)

Making of 405

(51)

Making of 405

Step 5: fine touchup

3D hat compositing and inpaintingp g p g

(52)

Making of 405

Step 6: music and delivery

(53)

Bloody Omaha

(54)

Dan Schick VFX Shot Breakdowns

• Video 1 Vid 2

• Video 2

(55)

Topics we plan to cover p p

(56)

Camera

Canon 10D Canon 10D

(57)

High dynamic range imaging/display

(58)

Image warping/morphing

someone very famous

someone not

th t f famous

that famous

video

(59)

Image warping/morphing

(60)

Tracking

Feature tracking Feature tracking

(61)

Image stitching

(62)

MatchMove

Move matching using scene planes Move matching using scene planes

(63)

Matchmove

Move matching using scene planes Move matching using scene planes

(64)

Matchmove

Move matching using scene planes Move matching using scene planes

(65)

Photo tourism

(66)

Video matching

MOCO (Motion control camera) Matrix MOCO (Motion control camera) Matrix

(67)

Video matching

Video matching Video matching

(68)

Matting and compositing

Titanic

(69)

Matting

(70)

Object selection

LazySnapping LazySnapping

(71)

Image manipulation

GraphCut Texture GraphCut Texture

(72)

Image manipulation

Poisson blending Poisson blending

(73)

Image-based modeling

photogrammetric modeling and projective texture-mapping photogrammetric modeling and projective texture-mapping

(74)

Image-based modeling

photogrammetric modeling and projective texture-mapping photogrammetric modeling and projective texture-mapping

(75)

Image-based modeling

photogrammetric modeling and projective texture-mapping photogrammetric modeling and projective texture-mapping

(76)

Image-based modeling

Tour into a picture Tour into a picture

(77)

Image-based modeling

Tour into a picture Tour into a picture

(78)

3D photography (active)

Cyberware whole body scanner Cyberware whole body scanner

(79)

3D photography (active)

Photometric stereo Photometric stereo

(80)

3D photography (passive)

left right

Stereo

depth Stereo

(81)

Image-based rendering

Surface lightfield Surface lightfield

(82)

View interpolation

Bullet time video Bullet time video

(83)

View interpolation

High Quality Video View Interpolation High-Quality Video View Interpolation

(84)

Making face

Spacetime face Gollum

(85)

Video rewrite

Trainable videorealistic speech animation Trainable videorealistic speech animation

(86)

Inpainting (wire removal)

Inpainting Inpainting

(87)

Texture synthesis/replacement

Texture replacement Texture replacement

(88)

Semi-automatic matting painting

Image analogies Image analogies

(89)

Video editing

Flow based video editing Flow-based video editing

(90)

Grading (subject to change)

• 3 programming assignments (60%)

HDR I i (18%) – HDR Imaging (18%) – AutoStitch (24%)

M t hM (18%) – MatchMove (18%)

• Class participation (5%)

• Final project (35%)

– Research – System – Film

(91)

High dynamic range imaging

(92)

From past semesters (鄭逸廷 陳柏叡)

(93)

From past semesters (吳侑親,張書瑋)

(94)

From past semesters (王瑋馥,余雁雲)

(95)

AutoStitch

(96)

From past semesters

鄭逸廷 陳柏叡

李佳燕 黃政基

(97)

MathMove

梁家愷 鐘志遠 姜任遠 林立峯

梁家愷 鐘志遠 姜任遠 林立峯

楊宗碩 林柏劭 翁憲政 洪韶憶

(98)

Final projects from a similar course

in Georgia Tech.

(99)

Life in Paints

Life in Paints, GaTech DVFX 2003

(100)

Tour into pictures

Making of Life in Paints

(101)

In Your Face

In Your Face, GaTech DVFX 2002

(102)

Stop action

Making of In Your Face

(103)

Tennis

Tennis, GaTech DVFX 2007

(104)

MatchMove/CGI

Making of Tennis

(105)

Final projects from the past.

Final projects from the past.

(106)

YoYo Flight

(107)

Making of YoYo Flight

(108)

That’s it for today!

• Don’t forget to subscribe the mailing list.

Ch k h b i

• Check out the course website.

數據

Updating...

參考文獻

相關主題 :