• 沒有找到結果。

It isn’t about photography

N/A
N/A
Protected

Academic year: 2022

Share "It isn’t about photography"

Copied!
29
0
0

加載中.... (立即查看全文)

全文

(1)

Course overview

Digital Visual Effects Yung-Yu Chuang

Logistics

• Meeting time: 2:20pm-5:20pm, Wednesday

• Classroom: CSIE Room 102

• Instructor: Yung-Yu Chuang (cyy@csie.ntu.edu.tw)

• Teaching assistants: 沈林承、陳育聖

• Textbook: Readings from books, journals and proceedings. Richard Szeliski’s Computer Vision:

Algorithms and Applications. Richard Radke’s Computer Vision for Visual Effects.

• Webpage: (user name/password) http://www.csie.ntu.edu.tw/~cyy/vfx

• Mailing list: vfx@cmlab.csie.ntu.edu.tw subscribe via https://cmlmail.csie.ntu.edu.tw/mailman/listinfo/vfx/

This course is NOT about …

It isn’t about photography

(2)

It isn’t about 3D animations It isn’t about watching movies

It isn’t about physical effects It’s not about industrial tricks

computer vision

computer graphics

image processing

You will learn more about Taylor and Poisson than Lucas and Spielberg in this course. If you hear Lucas in the class, it is more likely to refer to Bruce Lucas, not George Lucas.

(3)

Prerequisites

• It is a must that you have programming experiences.

• It is a must that you have basic knowledge on linear algebra and probability.

• It is a plus if you have background knowledge on computer vision, image processing and computer graphics.

• It is a plus if you have access to digital cameras and camcorders.

The vfx course

what you actually do

what you thought you will do

what other students think you do

what other professors think you do

Be cautious! Warning from previous students

‧請學期初老師要多提醒這門課的困難

度請興趣或實力不足的同學勿修,否

則就會像我一樣停修 XD

(4)

This course is about …

Digital Visual Effects

Deadpool Deadpool

(5)

Life of Pi Life of Pi

獨自一人拍和十三人的戲

要把身材高大的甘道夫和小矮人們拍攝在一起,我們是沒法在同一個片場的。和 我一起拍攝的只有柱子上貼著的13張他們的照片,後面還有一個小燈,哪個角 色說話了燈就亮起來。想像一下你在拍一場和13個人一起演的戲,但你卻只有 獨自一人。這真的會把你的演技推到極限。我哭了,真的,我當時真的哭了。然 後我還說出了聲:我認真演了一輩子不是為了跟這些照片對戲啊!

VFX of the Hobbit

(6)

Reality? Retouching

Retouching Retouching

(7)

Bush campaign’s TV AD, 2004 Texture synthesis and inpainting

Iraq War, LA Times, April 2003

Digital photomontage

Domestic example

The Liberty Times 2007.12.17

(8)

Special effects

Stop action

The execution of Mary, 1895

Glass shot Rear projection

King Kong, 1933

stop motion

(9)

Special effects (make-up) Special effects (physical effects)

Special effects (miniature) Special effects (matte painting)

(10)

Lord of the Rings Illusion - forced perspective

Computer-generated model The Avengers (1978 vs 2012)

(11)

Visual effects 100 Years

Production pipeline

Production pipeline

Preproduction Production

Post-production

Artwork Reference Stills Plates

Storyboard

Editing VFX

Music

Sound

Film

Effects

Preproduction

Storyboard

(12)

Preproduction

Artwork

Preproduction

Reference & Research

Production

Shooting

Post-production

(13)

Visual effects production

Preproduction Production

Post-production

Artwork Reference Stills Plates

Model Geometry

Skinning

Effects

Animation Character Animation

Lighting and Rendering Compositing Matchmove and Matchmodel

Assets Shots

Skeleton

Scanning

Film Recording Textures

Materials Storyboard

Effects

Visual effects post-production

A case study

405: The Movie

• This movie were created solely by two visual effects artists in the year of 2000. It was a process that took over three months of nights, weekends and any spare moments that they could find.

• https://en.wikipedia.org/wiki/405_(film)

• An early example of digital filmmaking and the use of Internet as media

• Budget: $300 ($140 for tickets. The officer is acknowledged)

(14)

405: The Movie Making of 405

Step 0: script and shooting plan

Making of 405

Step 1: shooting

two days with a Canon Optura DV camera with progressive mode.

 a 70-minute raw footage initial editing

pickup shots

Making of 405

Step 2: building CG world

total 62 shots, 42 enhanced with digital VFX.

19 shots are entirely digital creations.

plane, two cars, freeway background are digital

photo-based 3D environment

(15)

Making of 405

Real cars were used for close-up and interior shots

A low-resolution mesh scanned by a cyberscanner.

Mapped with photographs.

Making of 405

DC-10 plane took a month to model in details for the needs of close-up shots.

59 objects, 142,439 polygons

reference modeling material painting

Making of 405

close-up shots

Step 3: traffic clearing

inpainting

clean plate

Making of 405

shot with the vehicle standing still in a backyard Step 4: compositing

(16)

Making of 405 Making of 405

Step 5: fine touchup

3D hat compositing and inpainting

Making of 405

Step 6: music and delivery

Bloody Omaha

(17)

Breakdown (Wolf of Wall Street)

Topics we plan to cover

Camera

Canon 10D

High dynamic range imaging/display

(18)

Image warping/morphing

video

someone very famous

someone not that famous

Image warping/morphing

Tracking

Feature tracking

Image stitching

(19)

MatchMove

Move matching using scene planes

Matchmove

Move matching using scene planes

Matchmove

Move matching using scene planes

Photo tourism

(20)

Video matching

MOCO (Motion control camera) Matrix

Video matching

Video matching

Matting and compositing

Titanic

Matting

(21)

Object selection

LazySnapping

Image-based modeling

photogrammetric modeling and projective texture-mapping

Image-based modeling

photogrammetric modeling and projective texture-mapping

Image-based modeling

photogrammetric modeling and projective texture-mapping

(22)

Image-based modeling

Tour into a picture

Image-based modeling

Tour into a picture

3D photography (active)

Cyberware whole body scanner

3D photography (active)

Photometric stereo

(23)

3D photography (passive)

Stereo

left right

depth

Image-based rendering

Surface lightfield

View interpolation

Bullet time video

View interpolation

High-Quality Video View Interpolation

(24)

Image manipulation

GraphCut Texture

Image manipulation

Poisson blending

Stereoscopic films Making face

Spacetime face Gollum

(25)

Virtual human Video rewrite

Trainable videorealistic speech animation

Inpainting (wire removal)

Inpainting

Texture synthesis/replacement

Texture replacement

(26)

Semi-automatic matte painting

Image analogies

Video editing

Flow-based video editing

Grading (subject to change)

• 3 programming assignments (60%)

– HDR Imaging (18%) – AutoStitch (24%) – MatchMove (18%)

• Class participation (5%)

• Final project (35%)

– Research – System – Film

High dynamic range imaging

(27)

From past semesters (鄭逸廷 陳柏叡) From past semesters (吳侑親,張書瑋)

From past semesters (王瑋馥,余雁雲) AutoStitch

(28)

AutoStitch

羅聖傑

連奕婷 張宇蓓

MathMove

梁家愷 鐘志遠

楊宗碩 林柏劭 翁憲政 洪韶憶

姜任遠 林立峯

Final projects from the past.

YoYo Flight

(29)

Making of YoYo Flight That’s it for today!

• Don’t forget to subscribe the mailing list.

• Check out the course website.

參考文獻

相關文件

 If I buy a call option from you, I am paying you a certain amount of money in return for the right to force you to sell me a share of the stock, if I want it, at the strike price,

Your problem may be modest, but if it challenges your curiosity and brings into play your inventive faculties, and if you solve it by your own means, you may experience the tension

If w e sell you land, you m ust rem em ber that it is sacred, and you m ust teach your children that it is sacred and that each ghostly reflection in the clear w ater of the lakes

Playing computer games is interesting for my brother.(To play computer games is interesting for my brother.)(It is interesting for my brother to play computer

//if it does not connect it starts an access point with the specified name //here "AutoConnectAP". //and goes into a blocking loop awaiting

(It is also acceptable to have either just an image region or just a text region.) The layout and ordering of the slides is specified in a language called SMIL.. SMIL is covered in

• It is a plus if you have background knowledge on computer vision, image processing and computer graphics.. • It is a plus if you have access to digital cameras

– Basic concept of computer systems and architecture – ARM architecture and assembly language.. – x86 architecture and