• 沒有找到結果。

VR Project Orientation

N/A
N/A
Protected

Academic year: 2022

Share "VR Project Orientation"

Copied!
23
0
0

加載中.... (立即查看全文)

全文

(1)

VR Project Orientation

Ching-Chi Lin

Institute of Information Science, Academia Sinica

Department of Computer Science and Information Engineering, National Taiwan University

(2)

Agenda

Introduction

Research Issues

Current Project and Working Items

◦ Real-time Room fusion

◦ Perspective Changing

(3)

What is VR

Virtual Reality(VR) replicates an

environment that simulates a physical

presence in places in the real world or an imagined world, allowing the user to

interact in that world.[1]

◦ Artificially create sensory experiences, which can include sight, touch, hearing, and smell.

[1] https://en.wikipedia.org/wiki/Virtual_reality

(4)

Side-by-side Image

(5)

Augmented Reality(AR)

(6)

Mixed Reality

VR: virtual objects + virtual environment

AV: real objects + virtual environment

AR: virtual objects in real environment

(7)

VR Devices

Head Mount Device(HMD):

◦ Oculus Rift

◦ Samsung Gear VR

◦ Sony PlayStation VR

◦ HTC Vive

◦ Google Cardboard

◦ ...

Position Tracker, controller, joystick, …etc.

(8)

VR Applications

Games

◦ FPS, adventure, music, … etc.

Media

◦ 3D movie, 360 ° videos

◦ VR movies

Art

Architecture

(9)

Research Issues

Improve user experiences

◦ Make the VR/AR effect more realistic.

◦ Reduce the dizziness

◦ Reduce random wobble of the picture.

(10)

Research Issues(Cont.)

Mobile VR/AR

◦ Find a good balance between QoE and battery life of a mobile device.

◦ Dynamically scale resolution and refresh rate to reduce mobile GPU power consumption.

◦ Use user head movement information to decide the appropriate QoE metrics.

(11)

Research Issues(Cont.)

Cluster-Assisted VR

◦ Move the computations from local device to a server cluster, such that users without high-

end hardware equipments can also experience VR fluently.

◦ How to allocate sufficient computing

resources to different VR applications in the cluster?

(12)

Research Issues(Cont.)

Develop new VR/AR applications.

(13)

Current Project

Live Reality Fusion

◦ Combine the real-time images from two different locations into one.

◦ ex: fuse two seminar rooms for oversea joint meeting; “wall removing” for Interior design.

◦ Cooperate with Dr. Wang’s group.

(14)

Two Approaches

One-360’-camera

Multiple-camera

(15)

One-360’-Camera Approach

Only one 360’ camera in the remote room.

A server captures and process the stream from camera, then fuse the processed

stream into the video stream captured by

user HMD.

(16)

One-360’-Camera Approach(Cont.)

Remote room

Observation Room

(17)

Multiple-Camera Approach

Remote room

Observation Room

(18)

Steps

Break the video captured by 360’ camera into frames.

◦ Panoramic image

Construct a cuboid model of the remote room.

◦ Transform the panoramic frame into cube.

◦ Transform the cube into cuboid.

(19)

Steps(Cont.)

Compute what an user should see from the current angle.

◦ By projection or other methods.

Replace the wall in observation room

with the projected image of the remote

room.

(20)

Short-Term Goal

Fuse R106 and R107 in IIS.

◦ The wall between the two rooms can be removed to achieve real “room fusion”.

◦ Take picture/video as ground-truth.

(21)

Current Progress

Dr. Wang’s RA, 祖詒, has completed the

construction of the cuboid model of the

two rooms.

(22)

Working Plans

Speedup the model construction process.

◦ The current time required to process one image is a few seconds.

Less than 1/33 seconds in order to achieve real- time.

◦ Study the Matlab functions 祖詒 used in his code.

Continue 禎佑‘s work on multi-camera

interpolation.

(23)

Finish

Thank you!

Any Questions?

參考文獻

相關文件

6 《中論·觀因緣品》,《佛藏要籍選刊》第 9 冊,上海古籍出版社 1994 年版,第 1

The first row shows the eyespot with white inner ring, black middle ring, and yellow outer ring in Bicyclus anynana.. The second row provides the eyespot with black inner ring

Reading Task 6: Genre Structure and Language Features. • Now let’s look at how language features (e.g. sentence patterns) are connected to the structure

After students have had ample practice with developing characters, describing a setting and writing realistic dialogue, they will need to go back to the Short Story Writing Task

Robinson Crusoe is an Englishman from the 1) t_______ of York in the seventeenth century, the youngest son of a merchant of German origin. This trip is financially successful,

fostering independent application of reading strategies Strategy 7: Provide opportunities for students to track, reflect on, and share their learning progress (destination). •

volume suppressed mass: (TeV) 2 /M P ∼ 10 −4 eV → mm range can be experimentally tested for any number of extra dimensions - Light U(1) gauge bosons: no derivative couplings. =>

• Formation of massive primordial stars as origin of objects in the early universe. • Supernova explosions might be visible to the most