Microvision’s
Nomad ® Augmented Vision System:
The How and the Why
Thomas E. Sanko
Vice President, Marketing Microvision, Inc.
June 11, 2003
Welcome to Microvision!
• Agenda
9 Introductions
9 Microvision overview
9 How does it work
9 Why should I care
9 Q&A
9 Demos
9 Adjourn
9 Dinner
Information in the Form of Light
Scanned Beam
Technology Image
Capture
Displays
Microvision Background
• Founded 1993
9 NASDAQ: MVIS
• 180 employees
9 15 PhD’s, 50 Engineers, & 25 Researchers
• Located in Bothell, WA
9 67,500 Sq ft.Facility
• Strong Intellectual Property
9 66 issued US patents
9 89 plus US applications pending 9 Over 200 new disclosures
• Technical Capabilities
9 Image Quality/Electronics 9 Photonics & Optics
9 Scanner Development
9 MEMS Testing and Clean Rooms 9 Environmental Testing
9 Low Volume Manufacturing
Microvision Partners
Near-eye Displays
• Occluded
9 Look-around, look-down
9 Virtual reality
• Non-occluded (see-through)
9 Augmented vision
9 Augmented reality
Nomad ND1000: How It Works
Dr. Lance Evans
Director, Display Products Microvision, Inc.
June 11, 2003
• Product Overview
• System Block Diagram
• Scanned Beam Technology Overview
• Image Quality
Topics:
Introducing Nomad ND1000
Display Resolution: SVGA 800 x 600 pixels Field of View: 23 x 17 degrees
Display Color: Monochrome Red
Luminance: 1 to 800 fL
No. of Gray Shades: up to 32 shades
Headworn Weight: <18 ounces (502 gms) Eye Clearance: >20 mm
Depth of Focus Adj: 1 ft. to Infinity
Operating Environment: 0
oto 45
oC, 10 to 95% RH Battery life: up to 8 hours
NOMAD Augmented Vision System:
Worlds’ First MEMS-based, see-through, daylight readable display
Nomad ND1000 Components
Display Module Headgear
DM-VCEM Cable Belt
VCEM
Video Source
Video/Control Electronics Module (VCEM)
Video & Power Connectors Brightness,
Contrast, Power on/off
Set-Up Mode Indicators DM-VCEM
Cable
Nomad ND1000 Headgear
Technology Overview
How Scanned Beam Technology Works
• Single (triple for full color) light beam from LED or Laser Diode is sole light source
• Display raster (like CRT) is created from single scanning MEMS mirror
• Resultant image is delivered to eye via classical optics
Inherent Benefits
• LED/Laser Diode/Laser
provides high brightness and efficiency, low cost
• Single MEMS mirror provides simplicity/low cost (DLP has hundreds of thousands of MEMS mirrors)
• CRT-like raster provides superior image quality
• Architecture allows for
flexibility in design space
Nomad ND1000 Block Diagram
Video Control
External World Light
Light to Human Eye SVGA or VGA
Video
Source Video In
A/D & Frame Buffer (with Gamma and brightness comp)
Battery Power
D/A Laser Signal
Scanner Drive Electronics
Laser Shut Down
BufferBuffer
Vertical Drive Horiz Drive
MEMs Scanner
Laser Diode
Optical Combiner Focus
Lens LaserCurrentSource Drive
Photo Diode
Video / Control Electronics Module
Scanner Engine
Laser Assy
EPE Scanner Interconnect
Scanner PZR Feedback
Optic/Mechanical Assy
Scanner DSP Control
Display Module
Laser Safety Monitor
Laser Light Feedback Brightness
Cntl
Scanner Position Feedback
Monitor Functionality
Monitor MTBF > 725,000 Hrs Monitor MTBF > 725,000 Hrs
Per MIL-HDBK-217F
(Worst Case, Commercial Components)
Display Module Opto-Mechanical Design
(Isometric View)
Display Module Opto-Mechanical Design
(Section View)
Exit Pupil Expander (EPE):
• Diffractive Optic Element (DOE)
• Micro Lens Array (MLA)
Laser Diode 15 mW, 638 nm Display Module Electronics
MEMS Scanner
Focus Lens
Fold Mirror
Viewer Optic
Nomad ND1000 Optics Path/Attenuation
Beam Aperture
8 degree cone
Laser Diode modulation
Duty cycle
12mm
15 mw Laser Diode 2-dimensional
Scanning Micro Mirror
Focusing Lens
Light Diffuser Made of Diffractive Optical Elements Reflection
Mirror
Eye
Ocular Lens
Biaxial MEMS Scanner
Horizontal scan mirror
Vertical drive coils
Electrostatic drive plates
~7 mm
~7 mm
Packaged device sample
Micro-Electro-Mechanical Systems (MEMS) is the integration of mechanical elements, sensors, actuators, and electronics on a common silicon substrate
through the utilization of microfabrication technology.
Micro-Electro-Mechanical Systems (MEMS) is the integration of mechanical elements, sensors, actuators, and electronics on a common silicon substrate
through the utilization of microfabrication technology.
MEMS Mirror Parameters
• MEMS mirror size: 1.5mm x 1.5mm
• Horizontal:
Electrostatic drive
Bi-directional sinusoidal scan @resonance frequency
Scanning frequency: ~19,000Hz
Maximum mechanical scanning angle: +/- 5.5 o
Horizontal over-scan: 10%
• Vertical:
Sawtooth (ramp) electromagnetic drive
Vertical maximum mechanical scanning angle: +/- 3.8 o
Vertical scanning frequency: 60Hz
Display Performance Evaluation Station
CCD Matrox
frame
grabber CPU
Ocular DOE
MEMS LD Nomad
TMDisplay UUT
Test parameters:
FOV Distortion Contrast ratio Modulation depth
Test parameters:
Maximum luminance Dynamic range ratio
Dimming ratio
Luminance uniformity
Image Quality Data … Unit S/N 061 Summary
• Luminance: 864 fL
• Dynamic Range: 51,739
• Contrast Ratio: 197:1
• Dimming Ratio: 3262:1
Image Quality Data … Contrast
860.00 5.18 699.00 3.28 fL
4.62 664.00 6.14 831.00 fL
833.00 7.74 684.00 3.87 fL
2.84 644.00 3.55 805.00 fL
Measured contrast 1: 161.7
Calibration contrast 1: 894.6462
197.4 Display Contrast = 1 :
(for comparison purposes, the Contrast of a ViewSonic P817 CRT is: 174)
Image Quality Data … Code to Luminance
Nomad Serial No. 00061
0.01 0.1 1 10 100 1000 10000
0 50 100 150 200 250
Code (0-255)
Luminance (fL)
Red Green Blue
Image Quality Data … Dynamic Range
White Screen: Black Screen: Dynamic Range:
714 0.01 51739
Luminance measurements in fL (measured with a 4mm aperture):
(for comparison purposes, the Dynamic Range of a ViewSonic P817 CRT is: 210)
Image Quality Data … Uniformity
Nomad Serial No. 00114 784 Point Luminance Uniformity
1 3 5 7 9 11 13 15 17 19 21 23 25 27
S1S6S11S16S21S26 0.0
100.0 200.0 400.0 500.0
600.0 500.000-600.000
400.000-500.000 300.000-400.000 200.000-300.000 100.000-200.000 0.000-100.000 300.0
Luminance (fL)
Why should I care?
• Increased Productivity
• Improved Quality
• Enhanced Safety
It’s all about money!
$$$
Nomad Markets
• Military
• Aerospace
• Medical
• Industrial
Application Categories
• Navigation, alignment, and positioning
• Electronic performance support systems
• Real-time monitoring
Nomad Applications
Marine Navigation GIS Surveying
GPS Machine Control Marine Navigation Indoor Measurement Vehicle Operation Precision Alignment
Computer-Assisted Ortho Surgery Ultrasound-Guided Brachytherapy Ultrasound-Guided Needle Biopsy Aerial Cartography
Aerial Spraying Aircraft Navigation
Aircraft Instrument Flight (private) Avionics OEM (Commercial / Business HUD) Firefighting (precision drop)
Navigation, alignment, and
positioning Real-time
monitoring Electronic
performance support systems
Application Category Market
Sensor Vision Security
Intelligence/reconnaissance Aviation MRO
Vehicle MRO
Military/
Government
Police Patrol/Fire & Emergency Warehousing
Sensor Vision Security Package Delivery Aviation MRO
Vehicle MRO
Field Service Technicians Factory Machine MRO
Utility Workers Wheel Alignment
Industrial
Critical Care/Anesthesia Display Telemedicine Clinical Info Systems Telemedicine Medevac/EMT Interventional Cardiology Image-Guided Surgery
Medical
Police Patrol/Fire & Emergency Air Ambulance
EICAS (Engine instrument crew alert system for heavy lift)
Aviation preflight / flight check lists Aircraft Operating Procedures / Manual
General
Aviation
Nomad Applications
E C G
John Doe • 540-78-9054
• BD 1/22/70
Critical Data HR 71♥
BP 128/78 SpO2 70 Allergies: Penicillin Sulfa Drugs
Aerospace Applications
Aerospace Market Applications
• Precision Navigation & Control
9 Aerial Cartography
9 Aerial Spraying
9 Aircraft Navigation (pilot)
9 Aircraft Instrument Flight – GA (EFIS)
9 Aircraft / Avionics OEMs
9 Firefighting (precision drop)
• Computer-Aided Procedures
9 Aviation preflight / check lists
9 Aircraft Operating Procedures
Benefits of Augmented Vision
• CRITICAL FLIGHT INFORMATION ALWAYS IN VIEW
9 INCREASED SAFETY
Back-up to avionics
FOCUS on the Situation Outside the Cockpit 9 INCREASED PRODUCTIVITY
REDUCED PILOT WORKLOAD (through reduced instrument scanning)
Moving Map Flight Instrument System(EFIS)
Benefits of Augmented Vision
Aerial Spraying
Thermal Imaging Aerial Cartography
• CRITICAL FLIGHT INFORMATION ALWAYS IN VIEW
9 INCREASED SAFETY
Low passes require visual contact with terrain
FOCUS on the Situation Outside the Cockpit (coverage and obstacles) 9 INCREASED PRODUCTIVITY
REDUCED PILOT WORKLOAD (through reduced instrument scanning 9 INCREASED QUALITY
First pass coverage (very accurate)
Eliminates multiple passes to achieve full coverage
Military Applications
Military and Government Applications Military and Government Applications
• Precision Navigation & Control
9 Soldier – digitized battlefield
9 Aircraft – Digitization Without Aircraft Modification
9 Unmanned Vehicles – Aerial / Ground
9 Homeland Security – port and coastal patrol 9 Vehicle Fire Control –
9 Special Operations – Situational awareness
• Computer-Aided Procedures
9 Maintenance / Repair / Overhaul 9 Simulation
• Real Time Monitoring
9 Medical
9 Systems Monitoring
Soldier Systems
» CRITICAL MISSION
INFORMATION ALWAYS IN VIEW
» SAFETY - Improved Situational Awareness
» head up
» hands free
» PRODUCTIVITY - Increased operational effectiveness
» Accurate mission execution
» Efficiency through battlefield digitization knowledge
» IMPROVED MISSION
EFFECTIVENESS
Tactical Wireless Network
Increased Mission Effectiveness
»SAFETY - Improved Situational
Awareness
»Blue Force (friendly) tracking
»Enemy locations identified
»PRODUCTIVITY - Increased operational
effectiveness
»Accurate mission execution
»Efficiency through battlefield
digitization knowledge
Special Operations Forces
»Increased Mission Effectiveness
»Missions accomplished without incident
»SAFETY - Improved
Situational Awareness
»Identified hazards
»Accurately mapped
paths
»PRODUCTIVITY - Increased
operational effectiveness
»Efficiency through
digitized knowledge
Medical Applications
Medical Segment Applications
Medical Segment
Navigation/Alignment/Positioning
»Ultrasound-Guided Brachytherapy
»Ultrasound-Guided Needle Biopsy
»Computer-Assisted Orthopedic Surgery
»Image-Guided Surgery
Electronic Performance Support Systems
»Telemedicine & Clinical Info Systems
»Radiologic Image Viewing
Real-Time Data Monitoring
»Critical Care/Anesthesia Display
»Telemedicine Medevac/EMT
General Medical Benefits General Medical Benefits
Medical Segment
Navigation/Alignment/Positioning
»Productivity-Clinicians can see their hands, the target and the patient all at once
»Quality-Improve outcomes, increase success rate, shorten procedure
»Safety- Improve patient safety
Electronic Performance Support Systems
»Productivity-Clinicians can see their hands, the target and the patient all at once
»Quality-Improve outcomes, success rate shorten procedure
»Safety- Improves patient safety
Real-Time Data Monitoring
»Productivity- Clinicians can monitor critical patient data while performing other tasks
»Quality – Improves response time in emergencies, allows clinician more time watching patient
»Safety – Patient safety enhanced through faster response time
Specific Medical Benefits
Computer-Assisted Orthopedic Surgery (total knee replacement)
•No need to look away at monitor
9 improves surgeon accuracy in positioning hands and tools
9 cuts operative time
9 improves concentration
•Increased implant accuracy
9 provides longer implant service life
9 improved patient gait
9 fewer re-operations
9 lower cost of care
9 faster patient recovery
•Shorter procedure times
9 Saves hospital money
9 Faster patient recovery
9 Reduces cost
9 Improves patient satisfaction
Industrial Applications
Augmented Vision for Industry
Do It Faster … Better … Safer!
Faster, Better, Safer = Substantial ROI
• Customer Satisfaction
Getting it right the first time, every time
Greater accuracy Timely job completion
• Increased Worker & Operation Efficiency
• Reduced Training Costs
• Reduced Downtime
• Fewer Mistakes & Costly Re-dos
• Extended Operating Hours
• Enhanced Safety for Mobile Workers
Navigation/Alignment/Positioning
GIS Surveying Machine Control
Head-up, Hands-Free Precision Control
•Situational awareness
•Productivity
•Accuracy
•Eliminate costly mistakes
•Enhanced safety
H 0.000 m
Hz 390.4690 C + P
h 0.000 m
• Xyh Hz=0 ↑h/ih HOLD →2