Article
Control Design and Digital Implementation of a Fast
2-Degree-of-Freedom Translational Optical Image
Stabilizer for Image Sensors in Mobile
Camera Phones
Jeremy H.-S. Wang ID, Kang-Fu Qiu and Paul C.-P. Chao * ID
Institute of Electrical and Control Engineering, National Chaio Tung University, Hsinchu City 300, Taiwan; jeremyw.ece96g@g2.nctu.edu.tw (J.H.-S.W.); gary0713.ece04g@nctu.edu.tw (K.-F.Q.)
* Correspondence: pchao@mail.nctu.edu.tw; Tel.: +886-3-513-1377
Received: 1 August 2017; Accepted: 10 October 2017; Published: 13 October 2017
Abstract:This study presents design, digital implementation and performance validation of a lead-lag controller for a 2-degree-of-freedom (DOF) translational optical image stabilizer (OIS) installed with a digital image sensor in mobile camera phones. Nowadays, OIS is an important feature of modern commercial mobile camera phones, which aims to mechanically reduce the image blur caused by hand shaking while shooting photos. The OIS developed in this study is able to move the imaging lens by actuating its voice coil motors (VCMs) at the required speed to the position that significantly compensates for imaging blurs by hand shaking. The compensation proposed is made possible by first establishing the exact, nonlinear equations of motion (EOMs) for the OIS, which is followed by designing a simple lead-lag controller based on established nonlinear EOMs for simple digital computation via a field-programmable gate array (FPGA) board in order to achieve fast response. Finally, experimental validation is conducted to show the favorable performance of the designed OIS; i.e., it is able to stabilize the lens holder to the desired position within 0.02 s, which is much less than previously reported times of around 0.1 s. Also, the resulting residual vibration is less than 2.2–2.5 µm, which is commensurate to the very small pixel size found in most of commercial image sensors; thus, significantly minimizing image blur caused by hand shaking.
Keywords:optical image stabilizer (OIS); image blur; nonlinear equations of motion (EOMs); lead-lag controllers; field-programmable gate array (FPGA); mobile camera phones
1. Introduction
Image stabilization (IS) technology [1–3] has been considered essential for delivering high image quality with minimized image blur in professional cameras. The image blurs are usually caused by the inevitable motion of the camera while shooting. Recently, this IS technology has also been applied to mobile phone cameras to reduce image blur and for meeting new customer demands in the industrial field [1–3]. Most of the IS technologies can be categorized as either digital image stabilization (DIS) or optical image stabilization (OIS). DIS technology employs varied techniques of digital image processing to reduce image blurs caused by hand shaking while shooting photos [1,3–8]. On the other hand, OIS equips the lens in the camera with mechanical suspension and the associated actuating voice coil motors to move the lens fast enough to compensate for image blurs [2,9–14]. As compared to DIS, OIS tries to eliminate image blurs based on basic optics rather than working on imaged digital pixel data as DIS does. When employing DIS, one can significantly lose the original resolution offered by the camera after various digital image processing techniques are applied. Thus, OIS remains viable as an important technology, even with DIS also applied, to tackle the image blur caused by hand
Sensors 2017, 17, 2333 2 of 18
shaking as long as the performance of the designed OIS can meet the required specifications [11]. According to their different image stabilization goals, varied OIS structures have been proposed, such as, translational [9,12], rotational [13] as well as a special one using a deformable freeform mirror [14]. The study herein focuses on the translational OIS, since it is most suitable for compensating for the disturbances caused by hand shaking on a mobile phone camera, which is mostly translational.
This study is dedicated to designing, digital implementation and performance validation of the lead-lag controllers for a 2-degree-of-freedom (DOF) translational optical image stabilizer (OIS) installed in mobile camera phones. The related work reported herein includes: (1) the mechanism design of the 2-DOF translational OIS; (2) the establishment of the nonlinear dynamic equations of motion; (3) the design of a simple lead-lag controller based on the established nonlinear equations in order to be implemented via a field-programmable gate array (FPGA) board for fast response; and (4) experimental validation to show the positive performance of the designed OIS and controller to reduce image blur. Compared to all prior reported works, the work presented herein is the first to design a simple lead-lag controller based on complete, complicated nonlinear equations of motion of the OIS, especially including the coupling dynamics between different DOFs being treated as uncertainties during control design. Furthermore, the designed lead-lag controller is easy to implement by using an FPGA chip that is capable of achieving a faster response with the required precision than those reported in prior works [9,12,13,15].
2. The OIS Model
2.1. OIS Mechanism
A new OIS is designed for this work with two translational DOFs which has small, slim dimensions of 10.5 mm×10.5 mm× 4 mm, as shown in Figure1a. This size is suitable for installation in a common smart phone to hold the focusing lens. The mechanical structure of the OIS mechanism is schematically shown in Figure1b. The lens is mounted in a lens holder as shown in this figure. Also, the lens holder is suspended to the image base through four parallel vertical wires, with the intention to allow only the movement of the lens relative to the base in two horizontal, translational DOFs for image stabilization against hand shaking. The movement of the lens holder as opposed to the base of the OIS is made possible by the electro-magnetic forces generated between four magnets and coils as shown in Figure1b. With proper design of the magnet poles and the direction of the current driving through the coils, the generated electro-magnetic forces are able to move the lens in 2 horizontal, translational DOFs to overcome the image blurs due to hand shaking while shooting photos. The resulting important design parameters and expected performance specifications of the designed OIS are listed in Table1.
Table 1.Design parameters and specifications of the optical image stabilizer (OIS).
Item Specifications
Lens holder Diameter 6.7 mm
Lens holder weight 0.5202 g
Rated Load Current 80 mA
Working range ±1 mm
Moving displacement ±1 mm
Sensors 2017, 17, 2333 3 of 18
Figure 1. The designed optical image stabilizer (OIS) with 2 translational degrees-of-freedom (DOF),
which includes an image base attached with an image sensor, magnets, four-wire suspension and a lens holder. (a) a photo; (b) a schematic of the OIS structure.
To control the movement of the lens holder to the desired position for overcoming negative effects caused by hand shaking, the electromagnetic forces generated by the VCMs are expected to move the lens holder towards the opposite direction of the vibration induced by hand shaking at a required speed. The force generated by the VCMs, F, in a vector can be captured based on basic electromagnetic theory by
𝑭 = 𝑁 ∙ 𝒊 ∙ 𝐿 × 𝑩𝑔, (1)
where N is the total number of coil loops in a VCM, i is the vector prescribing the VCM current, L is the total length of the coil wires that accounts for generation of electromagnetic forces, and 𝑩𝑔 is the magnetic flux density that results from design and arrangement of magnets and its yokes.
With the electromagnetic forces in Equation (1) successfully generated by VCMs in a newly-designed OIS structure as shown in Figure 1b, effort was then made to derive the nonlinear equations of motion of the lens and lens holder for the ensuing controller design and experimental validation.
2.2. Governing Equations of OIS
The equations of motion are derived in this section. This begins with formulating the kinetic and potential energy of the OIS, and then application of Lagrange’s equation to obtain the governing equations of motion for the OIS. For formulating the kinetic and potential energies, two masses are considered. As schematically depicted in Figure 2, they are (1) the image base, to which the active pixel system (APS) of a Complementary Metal-Oxide Semiconductor (CMOS) image sensor is fixed, and (2) the lens and lens holder. Three different coordinates are defined to capture the motion of the lens holder in the OIS relative to ground while shooting photos under hand shaking. The ground reference coordinates are defined as 𝑋g𝑌𝑔𝑍𝑔, the origin of which is 𝑂𝑔. In addition to 𝑋g𝑌𝑔𝑍𝑔, there are two other coordinate systems, 𝑋i𝑌𝑖𝑍𝑖 and 𝑋l𝑌𝑙𝑍𝑙, which are fixed to the image sensor base and the lens holder, respectively. Note that 𝑋i𝑌𝑖𝑍𝑖 are in fact fixed to the camera case that is vibrating undesirably while shooting photos with hand shaking, causing unintentional shifting of imaged points on the base, eventually leading to image blurs. The VCMs designed and employed in the OIS, as shown in Figure 1, would be expected to move the lens holder, prescribed by the coordinate 𝑋l𝑌𝑙𝑍𝑙, in an opposite direction to compensate significantly for the image blur. Note that the kinematic constraint imposed by the four parallel, vertical wires, as shown in Figures 1b and 2a, restricts the motion of the lens holder to primarily 3 degrees-of-freedom (DOFs), 𝑥𝑙, 𝑦𝑙 and 𝜃𝑧𝑙, relative to the OIS base.
Figure 1.The designed optical image stabilizer (OIS) with 2 translational degrees-of-freedom (DOF), which includes an image base attached with an image sensor, magnets, four-wire suspension and a lens holder. (a) a photo; (b) a schematic of the OIS structure.
To control the movement of the lens holder to the desired position for overcoming negative effects caused by hand shaking, the electromagnetic forces generated by the VCMs are expected to move the lens holder towards the opposite direction of the vibration induced by hand shaking at a required speed. The force generated by the VCMs, F, in a vector can be captured based on basic electromagnetic theory by
F=N·i·L×Bg, (1)
where N is the total number of coil loops in a VCM, i is the vector prescribing the VCM current, L is the total length of the coil wires that accounts for generation of electromagnetic forces, and Bgis the magnetic flux density that results from design and arrangement of magnets and its yokes.
With the electromagnetic forces in Equation (1) successfully generated by VCMs in a newly-designed OIS structure as shown in Figure1b, effort was then made to derive the nonlinear equations of motion of the lens and lens holder for the ensuing controller design and experimental validation. 2.2. Governing Equations of OIS
The equations of motion are derived in this section. This begins with formulating the kinetic and potential energy of the OIS, and then application of Lagrange’s equation to obtain the governing equations of motion for the OIS. For formulating the kinetic and potential energies, two masses are considered. As schematically depicted in Figure2, they are (1) the image base, to which the active pixel system (APS) of a Complementary Metal-Oxide Semiconductor (CMOS) image sensor is fixed, and (2) the lens and lens holder. Three different coordinates are defined to capture the motion of the lens holder in the OIS relative to ground while shooting photos under hand shaking. The ground reference coordinates are defined as XgYgZg, the origin of which is Og. In addition to XgYgZg, there are two other coordinate systems, XiYiZiand XlYlZl, which are fixed to the image sensor base and the lens holder, respectively. Note that XiYiZiare in fact fixed to the camera case that is vibrating undesirably while shooting photos with hand shaking, causing unintentional shifting of imaged points on the base, eventually leading to image blurs. The VCMs designed and employed in the OIS, as shown in Figure1, would be expected to move the lens holder, prescribed by the coordinate XlYlZl, in an opposite direction to compensate significantly for the image blur. Note that the kinematic constraint imposed by the four parallel, vertical wires, as shown in Figures1b and2a, restricts the motion of the lens holder to primarily 3 degrees-of-freedom (DOFs), xl, yland θzl, relative to the OIS base.
Sensors 2017, 17, 2333 4 of 18
Sensors 2017, 17, 2333 4 of 18
(b)
(a) (c)
Figure 2. Coordinates and notations that describe the OIS dynamics; (a) 3-D view; (b) Planar view
from the top side view; (c) Electromagnetic forces on the centroid of the lens holder.
To design the controller, the governing equations of the OIS need to be derived, which begins by formulating the kinetic and potential energies of mass and inertias in the OIS system based on the coordinates defined in Figure 1. To derive the energies of the image base, in fact, a CMOS image sensor fixed to the camera case, the translational and angular accelerations of 𝑂𝑖 can be expressed as
𝑎𝑜𝑖= 𝑥𝑖̈ î + 𝑦𝑖̈ 𝑗̂ + 𝑧𝑖̈ 𝑘̂ , 𝜃̈𝑜𝑖= 𝜃̈𝑥𝑖𝑖̂ + 𝜃̈𝑦𝑖𝑗̂ + 𝜃̈𝑧𝑖𝑘̂, (2) where 𝑎𝑜𝑖 and 𝜃̈𝑜𝑖 denote the translational and angular accelerations of the image base, respectively. The Lagrange’s equation [15] applied is
𝑑 𝑑𝑡( 𝜕𝐿 𝜕𝑟𝑖̇ ) −𝜕𝐿 𝑟𝑖 = 𝑄𝑖, 𝑖 = 1,2, 3, (3)
where 𝑟𝑖 and 𝑄𝑖 are generalized coordinates and forces/torques, respectively, and the Lagrangian
L is
𝐿𝑜= 𝑇 − 𝑈 = 1 2𝑚𝑣0
2− 𝑈, (4)
where 𝒗𝒐, 𝑇 and 𝑈 are the velocity of the lens holder relative to the inertial frame, kinetic and potential energies, respectively. The kinetic energy is due to the motion of the lens holder, while the potential is induced by deflected parallel wires in the OIS, as shown in Figure 2a. Considering the motion of the lens holder is in a moving frame, 𝑋𝑖𝑌𝑖𝑍𝑖, the Lagrangian is no longer Equation (4). Suppose the image base is in a translational velocity 𝑽 relative to the ground coordinates 𝑋𝑔𝑌𝑔𝑍𝑔, thus 𝒗0= 𝑽 + 𝒗1, where 𝒗1 is the velocity of a given mass (𝑑𝑚) of the lens and lens holder relative to the image base in Figure 2a. The Lagrangian in Equation (4) becomes
𝐿′=1 2𝑚𝑣1 2+ 𝑚𝒗 𝟏．𝑽 + 1 2𝑚𝑉 2− 𝑈, (5) where 𝒗𝟏．𝑽 = 𝑑(𝑽 ∙ 𝒓) 𝑑𝑡 − 𝑑𝑽 𝑑𝑡∙ 𝒓 = 𝑑(𝑽 ∙ 𝒓) 𝑑𝑡 − 𝑾 ∙ 𝒓. (6)
Figure 2.Coordinates and notations that describe the OIS dynamics; (a) 3-D view; (b) Planar view from the top side view; (c) Electromagnetic forces on the centroid of the lens holder.
To design the controller, the governing equations of the OIS need to be derived, which begins by formulating the kinetic and potential energies of mass and inertias in the OIS system based on the coordinates defined in Figure1. To derive the energies of the image base, in fact, a CMOS image sensor fixed to the camera case, the translational and angular accelerations of Oican be expressed as
aoi= .. xiˆi+ .. yiˆJ+ .. ziˆk, .. θoi = .. θxiˆi+ .. θyiˆJ+ .. θziˆk, (2) where aoiand ..
θoidenote the translational and angular accelerations of the image base, respectively. The Lagrange’s equation [15] applied is
d dt( ∂L ∂r.i ) − ∂L ri =Qi, i=1, 2, 3, (3)
where riand Qiare generalized coordinates and forces/torques, respectively, and the Lagrangian L is
Lo =T−U= 1 2mv
2
0−U, (4)
where vo, T and U are the velocity of the lens holder relative to the inertial frame, kinetic and potential
energies, respectively. The kinetic energy is due to the motion of the lens holder, while the potential is induced by deflected parallel wires in the OIS, as shown in Figure2a. Considering the motion of the lens holder is in a moving frame, XiYiZi, the Lagrangian is no longer Equation (4). Suppose the image base is in a translational velocity V relative to the ground coordinates XgYgZg, thus v0=V+v1, where v1is the velocity of a given mass (dm) of the lens and lens holder relative to the image base in Figure2a. The Lagrangian in Equation (4) becomes
L0 = 1 2mv 2 1+mv1·V+ 1 2mV 2−U, (5) where
v1·V= d (V·r) dt − dV dt·r= d(V·r) dt −W·r. (6)
In the above Equation (6), r is the displacement of the lens holder relative to the image base. W is the acceleration of the image base in the ground coordinates XgYgZg. For the non-inertial frame with translational velocity relative to the inertial frame, the Lagrangian is
L0= 1 2mv 2 1+m d(V·r) dt −mW·r+ 1 2mV 2−U, (7)
where some terms depending only on time are omitted. In addition, the lens holder possibly rotates slightly with respect to the image base due to asymmetrical mechanism, and v1 = v+Ω×r. Thus, the Lagrangian can be finally formulated as
L=T−U= 1 2mv 2+md(V·r) dt +mv·Ω×r+ 1 2m(Ω×r) 2− mW·r+1 2mV 2−U. (8)
where mv2and mW·r are two translational kinetic energies due to translational motion, while mv·Ω×r and m(Ω×r)2are rotational kinetic energies. Finally, r, v,Ω, and W of a given differential mass (dm) of the lens holder in Figure2can be represented as
r= (xl+xdmcos θzl−ydmsin θzl)ˆi+ (yl+xdmsin θzl+ydmcos θzl)ˆJ+ (zl+zdm)ˆk, (9)
v= (x.l− . θzlxdmsin θzl− . θzlydmcos θzl)ˆi+ ( . yl+θ.zlxdmcos θzl−ydmsin θzl)ˆJ+ . zlˆk, (10) Ω=θ.xiˆi+ . θyiˆJ+ . θziˆk, (11) W=..xiˆi+ .. yiˆJ+..ziˆk. (12)
The kinetic energy and potential energies for the lens and lens holder can be derived, respectively, as T= Z (1 2v 2+d(V·r) dt +v·Ω×r+ 1 2(Ω×r) 2− W·r+1 2V 2)dm, (13) U= 1 2k(x 2 l +y2l) + 1 2kθθ 2 zl +gylm. (14)
Equations (9)–(12) are substituted next into Equations (13) and (14) for complete expressions of T and U, and this is followed by the application of Lagrange’s Equation (3), yielding the equations of motion along x-, y- and θz(roll)-axes as
(x..i+ .. xl− . θ 2 yixl− . θ 2 zixl+ .. θyizl− .. θziyl+ . θxi . θzizl+ . θxi . θyiyl+2 . θyi . zl−2 . θzi . yl)m +(θ.xi . θzi+ .. θyi)Iz+ . θxi . θyi − .. θzi− .. θzl(Ixsin θzl +Iycos θzl)− [θ. 2 yi+ ( . θzi + . θzl) 2
](Ixcos θzl −Iysin θzl) =Fxcos θzl −Fysin θzl−kxxl−cx . xl, (15) (y..i+y..l−θ. 2 xiyl− . θ 2 ziyl+ .. θzixl− .. θxizl+ . θyi . θzizl+ . θxi . θyixl+2 . θzi . xl−2 . θxi . zl)m +(θ.yi . θzi− .. θxi)Iz− [ . θ 2 xi+ ( . θzi + . θzl) 2 ](Ixsin θzl +Iycos θzl) +(θ..zi+ .. θzl + . θxi .
θyi)(Ixcos θzl −Iysin θzl) =Fycos θzl+Fxsin θzl−kyyl−cy . yl−mg,
Sensors 2017, 17, 2333 6 of 18 (Ixcos θzl− Iysin θzl)( .. yi+y..l−θ. 2 xiyl− . θ 2 ziyl+ .. θzixl− .. θxizl+ . θyi . θzizl+ . θxi . θyixl+ 2 . θzi . xl− 2 . θxi . zl) −(Ixsin θzl+ Iycos θzl)(
.. xi+ .. xl− . θ 2 yixl− . θ 2 zixl+ .. θyizl− .. θziyl+ . θxi . θzizl+ . θxi . θyiyl+ 2 . θyi . zl− 2 . θzi . yl) +(Ixzcos θzl− Iyzsin θzl) (
. θyi . θzi− .. θxi) − (Ixzsin θzl+ Iyzcos θzl)( . θxi . θzi+ .. θyi) +(θ. 2 yi− . θ 2
xi)(Ixxsin θzlcos θzl+ Ixy(cos 2θ
zl− sin2θzl) − Iyycos θzlsin θzl) +(..θzi+ .. θzl)Iθ+ . θxi . θyi(Ixxcos2θzl+ Iyysin 2 θzl− 2Ixysin θzlcos θzl) − . θxi . θyi(Ixxsin2θzl+ Iyycos2θzl+ 2Ixysin θzlcos θzl) = Mθ− kθθzl− cθ
.
θzl,
(17)
where x, y, and θzcapture the translational and rotational motions of the lens holder in XiYiZi. Note that as pointed out previously, the lens holder is constrained motionless relative to the image base along z,
θxand θyby four parallel wires, as shown in Figure2a. Therefore, the three equations of motion in Equations (15)–(17) suffice to prescribe the dynamics of the lens holder. Also in Equations (15)–(17), Ixx, Iyyand Iθare the mass moments of inertia of the lens holder, while Ixy, Ixz, and Iyz, are the mass
product of inertia of the lens holder about its centroid along the x-, y- and z-axis. Ix=R m
xdmdm and Iy = R
m
ydmdm are the first mass moments of inertia with respect to the x- and y-axes, respectively. kx, kyand kθare the equivalent spring stiffness of the four-wire suspension, respectively, along x-, y- and
roll-axes in OIS, while cx, cyand cθare the equivalent spring damping of the four-wire suspension
structure. Fx, Fyand Mθare the force and moment generated by the VCMs in OIS. Note also that based
on the fact of the near symmetry in the OIS structure between x- and y-directions, kxis assumed equal to ky, cxequals cyand Ixxequals Iyy. Moreover, this symmetry also leads to almost zero mass product of inertia and zero first mass moments of inertia of the lens holder over x- and y-directions. Due to the fact that the translational and rotational displacements of the lens holder relative to the image base are small, the distance between the image base and lens holder, zl, is assumed constant and determined by design. Thus, the terms,z.l and
..
zl, are assumed zeros in Equations (15)–(17), yielding
(x..i+ .. xl)m+cx . xlm+ [kx−m( . θ 2 yixl− . θ 2 zi)]xl−2 . θzi . ylm+ (θ.xi . θyi − .. θzi)ylm+ ( .. θyi+ . θxi . θzi)zlm=Fxcos θzl−Fysin θzl, (18) (y..i+y..l)m+cy . ylm− ( . θ 2 xi + . θ 2 zi)ylm+2 . θzi . xlm+ ( .. θzi+ . θxi . θyi)xlm+ ( . θyi . θzi− .. θxi)zlm+kyyl+mg=Fycos θzl+Fxsin θzl, (19) (θ..zi+ .. θzl)Iθ+cθ . θzl+kθθzl =Mθ. (20)
Note that a nonzero θzl does not change the imaging point on the image sensor, and is in fact small due to the nature of the four parallel wires. Thus, the later effort dedicated to controller design can focus on the system with the dynamics prescribed by Equations (18) and (19). In other words, the designed OIS is considered primarily as being of 2 degrees-of-freedom (DOFs), x and y, to control and then stabilize the image, ignoring the limited motion along an additional DOF of roll, captured herein by θzl. The governing dynamic Equations (18) and (19) can be re-arranged as a system of 2 DOFs for control, in the form of
M..ql+Mq..i+Cq.l+Kql+N+G=TF, (21) where qi = [ xi yi ]
T
and ql= [ xl yl ] T
captures the translational motion of the lens holder and the image base, respectively. Note that qi= [ xi yi ]
T
in fact captures components associated with x and y in r, as defined in Figure2a. C, K and M are the matrices containing the damping coefficient and Coriolis force terms. K is the spring stiffness. M represents the mass matrices. N contains the centrifugal forces. G= [ 0 mg ]Tcaptures gravitational effect. F= [ Fx Fy ]
T
are electromagnetic forces generated by VCMs for actuation on the lens holder to overcome image blurs caused by hand shaking. Fxand Fyare in fact generalized forces in Qiin Lagrange’s Equation (3). Note that F is already prescribed by Equation (1). Expressions of other terms in Equation (21) are
M=diag[ m m ], (22) C= " cx −2m . θzi 2mθ.zi cy # , (23) K= kx−m( . θ 2 yi+ . θ 2 zi) m( . θxi . θyi− .. θzi) m(..θzi+ . θxi . θyi) ky−m( . θ 2 xi+ . θ 2 zi) , (24) N= " m(θ.xi . θzi+ .. θyi)zl m(θ.yi . θzi− .. θxi)zl # , (25) T= cos θzl sin θzl 0 −sin θzl cos θzl 0 0 0 1 , (26)
where T is the transform matrix due to small, non-zero θzlcaused by unequal electromagnetic forces of[ Fx Fy ]
T
on the lens holder. Note that all the terms in Equations (23)–(26) depending on θzl can be calculated based on Equation (20). With the governing dynamic Equation (21) successfully derived, the controller is designed in the next section based on the derived Equation (21) to achieve image stabilization by moving the lens holder to the desired position while shooting photos with hand shaking.
3. Control Design for OIS
3.1. Control Objectives
The basic optical principle underlying OIS is illustrated in Figure3, where the movement of the lens and image sensor due to hand shaking are exaggerated for the sake of clarity [13,16]. Note that hand shaking by users while shooting photos on a camera phone induces not only translational but also rotational movements in all six DOFs of the camera. Of all movements, those associated with translational and rotational directions about x- and y-axes cause many more image blurs than those associated with the z-axis. This is due to the fact that the inertial force exerted by photo-shooting is generally not along the z-axis, and furthermore, any angular movement about θz does not change the imaging point on the sensor plane, leading to no image blur. Therefore, in this study, only the disturbances along x- and/or y-axes and about θx- and/or θy-axes are considered to derive the control objectives of the lens holder.
Figure 3a,b illustrate a lens and its holder in an OIS under disturbance caused by hand shaking while shooting photos along x- and/or y-axes and/or about θx- and/or θy-axes, respectively. In Figure3a, a downward movement of the camera leads to a downward movement of the image base relative to ground; thus, object A is equivalently moved upward relative to the camera case, including the image base. Thus, the imaged point B is shifted downward by BB0to B’, causing imaging blur. To compensate for the blur, the OIS moves the lens upward to re-image point B’ back to origin B, the desired position on the image plane, as shown in the last subfigure in Figure3a. Similarly, in Figure3b, point B is also shifted back to its origin, the desired position on the image plane, by the OIS moving the lens downward for some distance, as shown in the last subfigure.
With the feasibility of compensating for the imaging blur by moving the lens in the right directions, effort is then made to obtain the desired distance the lens must move to compensate for the image blurs. Figure4shows the geometric optics associated with those in Figure3a, where the camera is under translational disturbance from hand shaking. In the first subfigure of Figure3a, without hand shaking, object A is imaged on point B on the image plane. While experiencing downward hand shaking, A is shifted from A to A’ by∆h; thus shifting B to B’. To move B’ back upward to its original
Sensors 2017, 17, 2333 8 of 18
position, based on geometric optics, the lens needs to be moved upward by∆h∗. This∆h∗ can be actuated by OIS, by satisfying
(ha+∆h−∆h∗)Lb La−∆h ∗=h b (27) which yields ∆h∗ =∆h/(1+Lb La ). (28)
Considering that the size of the image plane of the CMOS image sensor is normally much smaller than that of the lens module and the image plane is placed very close to the focal point of the lens module, thus, La Lb. Therefore, the above analysis leads to the control objective of the OIS as
∆h∗≈∆h. (29)
It is pertinent to note at this point that the control objective in Equation (29) is equivalent to moving the lens in OIS exactly opposite to the movement of the camera due to hand shaking; that is, keeping the lens motionless to ground for image blur compensation. Similar analysis as that outlined above can also be conducted for the case of the camera under rotational disturbance, as shown in Figure3b. This analysis also arrives at the same control objective in Equation (29) with the assumption of La Lb. Note that several optical control objectives similar to Equation (29) were also reported in [17,18]. It has become one of the fundamental, validated rules-of-thumb for OIS in industry. In conclusion, the realistic, combined disturbance along x-, y-, θx- and θy-axes due to hand shaking on the mobile phone camera can be compensated for effectively with the single objective of moving the lens as if motionless to ground by the actuation exerted by OIS.
Sensors 2017, 17, 2333 8 of 18
Figure 3b. This analysis also arrives at the same control objective in Equation (29) with the assumption of 𝐿𝑎≫ 𝐿𝑏. Note that several optical control objectives similar to Equation (29) were also reported in [17,18]. It has become one of the fundamental, validated rules-of-thumb for OIS in industry. In conclusion, the realistic, combined disturbance along x-, y-, 𝜃𝑥- and 𝜃𝑦-axes due to hand shaking on the mobile phone camera can be compensated for effectively with the single objective of moving the lens as if motionless to ground by the actuation exerted by OIS.
(a) (b)
Figure 3. The optical working principles of OIS (a) under translational disturbance from hand
shaking; (b) under rotational disturbance.
Figure 4. Desired movement of lens holder to compensate for the image blur caused by hand shaking.
3.2. The Closed-Loop System for the OIS
With equations of motion and control objective successfully derived, the closed-loop system for the OIS is ready to synthesize, which is illustrated in Figure 5. In this figure, the four VCMs are driven by a driver circuit which accepts control effort signals from the output of the lead-lag controller. On the other hand, there are Hall Effect sensors installed inside the OIS to sense the relative motion of the lens holder to image base. The signals of the Hall Effect sensors are fed to the controller as feedback to be subtracted from the desired lens movement to compensate for the image blurs by hand Figure 3.The optical working principles of OIS (a) under translational disturbance from hand shaking; (b) under rotational disturbance.
Sensors 2017, 17, 2333 9 of 18
Figure 3b. This analysis also arrives at the same control objective in Equation (29) with the assumption of 𝐿𝑎≫ 𝐿𝑏. Note that several optical control objectives similar to Equation (29) were also reported in [17,18]. It has become one of the fundamental, validated rules-of-thumb for OIS in industry. In conclusion, the realistic, combined disturbance along x-, y-, 𝜃𝑥- and 𝜃𝑦-axes due to hand shaking on the mobile phone camera can be compensated for effectively with the single objective of moving the lens as if motionless to ground by the actuation exerted by OIS.
(a) (b)
Figure 3. The optical working principles of OIS (a) under translational disturbance from hand
shaking; (b) under rotational disturbance.
Figure 4. Desired movement of lens holder to compensate for the image blur caused by hand shaking.
3.2. The Closed-Loop System for the OIS
With equations of motion and control objective successfully derived, the closed-loop system for the OIS is ready to synthesize, which is illustrated in Figure 5. In this figure, the four VCMs are driven by a driver circuit which accepts control effort signals from the output of the lead-lag controller. On the other hand, there are Hall Effect sensors installed inside the OIS to sense the relative motion of the lens holder to image base. The signals of the Hall Effect sensors are fed to the controller as feedback to be subtracted from the desired lens movement to compensate for the image blurs by hand Figure 4.Desired movement of lens holder to compensate for the image blur caused by hand shaking. 3.2. The Closed-Loop System for the OIS
With equations of motion and control objective successfully derived, the closed-loop system for the OIS is ready to synthesize, which is illustrated in Figure5. In this figure, the four VCMs are driven by a driver circuit which accepts control effort signals from the output of the lead-lag controller. On the other hand, there are Hall Effect sensors installed inside the OIS to sense the relative motion of the lens holder to image base. The signals of the Hall Effect sensors are fed to the controller as feedback to be subtracted from the desired lens movement to compensate for the image blurs by hand shaking. As for the acquisition of the desired lens movement, this is obtained by first sensing the camera movement due to hand shaking by the gyroscope (MPU-6500 by InvenSense, which is supposed to be built into the mobile camera phone). Then the desired lens movement is set up based on Equation (29), i.e., to move the lens in OIS exactly opposite to the movement of the camera due to handshaking; that is, keeping the lens motionless relative to ground at all times. As a result, image blur can be effectively compensated. Note finally, that the VCM driver is implemented by driver circuitry with an H-bridge simplifier inside, which outputs pulse-width modulation (PWM) to regulate the currents through VCMs to be proportional to the output of the lead-lag controller.
Sensors 2017, 17, 2333 9 of 18
shaking. As for the acquisition of the desired lens movement, this is obtained by first sensing the camera movement due to hand shaking by the gyroscope (MPU-6500 by InvenSense, which is supposed to be built into the mobile camera phone). Then the desired lens movement is set up based on Equation (29), i.e., to move the lens in OIS exactly opposite to the movement of the camera due to handshaking; that is, keeping the lens motionless relative to ground at all times. As a result, image blur can be effectively compensated. Note finally, that the VCM driver is implemented by driver circuitry with an H-bridge simplifier inside, which outputs pulse-width modulation (PWM) to regulate the currents through VCMs to be proportional to the output of the lead-lag controller.
Figure 5. The closed-loop control system of the OIS.
3.3. System Identification for the OIS
The OIS model is identified in this section based on experimental frequency responses of the OIS system; that is, experimental Bode plots. Utilizing a spectrum analyzer, the frequency responses of the designed OIS along different axes can be obtained with swept sinusoidal input signals to drive the circuit of the OIS and using a laser displacement sensor to measure its responses. Measured frequency responses are shown in Figure 6, where four different responses are presented. Figure 6a shows the experimental frequency response in the x axis with VCM driving along the x axis, exhibiting a resonance at 57.59 Hz. Figure 6b shows experimental the frequency response of the OIS in the y axis with VCM driving along the y axis, exhibiting a resonance at 57.39 Hz. Figure 6c shows the experimental frequency response of the OIS in the x axis with VCM driving along the y axis, exhibiting a resonance at 57.60 Hz. Figure 6d shows the experimental frequency response of the OIS in the y axis with VCM driving along the x axis, exhibiting a resonance at 57.40 Hz. Due to the fact that the resonance in Figure 6a, 57.59 Hz, is very close to Figure 6b, 57.39 Hz, the structure of the OIS, a four-wire suspended structure is highly symmetric between x and y. On the other hand, the frequency responses in Figure 6c,d represent the coupling dynamics between the x and y axes, which results from very limited asymmetry in the OIS between the x and y axes. The amplitudes in Figure 6c,d are significantly smaller than those in the direct dynamics in Figure 6a,b; this indicates that the coupled dynamics of the OIS, corresponding to those cross-diagonal terms in Equations (22)–(26), influence the overall dynamics of OIS much less than direct dynamics, corresponding to the diagonal terms in Equations (22)–(26).
Figure 5.The closed-loop control system of the OIS. 3.3. System Identification for the OIS
The OIS model is identified in this section based on experimental frequency responses of the OIS system; that is, experimental Bode plots. Utilizing a spectrum analyzer, the frequency responses of the designed OIS along different axes can be obtained with swept sinusoidal input signals to drive the circuit of the OIS and using a laser displacement sensor to measure its responses. Measured
Sensors 2017, 17, 2333 10 of 18
frequency responses are shown in Figure6, where four different responses are presented. Figure6a shows the experimental frequency response in the x axis with VCM driving along the x axis, exhibiting a resonance at 57.59 Hz. Figure6b shows experimental the frequency response of the OIS in the y axis with VCM driving along the y axis, exhibiting a resonance at 57.39 Hz. Figure6c shows the experimental frequency response of the OIS in the x axis with VCM driving along the y axis, exhibiting a resonance at 57.60 Hz. Figure6d shows the experimental frequency response of the OIS in the y axis with VCM driving along the x axis, exhibiting a resonance at 57.40 Hz. Due to the fact that the resonance in Figure6a, 57.59 Hz, is very close to Figure6b, 57.39 Hz, the structure of the OIS, a four-wire suspended structure is highly symmetric between x and y. On the other hand, the frequency responses in Figure6c,d represent the coupling dynamics between the x and y axes, which results from very limited asymmetry in the OIS between the x and y axes. The amplitudes in Figure6c,d are significantly smaller than those in the direct dynamics in Figure6a,b; this indicates that the coupled dynamics of the OIS, corresponding to those cross-diagonal terms in Equations (22)–(26), influence the overall dynamics of OIS much less than direct dynamics, corresponding to the diagonal terms in
Equations (22)–(26).Sensors 2017, 17, 2333 10 of 18
(a) (b)
(c) (d)
Figure 6. Experimental and simulated Bode plots of the nonlinear Equations (18)–(20) of OIS.(a) Experimental and simulated Bode plots of nonlinear OIS in xaxis with VCM driving along x axis, showing a resonance at 57.59 Hz; (b) Experimental and simulated Bode plots of nonlinear OIS in y axis with VCM driving along y axis, showing a resonance at 57.39 Hz; (c) Experimental and simulated Bode plots of nonlinear OIS in x axis with VCM driving along y axis, showing a resonance at 57.60 Hz; (d) Experimental and simulated Bode plots of nonlinear OIS in y axis with VCM driving along x axis, showing a resonance at 57.40 Hz.
Along with the experimental frequency responses in Figure 6a,b there are theoretical frequency responses simulated by the established nonlinear governing equations of motion (18)–(20) with available information about the varied dimensions of the OIS, the mass of the lens holder, the spring constant estimated by a finite element model, and a simple vibration experiment to obtain the damping coefficient. Table 2 lists the identified parameters of the OIS. It can be seen from Figure 6a,b that the theoretical responses predicted by system Equations (18)–(20) are fairly close to their experimental counterparts, confirming the validity of the established Equations (18)–(20).
Table 2. Parameters of optical image stabilizer.
Item Specifications
Lens holder mass 0.5202 g
Stiffness (kx) in x axis 67.092 N/m Stiffness (ky) in x axis 67.081 N/m
Stiffness (kθ) in roll 4.189 × 10−4 Nm
Damping ratios 0.0577
3.4. Design of a Lead-Lag Controller
A simple lead-lag controller is designed based on the identified model to take advantage of simple digital computation via an FPGA board in order to achieve fast response. As compared to PID, the design process of a lead-lag controller allows one to determine controller parameters for a specific settling time and overshoot, which are very important for OIS control. On the other hand, the fractional controller employed in [15] is, in theory, a better choice than a simple lead-lag controller to achieve the precis, desired closed-loop performance. However, a typical fractional controller would consume much more time than a lead-lag controller to execute its algorithm in a digital chip due to Figure 6. Experimental and simulated Bode plots of the nonlinear Equations (18)–(20) of OIS. (a) Experimental and simulated Bode plots of nonlinear OIS in x axis with VCM driving along x axis, showing a resonance at 57.59 Hz; (b) Experimental and simulated Bode plots of nonlinear OIS in y axis with VCM driving along y axis, showing a resonance at 57.39 Hz; (c) Experimental and simulated Bode plots of nonlinear OIS in x axis with VCM driving along y axis, showing a resonance at 57.60 Hz; (d) Experimental and simulated Bode plots of nonlinear OIS in y axis with VCM driving along x axis, showing a resonance at 57.40 Hz.
Along with the experimental frequency responses in Figure6a,b there are theoretical frequency responses simulated by the established nonlinear governing equations of motion (18)–(20) with available information about the varied dimensions of the OIS, the mass of the lens holder, the spring constant estimated by a finite element model, and a simple vibration experiment to obtain the damping coefficient. Table2lists the identified parameters of the OIS. It can be seen from Figure6a,b that the theoretical responses predicted by system Equations (18)–(20) are fairly close to their experimental counterparts, confirming the validity of the established Equations (18)–(20).
Table 2.Parameters of optical image stabilizer.
Item Specifications
Lens holder mass 0.5202 g
Stiffness (kx) in x axis 67.092 N/m
Stiffness (ky) in y axis 67.081 N/m
Stiffness (kθ) in roll 4.189×10−4Nm
Damping ratios 0.0577
3.4. Design of a Lead-Lag Controller
A simple lead-lag controller is designed based on the identified model to take advantage of simple digital computation via an FPGA board in order to achieve fast response. As compared to PID, the design process of a lead-lag controller allows one to determine controller parameters for a specific settling time and overshoot, which are very important for OIS control. On the other hand, the fractional controller employed in [15] is, in theory, a better choice than a simple lead-lag controller to achieve the precis, desired closed-loop performance. However, a typical fractional controller would consume much more time than a lead-lag controller to execute its algorithm in a digital chip due to its more complicated nature. For the OIS in a mobile phone camera, a fast settling time is much required.
A typical lead-lag controller is in the form of a lead controller cascaded with a lag controller. On the other hand, since the system of a lens holder and spring wires fixed to the image base is a Type I system, to eliminate steady state error, there must be a free integrator in the lead-lag controller, yielding
C(s) = kp(s−z1)(s−z2)
s(s−p1)(s−p2), (30)
where z1and p1are the zero and pole of the lead controller while z2and p2are the zero and pole of the lag controller, respectively. kpis the proportional gain. The determination of realistic values of z1, p1, z2and p2starts with setting the final control goals for the closed-loop system of a commercial OIS with a transient period, ts, less than 0.02 s [18] and the overshoot limited by 5%. The overshoot of 5% leads to the damping ratio, ζ, of 0.6925, and equivalently, a phase margin (PM) of 69.25◦. The desired condition of ts< 0.02 s together with the determined ζ of 0.6925 decide the poles of the final closed-loop system as in [19],
sd= −ςωn±jωn q
1−ς2= −200±j208.342, (31)
for the plant along either x- or y-directions (both are symmetric), where ωnis determined by the approximation of ωn = 4/(ζts). In the next step, z1 is designed as −126.9, close to the pole in Equation (31), to contribute 90◦in root loci in the complex plane from open-loop to closed-loop, which is based on the nonlinear governing equations of motion for the system as given in Equations (22)–(26). p1 is determined to be −11,600 to achieve more than 180◦ for robustness to tackle the coupling dynamics as captured by the final closed-loop system. With the steady-state error desired to be under 2%, kpis designed as 3500. In the next step, the lag controller is designed to further minimize the steady-state error without affecting the pre-designed transient period of 0.02 s. To this end, p2is determined as−0.01 to avoid the effects on the pre-designated transient period, while z2is designed as−1 to further minimize steady-state error without affecting the pre-designed transient period of 0.02 s. Finally, we have the lead-lag controller as
C(s) = 3500(s+1)(s+126.9)
s(s+0.01)(s+116, 000). (32)
Figure7a shows the Bode plots of experimental/theoretical uncompensated nonlinear plants in x-direction and the plant compensated by the designed lead-lag controller in Equation (32). A phase margin of PM~69.25 as pre-designed, can be seen as achieved by the compensated nonlinear plant.
Sensors 2017, 17, 2333 12 of 18
Figure7b shows the simulated step response of the compensated nonlinear plant along x-direction, where a transient period much less than 0.005 s and an overshoot around 5% are clearly seen.
Sensors 2017, 17, 2333 11 of 18
its more complicated nature. For the OIS in a mobile phone camera, a fast settling time is much required.
A typical lead-lag controller is in the form of a lead controller cascaded with a lag controller. On the other hand, since the system of a lens holder and spring wires fixed to the image base is a Type I system, to eliminate steady state error, there must be a free integrator in the lead-lag controller, yielding
𝐶(𝑠) =𝑘𝑠(𝑠−𝑝𝑝(𝑠−𝑧1)(𝑠−𝑧2)
1)(𝑠−𝑝2), (30)
where 𝑧1 and 𝑝1 are the zero and pole of the lead controller while 𝑧2 and 𝑝2 are the zero and pole of the lag controller, respectively. 𝑘𝑝 is the proportional gain. The determination of realistic values of 𝑧1, 𝑝1, 𝑧2 and 𝑝2 starts with setting the final control goals for the closed-loop system of a commercial OIS with a transient period, ts, less than 0.02 s [18] and the overshoot limited by 5%. The
overshoot of 5% leads to the damping ratio, ζ, of 0.6925, and equivalently, a phase margin (PM) of 69.25°. The desired condition of ts < 0.02 s together with the determined ζ of 0.6925 decide the poles
of the final closed-loop system as in [19],
342 . 208 200 1 2 j j sdn n , (31)
for the plant along either x- or y-directions (both are symmetric), where ωn is determined by the
approximation of ωn = 4/(ζts). In the next step, 𝑧1 is designed as −126.9, close to the pole in Equation
(31), to contribute 90° in root loci in the complex plane from open-loop to closed-loop, which is based on the nonlinear governing equations of motion for the system as given in Equations (22)–(26). 𝑝1 is determined to be −11,600 to achieve more than 180° for robustness to tackle the coupling dynamics as captured by the final closed-loop system. With the steady-state error desired to be under 2%, 𝑘𝑝 is designed as 3500. In the next step, the lag controller is designed to further minimize the steady-state error without affecting the pre-designed transient period of 0.02 s. To this end, 𝑝2 is determined as −0.01 to avoid the effects on the pre-designated transient period, while 𝑧2 is designed as −1 to further minimize steady-state error without affecting the pre-designed transient period of 0.02 s. Finally, we have the lead-lag controller as
𝐶(𝑠) = 3500(𝑠+1)(𝑠+126.9)
𝑠(𝑠+0.01)(𝑠+116000). (32)
Figure 7a shows the Bode plots of experimental/theoretical uncompensated nonlinear plants in
x-direction and the plant compensated by the designed lead-lag controller in Equation (32). A phase
margin of PM~69.25 as pre-designed, can be seen as achieved by the compensated nonlinear plant. Figure 7b shows the simulated step response of the compensated nonlinear plant along x-direction, where a transient period much less than 0.005 s and an overshoot around 5% are clearly seen.
∠ Uncompensated |Uncompensated| ∠ C ompensated |C ompensated| PM=69.25∘ (a) Sensors 2017, 17, 2333 12 of 18 0.05 0.005sec 0.02 (b)
Figure 7. Simulated results with the designed controller applied to the OIS. (a) Bode plots for
x-direction; (b) step response along x-direction. 4. Simulation and Experimental Results 4.1. Simulation Results
Simulations were conducted using MATLAB to verify the performance of the lead-lag controller as designed in Equation (32). In these simulations, disturbances due to hand shaking on the OIS are assumed harmonics at 5, 10, 15, 20 Hz, which in fact correspond to the main harmonics of common hand shakings. Figure 8 shows the simulated response of the lens holder in OIS along x-direction relative to ground with the lead-lag controller designed and applied to both the x- and y-direction of the OIS to suppress the coupling effects from 𝜃𝑧𝑙 direction; i.e., those non-zero cross terms in Equations (22)–(26), with some degree of robustness. It is seen from these figures that the designed lead-lag controller is able to control the lens holder at steady state with a residual disturbance within 2.4 μm in amplitude; that is, almost motionless to the ground. This 2.4 μm of residual vibration for the lens holder is actually smaller than the common pixel size of a CMOS/CCD image sensor plane, which is around 2.4–30 μm [20]. Thus, the controller has successfully suppressed the negative effect of hand-shake disturbance on image stabilization, effectively reducing image blurs.
2.4um Hand Shaking Compensated Shock signal (a) (b) 2.4um Hand Shaking Compensated Shock signal
Figure 7.Simulated results with the designed controller applied to the OIS. (a) Bode plots for x-direction; (b) step response along x-direction.
4. Simulation and Experimental Results
4.1. Simulation Results
Simulations were conducted using MATLAB to verify the performance of the lead-lag controller as designed in Equation (32). In these simulations, disturbances due to hand shaking on the OIS are assumed harmonics at 5, 10, 15, 20 Hz, which in fact correspond to the main harmonics of common hand shakings. Figure8shows the simulated response of the lens holder in OIS along x-direction relative to ground with the lead-lag controller designed and applied to both the x- and y-direction of the OIS to suppress the coupling effects from θzl direction; i.e., those non-zero cross terms in Equations (22)–(26), with some degree of robustness. It is seen from these figures that the designed lead-lag controller is able to control the lens holder at steady state with a residual disturbance within 2.4 µm in amplitude; that is, almost motionless to the ground. This 2.4 µm of residual vibration for the lens holder is actually smaller than the common pixel size of a CMOS/CCD image sensor plane, which is around 2.4–30 µm [20]. Thus, the controller has successfully suppressed the negative effect of hand-shake disturbance on image stabilization, effectively reducing image blurs.
Sensors 2017, 17, 2333 13 of 18
0.05
0.005sec 0.02
(b)
Figure 7. Simulated results with the designed controller applied to the OIS. (a) Bode plots for
x-direction; (b) step response along x-direction. 4. Simulation and Experimental Results 4.1. Simulation Results
Simulations were conducted using MATLAB to verify the performance of the lead-lag controller as designed in Equation (32). In these simulations, disturbances due to hand shaking on the OIS are assumed harmonics at 5, 10, 15, 20 Hz, which in fact correspond to the main harmonics of common hand shakings. Figure 8 shows the simulated response of the lens holder in OIS along x-direction relative to ground with the lead-lag controller designed and applied to both the x- and y-direction of the OIS to suppress the coupling effects from 𝜃𝑧𝑙 direction; i.e., those non-zero cross terms in Equations (22)–(26), with some degree of robustness. It is seen from these figures that the designed lead-lag controller is able to control the lens holder at steady state with a residual disturbance within 2.4 μm in amplitude; that is, almost motionless to the ground. This 2.4 μm of residual vibration for the lens holder is actually smaller than the common pixel size of a CMOS/CCD image sensor plane, which is around 2.4–30 μm [20]. Thus, the controller has successfully suppressed the negative effect of hand-shake disturbance on image stabilization, effectively reducing image blurs.
2.4um Hand Shaking Compensated Shock signal (a) (b) 2.4um Hand Shaking Compensated Shock signal Sensors 2017, 17, 2333 13 of 18 2.2um Hand Shaking Compensated Shock signal 2.0um Hand Shaking Compensated Shock signal (c) (d)
Figure 8. Simulated response of the lens holder motion relative to ground with the designed controller
applied to the OIS; (a) 5 Hz disturbance in ±50 μm; (b) 10 Hz disturbance in ±50 μm; (c) 15Hz disturbance in ±50 μm; (d) 20 Hz disturbance in ±50 μm.
4.2. Experimental Results
Experiments were conducted to test the performance of the designed lead-lag controller for stabilizing the lens holder relative to ground, with the aim of reducing imaging blur. Figure 9a shows the setup for conducting the experiments, while Figure 9b illustrates the connection between the device and instruments. In this experimental system, there is an OIS driven by a current drive IC to drive the the lens holder in OIS along x- and y-directions, a tranlational 2-DOF shaker to simulate hand-shaking disturbance to the OIS, an FPGA board realizing the designed lead-lag controller, and a laser displacement sensor to measure the movement of the lens holder. There are also Hall Effect sensors built into the OIS to measure the real-time motion of the lens holder relative to the OIS image base, and a gyroscope for measuring the motion of the shaker as mimicking hand shake.
Figure 10 shows the experimental results of the Hall Effect sensor output for measuring the motion of the lens holder along x-direction, with PWM drive signals generated from the current drive IC and step commands of 30 and 50 μm programmed by the current drive IC in Figure 10a,b, respectively. It can be clearly seen from these figures that the lead-lag controller is able to control the lens holder position to the desired 30 and 50 μm within 0.02 s. Thanks to digital implementation of the simple lead-lag controller, this settling time of 0.02 s is much better than prior studies [10] with results of around 0.1 s.
FPGA Board
Hall Sensor Readout Circuit and VCM Driver Circuit
Shaker Laser Displacement Sensor OIS Gyro (a)
Figure 8.Simulated response of the lens holder motion relative to ground with the designed controller applied to the OIS; (a) 5 Hz disturbance in±50 µm; (b) 10 Hz disturbance in±50 µm; (c) 15 Hz disturbance in±50 µm; (d) 20 Hz disturbance in±50 µm.
4.2. Experimental Results
Experiments were conducted to test the performance of the designed lead-lag controller for stabilizing the lens holder relative to ground, with the aim of reducing imaging blur. Figure9a shows the setup for conducting the experiments, while Figure9b illustrates the connection between the device and instruments. In this experimental system, there is an OIS driven by a current drive IC to drive the the lens holder in OIS along x- and y-directions, a tranlational 2-DOF shaker to simulate hand-shaking disturbance to the OIS, an FPGA board realizing the designed lead-lag controller, and a laser displacement sensor to measure the movement of the lens holder. There are also Hall Effect sensors built into the OIS to measure the real-time motion of the lens holder relative to the OIS image base, and a gyroscope for measuring the motion of the shaker as mimicking hand shake.
Figure10shows the experimental results of the Hall Effect sensor output for measuring the motion of the lens holder along x-direction, with PWM drive signals generated from the current drive IC and step commands of 30 and 50 µm programmed by the current drive IC in Figure10a,b, respectively. It can be clearly seen from these figures that the lead-lag controller is able to control the lens holder position to the desired 30 and 50 µm within 0.02 s. Thanks to digital implementation of the simple lead-lag controller, this settling time of 0.02 s is much better than prior studies [10] with results of around 0.1 s.
Sensors 2017, 17, 2333 14 of 18 Sensors 2017, 17, 2333 13 of 18 2.2um Hand Shaking Compensated Shock signal 2.0um Hand Shaking Compensated Shock signal (c) (d)
Figure 8. Simulated response of the lens holder motion relative to ground with the designed controller
applied to the OIS; (a) 5 Hz disturbance in ±50 μm; (b) 10 Hz disturbance in ±50 μm; (c) 15Hz disturbance in ±50 μm; (d) 20 Hz disturbance in ±50 μm.
4.2. Experimental Results
Experiments were conducted to test the performance of the designed lead-lag controller for stabilizing the lens holder relative to ground, with the aim of reducing imaging blur. Figure 9a shows the setup for conducting the experiments, while Figure 9b illustrates the connection between the device and instruments. In this experimental system, there is an OIS driven by a current drive IC to drive the the lens holder in OIS along x- and y-directions, a tranlational 2-DOF shaker to simulate hand-shaking disturbance to the OIS, an FPGA board realizing the designed lead-lag controller, and a laser displacement sensor to measure the movement of the lens holder. There are also Hall Effect sensors built into the OIS to measure the real-time motion of the lens holder relative to the OIS image base, and a gyroscope for measuring the motion of the shaker as mimicking hand shake.
Figure 10 shows the experimental results of the Hall Effect sensor output for measuring the motion of the lens holder along x-direction, with PWM drive signals generated from the current drive IC and step commands of 30 and 50 μm programmed by the current drive IC in Figure 10a,b, respectively. It can be clearly seen from these figures that the lead-lag controller is able to control the lens holder position to the desired 30 and 50 μm within 0.02 s. Thanks to digital implementation of the simple lead-lag controller, this settling time of 0.02 s is much better than prior studies [10] with results of around 0.1 s.
FPGA Board
Hall Sensor Readout Circuit and VCM Driver Circuit
Shaker Laser Displacement Sensor OIS Gyro (a) Sensors 2017, 17, 2333 14 of 18 (b)
Figure 9. (a) Experimental Setup; (b) Devices and apparatus in connection.
0.02s PWM Hall sensor 30um 0.02s PWM Hall sensor 5 0um (a) (b)
Figure 10. Experimental results of step responses with the designed controller applied to the OIS
along x-direction; (a) Step command of 30 μm; (b) Step command of 50 μm.
Figure 11 shows the measured movement of the lens holder with external disturbance programmed by the shaker to mimic major frequencies of a typical hand-shaking disturbance along
x-direction. The disturbance generated by the shaker are at an amplitude of 40 μm at different
frequencies of 6, 10, 14, and 18 Hz, corresponding to the main frequencies of typical hand shaking. It can be clearly seen from these figures that as the OIS becomes active, the lens holder is effectively stabilized by the lead-lag controller to be almost motionless to ground within 2.2–2.5 μm, as expected according to the simulations in Figure 8. The residual vibrations are all around 2.2–2.5 μm in magnitude, which is less than or approximately equal to the common pixel size of a CCD/CMOS camera of 2.4–3.0 μm [20]. Thus, it is proven that the designed controller has successfully suppressed the negative effect of hand-shake disturbance on image stabilization in a general mobile phone camera, effectively reducing image blurs.
40um 2.5um 40um 2.5um (a) (b) Shaker Function Generator OIS Hall Sensor Readout Circuit Power Supply Gyro FPGA board DE1-SoC VCM Driver
Figure 9.(a) Experimental Setup; (b) Devices and apparatus in connection.
Sensors 2017, 17, 2333 14 of 18
(b)
Figure 9. (a) Experimental Setup; (b) Devices and apparatus in connection.
0.02s PWM Hall sensor 30um 0.02s PWM Hall sensor 5 0um (a) (b)
Figure 10. Experimental results of step responses with the designed controller applied to the OIS along x-direction; (a) Step command of 30 μm; (b) Step command of 50 μm.
Figure 11 shows the measured movement of the lens holder with external disturbance programmed by the shaker to mimic major frequencies of a typical hand-shaking disturbance along x-direction. The disturbance generated by the shaker are at an amplitude of 40 μm at different frequencies of 6, 10, 14, and 18 Hz, corresponding to the main frequencies of typical hand shaking. It can be clearly seen from these figures that as the OIS becomes active, the lens holder is effectively stabilized by the lead-lag controller to be almost motionless to ground within 2.2–2.5 μm, as expected according to the simulations in Figure 8. The residual vibrations are all around 2.2–2.5 μm in magnitude, which is less than or approximately equal to the common pixel size of a CCD/CMOS camera of 2.4–3.0 μm [20]. Thus, it is proven that the designed controller has successfully suppressed the negative effect of hand-shake disturbance on image stabilization in a general mobile phone camera, effectively reducing image blurs.
40um 2.5um 40um 2.5um (a) (b) Shaker Function Generator OIS Hall Sensor Readout Circuit Power Supply Gyro FPGA board DE1-SoC VCM Driver
Figure 10.Experimental results of step responses with the designed controller applied to the OIS along x-direction; (a) Step command of 30 µm; (b) Step command of 50 µm.
Figure 11 shows the measured movement of the lens holder with external disturbance programmed by the shaker to mimic major frequencies of a typical hand-shaking disturbance along x-direction. The disturbance generated by the shaker are at an amplitude of 40 µm at different frequencies of 6, 10, 14, and 18 Hz, corresponding to the main frequencies of typical hand shaking. It can be clearly seen from these figures that as the OIS becomes active, the lens holder is effectively stabilized by the lead-lag controller to be almost motionless to ground within 2.2–2.5 µm, as expected according to the simulations in Figure8. The residual vibrations are all around 2.2–2.5 µm in magnitude, which is less than or approximately equal to the common pixel size of a CCD/CMOS camera of 2.4–3.0 µm [20]. Thus, it is proven that the designed controller has successfully suppressed the negative effect of hand-shake disturbance on image stabilization in a general mobile phone camera, effectively reducing image blurs.
