Abstract

In this paper, a joint gesture tracking method combining particle filter and mean shift algorithm is proposed to improve the accuracy and robustness of the system. During the slow movement of the human hand, the average movement of the particles is first used to cause most of the particles to drift into the gesture area. In the case where the movement of the human hand is faster or there is occlusion, when the mean shift of the particle is performed, if the region of the gesture is not detected, the particle will return to the state before the drift, and then the next frame is processed. The method can directly calculate the position of the gesture based on the particles used for subsequent testing, and can save the tracking time of the algorithm. Through experimental simulation, compared with the Cam-shift algorithm, when the sampling point of the joint tracking algorithm proposed in this paper is 200, the tracking accuracy is improved to 95.2%. Compared with 90.6% of the Cam-shift algorithm, the tracking time is reduced from 83.7 ms to 25.8 ms. Therefore, the proposed algorithm can greatly improve the tracking accuracy and real-time, and can also effectively reduce the impact of complex environments on the tracking effect.

References

1.
Alexandre
,
L. A.
,
2010
, “
Gender Recognition: A Multiscale Decision Fusion Approach
,”
Pattern Recognit. Lett.
,
31
(
11
), pp.
1422
1427
.10.1016/j.patrec.2010.02.010
2.
Lu
,
W.
,
Tong
,
Z.
, and
Chu
,
J.
,
2016
, “
Dynamic Hand Gesture Recognition With Leap Motion Controller
,”
IEEE Signal Process. Lett.
,
23
(
9
), pp.
1188
1192
.10.1109/LSP.2016.2590470
3.
Cheng
,
H.
,
Yang
,
L.
, and
Liu
,
Z.
,
2016
, “
Survey on 3D Hand Gesture Recognition
,”
IEEE Trans. Circuits Syst. Video Technol.
,
26
(
9
), pp.
1659
1673
.10.1109/TCSVT.2015.2469551
4.
Abdulhussain
,
E. M.
, and
Lorenzo
,
F.
,
2015
, “
An Improved Capacitively Coupled Contactless Conductivity Detection Sensor for Industrial Applications
,”
Sens. Actuators, A
,
222
(
1
), pp.
176
183
.10.1016/j.sna.2015.09.038
5.
Zhang
,
J.
,
Xiong
,
J.
,
Ren
,
M.
,
Shi
,
Y. T.
, and
Xu
,
J. L.
,
2016
, “
Filter-Based Fault Diagnosis of Wind Energy Conversion Systems Subject to Sensor Faults
,”
ASME J. Dyn. Syst. Meas. Control
,
138
(
6
), p.
061008
.10.1115/1.4032827
6.
Li
,
Y.
,
2012
, “
Hand Gesture Recognition Using Kinect
,”
IEEE Third International Conference on Software Engineering and Service Science
, Beijing, China, June 22–24, pp.
197
198
.10.1109/ICSESS.2012.6269439
7.
Yang
,
C.
,
Jang
,
Y.
,
Beh
,
J.
,
Xie
,
Q.
, and
Xu
,
Y.
,
2012
, “
Gesture Recognition Using Depth-Based Hand Tracking for Contactless Controller Application
,” IEEE
International Conference on Consumer Electronics
(
ICCE
), Las Vegas, NV, Jan. 13–16, pp.
297
298
.10.1109/ICCE.2012.6161876
8.
Tang
,
C.
,
Ou
,
Y.
,
Jiang
,
G.
,
Han
,
D.
, and
Ko
,
H.
,
2012
, “
Hand Tracking and Pose Recognition Via Depth and Color Information
,”
IEEE International Conference on Robotics and Biomimetics
(
ROBIO
), Guangzhou, China, Dec. 11–14, pp.
1104
1109
.10.1109/ROBIO.2012.6491117
9.
Alamsyah
, ,
D.
, and
Fanany
,
M. I.
,
2013
, “
Particle Filter for 3D Fingertips Tracking From Color and Depth Images With Occlusion Handling
,” IEEE
International Conference on Advanced Computer Science and Information Systems
(
ICACSIS
), Bali, Indonesia, Sept. 28–29, pp.
445
449
.10.1109/ICACSIS.2013.6761616
10.
Keskin
,
C.
,
Kirac
,
F.
,
Kara
,
Y. E.
, and
Akarun
,
L.
,
2013
, “
Real Time Hand Pose Estimation Using Depth Sensors
,”
Consumer Depth Cameras for Computer Vision
,
Springer
,
London
, pp.
119
137
.
11.
Mure
,
S.
,
Grenier
,
T.
,
Meier
,
D. S.
,
Guttmann
,
C.
, and
Benoit-Cattin
,
H.
,
2015
, “
Unsupervised Spatio-Temporal Filtering of Image Sequences. A Mean-Shift Specification
,”
Pattern Recognit. Lett.
,
68
, pp.
48
55
.10.1016/j.patrec.2015.07.021
12.
Chen
,
C. P.
,
Chen
,
Y.
,
Lee
,
P.
,
Tsai
,
Y. P.
, and
Lei
,
S.
,
2011
, “
Real-Time Hand Tracking on Depth Images
,”
IEEE Conference on Visual Communications and Image Processing
(
VCIP
), Tainan, Taiwan, Nov. 6–9, pp.
1
4
.10.1109/VCIP.2011.6115983
13.
Yu
,
L.
,
Li
,
C.
, and
Fei
,
S.
,
2018
, “
Any-Wall Touch Control System With Switching Filter Based on 3D Sensor
,”
IEEE Sens. J.
,
18
(
11
), pp.
4697
4703
.10.1109/JSEN.2018.2827386
14.
Poloni
,
T.
,
Eielsen
,
A.
,
Rohal'-Ilkiv
,
B.
, and
Johansen
,
T. A.
,
2013
, “
Adaptive Model Estimation of Vibration Motion for a Nanopositioner With Moving Horizon Optimized Extended Kalman Filter
,”
ASME J. Dyn. Syst. Meas. Control
,
135
(
4
), p.
041019
.10.1115/1.4024008
15.
Hsu
,
M. H.
,
Shih
,
T. K.
, and
Chiang
,
J. S.
,
2014
, “
Real-Time Finger Tracking for Virtual Instruments
,”
IEEE Seventh International Conference on Ubi-Media Computing and Workshops
(
UMEDIA
), Ulaanbaatar, Mongolia, July 12–14, pp.
133
138
.10.1109/U-MEDIA.2014.53
16.
Gonzalez-Sanchez
,
T.
, and
Puig
,
D.
,
2011
, “
Real-Time Body Gesture Recognition Using Depth Camera
,”
Electron. Lett.
,
47
(
12
), pp.
697
698
.10.1049/el.2011.0967
17.
Menegaz
,
H.
,
Ishihara
,
J. Y.
,
Borges
,
G. A.
, and
Vargas
,
A. N.
,
2015
, “
A Systematization of the Unscented Kalman Filter Theory
,”
IEEE Trans. Autom. Control
,
60
(
10
), pp.
2583
2598
.10.1109/TAC.2015.2404511
18.
Chen
,
K. B.
,
Anne
,
S. B.
,
Chourasia
,
A. O.
,
Wiegmann
,
D. A.
, and
Sesto
,
M. E.
,
2013
, “
Touch Screen Performance by Individuals With and Without Motor Control Disabilities
,”
Appl. Ergonom.
,
44
(
2
), pp.
297
302
.10.1016/j.apergo.2012.08.004
19.
Xu
,
H.
,
Yu
,
L.
, and
Fei
,
S.
,
2018
, “
Hand-Held 3D Reconstruction of Large-Scale Scene With Kinect Sensors Based on Surfel and Video Sequences
,”
IEEE Geosci. Remote Sensing Lett.
,
15
(
12
), pp.
1842
1846
.10.1109/LGRS.2018.2866280
20.
Yu
,
L.
, and
Hou
,
J.
,
2018
, “
Large Screen Interactive Imaging System With Switching Federated Filter Method Based on 3D Sensor
,”
Complexity
,
2018
, p.
8730281
.10.1155/2018/8730281
21.
Hou
,
J.
,
Yu
,
L.
, and
Fei
,
S.
,
2019
, “
Four-Point Trapezoidal Calibration Algorithm for Human-Computer Interaction System Based on 3D Sensor
,”
Measurements
,
134
, pp.
730
738
.10.1016/j.measurement.2018.11.016
22.
Schikora
,
M.
,
Gning
,
A.
,
Mihaylova
,
L.
,
Cremers
,
D.
, and
Koch
,
W.
,
2014
, “
Box-Particle Probability Hypothesis Density Filtering
,”
IEEE Trans. Aerosp. Electron. Syst.
,
50
(
3
), pp.
1660
1672
.10.1109/TAES.2014.120238
23.
Straka
,
O.
,
Dunik
,
J.
, and
Simandl
,
M.
,
2014
, “
Unscented Kalman Filter With Advanced Adaptation of Scaling Parameter
,”
Automatica
,
50
(
10
), pp.
2657
2664
.10.1016/j.automatica.2014.08.030
24.
Dai
,
G.
,
Yu
,
L.
,
Xu
,
H.
,
Hou
,
Z.
, and
Fei
,
S.
,
2018
, “
Federated Filter Algorithm With Positioning Technique Based on 3D Sensor
,”
Circuits Syst. Signal Process.
,
37
(
6
), pp.
2613
2628
.10.1007/s00034-017-0686-3
25.
Maqueda
,
A. I.
,
del-Blanco
,
C. R.
,
Jaureguizar
,
F.
, and
García
,
N.
,
2015
, “
Human–Computer Interaction Based on Visual Hand-Gesture Recognition Using Volumetric Spatiograms of Local Binary Patterns
,”
Comput. Vision Image Understanding
,
141
, pp.
126
137
.10.1016/j.cviu.2015.07.009
26.
Yu
,
L.
,
Fei
,
S.
,
Sun
,
L.
,
Huang
,
J.
, and
Yang
,
G.
,
2015
, “
Design of Robust Adaptive Neural Switching Controller for Robotic Manipulators With Uncertainty and Disturbances
,”
J. Intell. Rob. Syst.
,
77
(
3–4
), pp.
571
581
.10.1007/s10846-013-0008-3
27.
Yu
,
L.
,
Huang
,
J.
, and
Fei
,
S.
,
2019
, “
Robust Switching Control of the Direct-Drive Servo Control Systems Based on Disturbance Observer for Switching Gain Reduction
,”
IEEE Trans. Circuits Syst. II
,
26
(
8
), pp.
1366
1370
.10.1109/TCSII.2018.2881244
28.
Xu
,
H.
,
Yu
,
L.
,
Hou
,
J.
, and
Fei
,
S.
,
2019
, “
Automatic Reconstruction Method for Large Scene Based on Multi-Site Point Cloud Stitching
,”
Measurements
,
131
, pp.
590
596
.10.1016/j.measurement.2018.09.022
29.
Yu
,
L.
,
2018
, “
Image Noise Preprocessing of Interactive Projection System Based on Switching Filtering Scheme
,”
Complexity
,
2018
, p.
1258306
.10.1155/2018/1258306
30.
Park
,
G.
,
Hwang
,
Y.
, and
Choi
,
S. B.
,
2017
, “
Vehicle Positioning Based on Velocity and Heading Angle Observer Using Low-Cost Sensor Fusion
,”
ASME J. Dyn. Syst. Meas. Control
,
139
(
12
), p.
121008
.
31.
Xia
,
W.
,
Li
,
Y.
,
Chu
,
Y.
,
Xu
,
S.
, and
Zhang
,
Z. Q.
,
2017
, “
Dissipative Filter Design for Uncertain Markovian Jump Systems With Mixed Delays and Unknown Transition Rates
,”
Signal Process.
,
141
, pp.
176
186
.10.1016/j.sigpro.2017.06.002
32.
Yang
,
T.
, and
Mehta
,
P. G.
,
2018
, “
Probabilistic Data Association-Feedback Particle Filter for Multiple Target Tracking Applications
,”
ASME J. Dyn. Syst. Meas. Control
,
140
(
3
), p.
030905
.10.1115/1.4037781
You do not currently have access to this content.