Table of Contents Author Guidelines Submit a Manuscript
BioMed Research International
Volume 2014, Article ID 740469, 12 pages
Research Article

Microsoft Kinect-Based Artificial Perception System for Control of Functional Electrical Stimulation Assisted Grasping

1University of Belgrade-Faculty of Electrical Engineering, 11000 Belgrade, Serbia
2Tecnalia Serbia Ltd., 11000 Belgrade, Serbia
3Department of Translational Research and Knowledge Management, Otto Bock HealthCare GmbH, 37115 Duderstadt, Germany
4Serbian Academy of Sciences and Arts (SASA), 11000 Belgrade, Serbia

Received 28 February 2014; Revised 26 June 2014; Accepted 16 July 2014; Published 19 August 2014

Academic Editor: Mary Ellen Stoykov

Copyright © 2014 Matija Štrbac et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


We present a computer vision algorithm that incorporates a heuristic model which mimics a biological control system for the estimation of control signals used in functional electrical stimulation (FES) assisted grasping. The developed processing software acquires the data from Microsoft Kinect camera and implements real-time hand tracking and object analysis. This information can be used to identify temporal synchrony and spatial synergies modalities for FES control. Therefore, the algorithm acts as artificial perception which mimics human visual perception by identifying the position and shape of the object with respect to the position of the hand in real time during the planning phase of the grasp. This artificial perception used within the heuristically developed model allows selection of the appropriate grasp and prehension. The experiments demonstrate that correct grasp modality was selected in more than 90% of tested scenarios/objects. The system is portable, and the components are low in cost and robust; hence, it can be used for the FES in clinical or even home environment. The main application of the system is envisioned for functional electrical therapy, that is, intensive exercise assisted with FES.