Mechanic of Advanced and Smart Materials
Quarterly

Implementation of a Virtual Piano using Image Processing

Document Type : Original Article

Authors

Hassan Moradzadeh 1
Tannaneh Ghadimian 2

1 Electrical Eng. Department, Eng. Faculty, Arak University, Arak, IRAN

2 Department of Mechanical Engineering, Faculty of Engineering, Arak University, Arak, Iran

10.66224/masm.5.2.292.
Abstract
The aim of this project is to present an approach for developing a real-time hand gesture recognition which uses only a webcam and Computer Vision technology, such as image processing that can recognize several gestures for using in computer interface interaction. The most important goal of this project is to simulate playing a virtual piano using hand gesture recognition and recognizing specific gestures for each piano note. Implementing this virtual piano is done using a Personal Computer in MATLAB and also in Visual Studio C++ by OpenCV library environments and some comparisons is reported. The results show that implementing using OpenCV library is more fast and has higher performance than using MATLAB. Hand gesture distinguish accuracy is about 86.45% in MATLAB environment and about 92.7% using OpenCV library. Comparing the results based on consumed time to correctly distinguish a hand gesture is about 1.39 seconds in MATLAB environment and about 1.19 seconds using OpenCV library.

Keywords

Virtual Piano
Image Processing
Hand Gesture Recognition
MATLAB
OpenCV
[1]    Ji B, et al. Flexible strain sensor-based data glove for gesture interaction in the metaverse: A review. Int J Hum Comput Interact. 2023;40(4):1–20.
[2]    Lin BS, Lee IJ, Yang SY, Lo YC. Design of an inertial-sensor-based data glove for hand function evaluation. Sensors. 2018;18(5):1545.
[3]    Kverh B, Lipanje M, Batagelj B, Solina F. Piano Crossing—Walking on a keyboard. Acta Graph. 2010;21(3–4):223–24.
[4]    Yoshinari T, Tsutomu T, Shojiro N. Design and implementation of a real-time fingering detection system for piano performance. In: Proceedings of the International Computer Music Conference (ICMC); 2006:67–74.
[5]    Sakthivel S, Anbarasi A. Hand gesture recognition system for human-computer interaction. Int J Recent Trends Electr Electron Eng. 2014:121–32.
[6]    Zhou X, Koltun V, Krähenbühl P. Tracking objects as points. In: Proceedings of the European Conference on Computer Vision (ECCV); 2020:474–90.
[7]    Shen C, Kim J, Wang H. Generalized kernel-based visual tracking. IEEE Trans Circuits Syst Video Technol. 2010;20(1):119–30.
[8]    Jiang X, Sun J, Ding H, Li C. A silhouette-based novel algorithm for object detection and tracking using information fusion of video frames. Cluster Comput. 2019;22(1):391–8.
[9]    Petrovic VL, Popovic-Bozovic JS. Towards real-time blob detection in large images with reduced memory cost. In: Proceedings of the 3rd International Conference on Electrical, Electronic and Computing Engineering (IcETRAN); 2016.
[10]    Samantaray A, Nayak SK, Mishra AK. Hand gesture recognition using computer vision. Int J Sci Eng Res. 2013;4(6):1602–9.
[11]     Sarhangi A, Nezhad A. Parkinson disease recognition based on type speed on keyboard. In: Proceedings of the Civilica Conference; 2023. (In Persian).
Mechanic of Advanced and Smart Materials
Volume 5, Issue 2
Summer 2025
Pages 292-304

  • Receive Date 14 June 2024
  • Accept Date 24 June 2024

Home

Guide for Authors

Submit Manuscript

Contact Us