Open Access

CNN-Driven Kinematic Modeling Framework for Human Upper Limb Motion Imitation and Functional Replication

4 Faculty of Computer Engineering, Da Nang University of Technology, Da Nang, Vietnam

Abstract

The replication of human upper limb motion with computational intelligence has become a critical research domain in robotics, human–computer interaction, and assistive rehabilitation systems. This study proposes a CNN-driven kinematic modeling framework designed to imitate and functionally replicate human upper limb movements with high spatial-temporal fidelity. The framework integrates convolutional neural networks (CNNs) with kinematic representation strategies to extract motion features, estimate joint configurations, and enable structured motion reproduction in real or simulated robotic systems. Unlike conventional vision-based tracking systems that rely solely on geometric estimation, the proposed approach leverages deep hierarchical feature extraction to improve robustness against occlusion, noise, and environmental variability.

The methodology synthesizes advancements in object detection, pose estimation, and motion tracking, drawing inspiration from Faster R-CNN-based localization mechanisms in dynamic environments (J. O. P. Arenas, M. R. Jiménez, and P. C. U. Murillo, 2018). A multi-stage pipeline is developed, consisting of feature extraction, kinematic mapping, and motion synthesis modules. Comparative insights from prior CNN-based tracking and human motion modeling systems demonstrate that deep convolutional architectures significantly enhance precision in spatial localization and trajectory continuity.

Experimental reasoning indicates that CNN-based kinematic learning enables improved adaptability in complex motion environments, particularly for upper limb articulation tasks involving multiple degrees of freedom. The study further identifies limitations in real-time scalability and sensor dependency, proposing hybrid optimization strategies for future enhancement. Overall, this research contributes a structured framework for advancing biologically inspired motion imitation systems and supports applications in rehabilitation robotics, teleoperation, and intelligent assistive devices.

Keywords

References

J. O. P. Arenas, M. R. Jiménez, and P. C. U. Murillo, “Faster R-CNN for object location in a virtual environment for sorting task,” International Journal of Online Engineering, vol. 14, no. 7, pp. 4–14, 2018
M. F. Aslan, A. Durdu, K. Sabanci, and M. A. Mutluer, “CNN and HOG based comparison study for complete occlusion handling in human tracking,” Measurement: Journal of the International Measurement Confederation, vol. 158, 2020
A. A. Kupin, S. Banerjee, N. Banerjee, S. H. Roy, J. C. Kline, and B. Shiwani, “System architecture for VR yoga therapy platform with 6-DoF whole-body avatar tracking,” in 2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality, AIxVR 2024, 2024, pp. 360–366
M. Babaee, Z. Li, and G. Rigoll, “A dual CNN–RNN for multiple people tracking,” Neurocomputing, vol. 368, pp. 69–83, 2019
P. K. Balla, A. Kumar, and R. Pandey, “A 4-channelled hazy image input generation and deep learning-based single image dehazing,” Journal of Visual Communication and Image Representation, vol. 100, 2024
F. Cui, M. Ning, J. Shen, and X. Shu, “Automatic recognition and tracking of highway layer-interface using Faster R-CNN,” Journal of Applied Geophysics, vol. 196, 2022
Z. Feng and P. Wang, “A model adaptive updating kernel correlation filter tracker with deep CNN features,” Engineering Applications of Artificial Intelligence, vol. 123, 2023
R. Girshick, “Fast R-CNN,” in Proceedings of the IEEE International Conference on Computer Vision, ICCV 2015, pp. 1440–1448, 2015
N. Gunawardena, J. A. Ginige, B. Javadi, and G. Lui, “Performance analysis of CNN models for mobile device eye tracking with edge computing,” Procedia Computer Science, vol. 207, pp. 2291–2300, 2022
S. M. L. Gioi, G. Loianno, and F. Cordella, “Robust upper limb kinematic reconstruction using aRGB-D camera,” IEEE Robotics and Automation Letters, vol. 9, no. 4, pp. 3831–3837, 2024
G. Li et al., “One-shot multi-object tracking using CNN-based networks with spatial-channel attention mechanism,” Optics and Laser Technology, vol. 153, 2022
L. A. Hussain, S. Singh, R. Mizouni, H. Otrok, and E. Damiani, “A predictive target tracking framework for IoT using CNN–LSTM,” Internet of Things, vol. 22, 2023
P. A. Javier Orlando, J. M. Robinson, and J. E. M. Baquero, “Comparison of convolutional neural network models for user’s facial recognition,” International Journal of Electrical and Computer Engineering, vol. 14, no. 1, pp. 192–198, 2024
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Communications of the ACM, vol. 60, no. 6, pp. 84–90, 2017
L. H. Li and R. Tanone, “Ensemble learning based on CNN and transformer models for leaf diseases classification,” in Proceedings of the 2024 18th International Conference on Ubiquitous Information Management and Communication, IMCOM 2024, 2024, pp. 1–6
N. A. S. N. Nandasena, W. A. A. Vimukthi, H. M. K. K. M. B. Herath, R. Wijesinghe, and S. L. P. Yasakethu, “Real-time upper body motion tracking using computer vision for improved human-robot interaction and teleoperation,” Moratuwa Engineering Research Conference, MERCon, pp. 201–206, 2023
L. E. Pomme, R. Bourqui, R. Giot, and D. Auber, “Relative confusion matrix: efficient comparison of decision models,” in Proceedings of the International Conference on Information Visualisation, 2022, vol. 2022, pp. 98–103
M. P. C. Useche, J. P. Arenas, and R. J. Moreno, “Implementation of a data augmentation algorithm validated by means of the accuracy of a convolutional neural network,” Journal of Engineering and Applied Sciences, vol. 12, no. 20, pp. 5323–5331, 2017
Q. Wu, “Research on human body detection and tracking algorithm based on kinect,” in 2021 International Conference on Electronic Information Technology and Smart Agriculture, ICEITSA 2021, 2021, pp. 7–10
T. D. Trinh, P. C. L. T. Vu, and P. T. Bao, “Comparing mask R-CNN backbone architectures for human detection using thermal imaging,” International Journal of Electrical and Computer Engineering, vol. 14, no. 4, pp. 3962–3970, 2024
Y. Wang, X. Wei, X. Tang, H. Shen, and L. Ding, “CNN tracking based on data augmentation,” Knowledge-Based Systems, vol. 194, 2020
Y. Wang, X. Wei, H. Shen, L. Ding, and J. Wan, “Robust fusion for RGB-D tracking using CNN features,” Applied Soft Computing Journal, vol. 92, 2020
Y. Wang, X. Wei, L. Luo, W. Wen, and Y. Wang, “Robust RGB-D tracking via compact CNN features,” Engineering Applications of Artificial Intelligence, vol. 96, 2020
X. Wang, Y. Bai, and X. Liu, “Prediction of railroad track geometry change using a hybrid CNN-LSTM spatial-temporal model,” Advanced Engineering Informatics, vol. 58, 2023
H. Xu, J. Fan, H. Ma, and Q. Wang, “Semiparametric musculoskeletal model for reinforcement learning-based trajectory tracking,” IEEE Transactions on Instrumentation and Measurement, vol. 73, 2024
H. Yun, “Prediction model of algal blooms using logistic regression and confusion matrix,” International Journal of Electrical and Computer Engineering, vol. 11, no. 3, pp. 2407–2413, 2021
Q. Zhu, X. Huang, and Q. Guan, “TabCtNet: Target-aware bilateral CNN-transformer network for single object tracking in satellite videos,” International Journal of Applied Earth Observation and Geoinformation, vol. 128, 2024

Similar Articles

11-20 of 24

You may also start an advanced similarity search for this article.