Human action recognition using a convolutional neural network based on skeleton heatmaps from two-stage pose estimation

查看全文 作　　者：Ruiqi [1]Sun;Qin [1,2]Zhang;Chuang [1]Luo;Jiamin [2]Guo;Hui [2]Chai 机构地区：[1]School of Electrical Engineering,University of Jinan,Jinan 250022,China;[2]School of Control Science and Engineering,Shandong University,Jinan 250061,China 出　　处：《Biomimetic Intelligence & Robotics》索引2022年第2卷第3期,共12页 基　　金：This study was supported by the National Natural Science Founda-tion of China(Grant Nos.91948201 and 62073191). 摘　　要：Human action recognition based on skeleton information has been extensively used in various areas,such as human-computer interaction.In this paper,we extracted human skeleton data by constructing a two-stage human pose estimation model,which combined the improved single shot detector(SSD)algorithm with convolutional pose machines(CPM)to obtain human skeleton heatmaps.The backbone of the SSD algorithm was replaced with ResNet,which can characterize images effectively.In addition,we designed multiscale transformation rules for CPM to fuse the information of different scales and a convolutional neural network for the classification of the skeleton keypoints heatmaps to complete action recognition.Indoor and outdoor experiments were conducted on the Caster Moma mobile robot platform,and without an external remote control,the real-time movement of the robot was controlled by the leader through command actions. 关 键 词：Convolutional neural networks Human detection Human pose estimation Human action recognition