Human action recognition method based on multi-view semi-supervised ensemble learning

Shengnan CHEN; Xinmin FAN

doi:10.11959/j.issn.2096-109x.2021061

您当前的位置：

首页 >

文章列表页 >

Human action recognition method based on multi-view semi-supervised ensemble learning

Papers | 更新时间：2024-06-03

- Human action recognition method based on multi-view semi-supervised ensemble learning
- Chinese Journal of Network and Information Security Vol. 7, Issue 3, Pages: 141-148(2021)
- 作者机构：
  
  1. 福建师范大学，福建福州 350117
  2. 网络安全与教育信息化福建省高校工程研究中心，福建福州 350117
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2021061
  CLC： TP393
- Online First：2021-06，
  
  Published：15 June 2021
- 稿件说明：
移动端阅览
Shengnan CHEN, Xinmin FAN. Human action recognition method based on multi-view semi-supervised ensemble learning[J]. Chinese Journal of Network and Information Security, 2021, 7(3): 141-148.
DOI：

Shengnan CHEN, Xinmin FAN. Human action recognition method based on multi-view semi-supervised ensemble learning[J]. Chinese Journal of Network and Information Security, 2021, 7(3): 141-148. DOI： 10.11959/j.issn.2096-109x.2021061.

摘要

移动设备上难以获取大量标签样本，而训练不足导致分类模型在人体动作识别上表现欠佳。针对这一问题，提出一种基于多视图半监督集成学习的人体动作识别算法。首先，利用两种内置传感器收集的数据构建两个特征视图，将两个视图和两种基分类器进行组合构建协同学习框架；然后，根据多分类任务重新定义置信度，结合主动学习思想在迭代过程中控制预测伪标签结果；使用LightGBM对扩充后的训练集进行学习。实验结果表明，算法的精确率、召回率和F1值较高，能稳定、准确地识别多种人体动作。

Abstract

Mass labeled data are hard to get in mobile devices.Inadequate training leads to bad performance of classifiers in human action recognition.To tackle this problem

a multi-view semi-supervised ensemble learning method was proposed.First

data of two different inertial sensors was used to construct two feature views.Two feature views and two base classifiers were combined to construct co-training framework.Then

the confidence degree was redefined in multi-class task and was combined with active learning method to control predict pseudo-label result in each iteration.Finally

extended training data was used as input to train LightGBM.Experiments show that the method has good performance in precision rate

recall rate and F1 value

which can effectively detect different human action.

关键词

Keywords

references

LIU L J , LEI X L , CHEN B F , et al . Human action recognition based on inertial sensors and complexity classification [J ] . Journal of Information Technology Research , 2019 : 18 - 35 .

周启臻 , 邢建春 , 杨启亮 , 等 . 基于连续图像深度学习的 Wi-Fi人体行为识别方法 [J ] . 通信学报 , 2020 , 41 ( 8 ): 43 - 54 .

ZHOU Q Z , XING J C , HAN Q L , et al . Sequential image deep learning-based Wi-Fi human activity recognition method [J ] . Journal on Communications , 2020 , 41 ( 8 ): 43 - 54 .

钱慧芳 , 易剑平 , 付云虎 . 基于深度学习的人体动作识别综述 [J ] . 计算机科学与探索 , 2021 ( 1 ): 1 - 20 .

QIAN H F , YI J P , FU Y H . Human action recognition based on deep learning：a review [J ] . Journal of Frontiers of Computer Science ＆ Technology , 2021 ( 1 ): 1 - 20 .

张会珍 , 刘云麟 , 任伟建 , 等 . 人体行为识别特征提取方法综述 [J ] . 吉林大学学报(信息科学版) , 2020 , 38 ( 3 ): 360 - 370 .

ZHANG H J , LIU Y L , REN J W , et al . Human behavior recognition feature extraction method:a survey [J ] . Journal of Jilin University (Information Science Edition) , 2020 , 38 ( 3 ): 360 - 370 .

邹建 . 基于BP神经网络的人体行为识别 [J ] . 网络与信息安全学报 , 2017 , 3 ( 9 ): 55 - 60 .

ZOU J . Human action recognition based on back propagation neural network [J ] . Chinese Journal of Network and Information Security , 2017 , 3 ( 9 ): 55 - 60 .

WANG Y J , WU K S , LIONEL M N . WiFall:device-free fall detection by wireless networks [J ] . IEEE Transactions on Mobile Computing , 2017 , 16 ( 2 ): 581 - 594

肖玲 , 潘浩 . 基于Wi-Fi信号的人体动作识别系统 [J ] . 北京邮电大学学报 , 2018 , 41 ( 3 ): 119 - 124 .

XIAO L , PAN H . Human activity recognition system based on Wi-Fi signal [J ] . Journal of Beijing University of Posts and Telecommunications , 2018 , 41 ( 3 ): 119 - 124 .

CAO S M , YANG P L , LI X Y , et al . iPand:accurate gesture input with smart acoustic sensing on hand [C ] // 15th Annual IEEE International Conference on Sensing,Communication,and Networking(SECON) . 2018 .

LIU Y T , ZHANG Y A , ZENG M . Novel algorithm for hand gesture recognition utilizing a wrist-worn inertial sensor [J ] . IEEE Sensors Journal , 2018 , 18 ( 24 ): 10085 - 10095 .

殷晓玲 , 陈晓江 , 夏启寿 , 等 . 基于智能手机内置传感器的人体运动状态识别 [J ] . 通信学报 , 2019 , 40 ( 3 ): 161 - 173 .

YING X L , CHEN X J , XIA Q S , et al . Human motion state recognition based on smart phone built-in sensor [J ] . Journal on Communications , 2019 , 40 ( 3 ): 161 - 173 .

WANG Y , CANG H N , YU H N . A survey on wearable sensor modality centred human activity recognition in health care [J ] . Expert Systems with Applications , 2019 , 137 : 167 - 190 .

ALEJANDRO B , YAGO S , PEDRO I . Evolutionary design of convolutional neural networks for human activity recognition in sensor-rich environments [J ] . Sensors , 2018 , 18 ( 4 ): 1288 - 1312

张儒鹏 , 于亚新 , 张康 , 等 . 基于 OI-LSTM 神经网络结构的人类动作识别模型研究 [J ] . 计算机科学与探索 , 2018 , 12 ( 12 ): 1926 - 1939 .

ZHANG R P , YU Y X , ZHANG K , et al . Research on human action recognition model based on OI-LSTM neural network structure [J ] . Journal of Frontiers of Computer Science ＆ Technology , 2018 , 12 ( 12 ): 1926 - 1939 .

韩嵩 , 韩秋弘 . 半监督学习研究的述评 [J ] . 计算机工程与应用 , 2020 ( 6 ): 19 - 27 .

HAN S , HAN Q H . Review of semi-supervised learning research [J ] . Computer Engineering and Applications , 2020 ( 6 ): 19 - 27 .

尹玉 , 詹永照 , 姜震 . 伪标签置信选择的半监督集成学习视频语义检测 [J ] . 计算机应用 , 2019 , 39 ( 8 ): 2204 - 2209 .

YIN Y , ZHAN Y Z , JIANG Z , et al . Semi-supervised ensemble learning for video semantic detection based on pseudo-label confidence selection [J ] . Journal of Computer Applications , 2019 , 39 ( 8 ): 2204 - 2209 .

GUO L K , QI M , FINLEY T , et al . LightGBM:a highly efficient gradient boosting decision tree [C ] // Advances in Neural Information Processing Systems(NIPS) . 2017 : 3146 - 3154 .

ANGUITA D , GHIO A , ONETO L , et al . A public domain dataset for human activity recognition using smartphones [C ] // European Symposium on Artificial Neural Networks,Computational Intelligence and Machine Learning (ESANN) . 2013 .

ROSENBERG C , HEBERT M , SCHNEIDERMAN H . Semi-supervised self-training of object detection models [C ] // IEEE Workshops on Applications of Computer Vision (WACV) . 2005 : 29 - 36 .

ZHOU Z H , LI M . Semisupervised regression with co-trainingstyle algorithms [J ] . IEEE Transactions on Knowledge and Data Engineering , 2007 : 1479 - 1493 .

Views

224

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Study of semi-supervised learning based encrypted traffic classification method for Tor anonymity network

Contrastive meta-learning framework for few-shot cross-lingual text classification

Research on credit card transaction security supervision based on PU learning

Related Author

CAO Qingwei

GONG Liangyi

LI Yufu

MO Xiuliang

YANG Ke

YUAN Yali

GUO Jianming

ZHAO Yuran

Related Institution

Tianjin University of Science and Technology

Computer Network Information Center, Chinese Academy of Sciences

University of Chinese Academy of Sciences

Southeast University

School of Cyber Science and Engineering, Shanghai Jiao Tong University

⁰