TY - JOUR
T1 - H2HI-Net
T2 - A Dual-Branch Network for Recognizing Human-to-Human Interactions from Channel-State-Information
AU - Abdel-Basset, Mohamed
AU - Hawash, Hossam
AU - Moustafa, Nour
AU - Mohammad, Nazeeruddin
N1 - Funding Information:
This work was supported in part by PMU Cybersecurity Center under Grant PCC-Grant-202105.
Publisher Copyright:
© 2014 IEEE.
PY - 2022/6/15
Y1 - 2022/6/15
N2 - Recognizing human activities is considered a vital research challenge because of its essential significance for improving human-machine collaboration in the Internet of Things environments. The present deep learning (DL) literature focused on studying human activities (HAs) from one subject, with several schemes differing in the recognition method and sensing strategy. However, few research interests have been dedicated to situations where numerous individuals interact to perform common activities. This challenge is termed human-to-human interaction (H2HI) recognition. This study addresses the H2HI problem by a novel device-free DL model, named H2HI-NET, for modeling the HA representation of the Channel State Information of Wireless Fidelity devices. In H2HI-NET, a bi-directional temporal learning module is introduced to capture temporal representation from historical and future information. Simultaneously, the residual spatial learning module is designed to combine residual learning and transformer network capabilities for the efficient extraction of complex spatial features of HAs. The experimental evaluations reveal the efficiency of the H2HI-NET with 96.39% accuracy overcoming cutting-edge studies.
AB - Recognizing human activities is considered a vital research challenge because of its essential significance for improving human-machine collaboration in the Internet of Things environments. The present deep learning (DL) literature focused on studying human activities (HAs) from one subject, with several schemes differing in the recognition method and sensing strategy. However, few research interests have been dedicated to situations where numerous individuals interact to perform common activities. This challenge is termed human-to-human interaction (H2HI) recognition. This study addresses the H2HI problem by a novel device-free DL model, named H2HI-NET, for modeling the HA representation of the Channel State Information of Wireless Fidelity devices. In H2HI-NET, a bi-directional temporal learning module is introduced to capture temporal representation from historical and future information. Simultaneously, the residual spatial learning module is designed to combine residual learning and transformer network capabilities for the efficient extraction of complex spatial features of HAs. The experimental evaluations reveal the efficiency of the H2HI-NET with 96.39% accuracy overcoming cutting-edge studies.
KW - Channel-state information (CSI)
KW - Deep learning (DL)
KW - Human activity recognition
KW - Human interaction detection
KW - Wireless Fidelity (Wi-Fi) sensing
UR - http://www.scopus.com/inward/record.url?scp=85119579830&partnerID=8YFLogxK
U2 - 10.1109/JIOT.2021.3117909
DO - 10.1109/JIOT.2021.3117909
M3 - Article
AN - SCOPUS:85119579830
SN - 2327-4662
VL - 9
SP - 10010
EP - 10021
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 12
ER -