IOE OpenIR  > 光电测控技术研究室(三室)
Department光电测控技术研究室(三室)
Temporal Modeling on Multi-Temporal-Scale Spatiotemporal Atoms for Action Recognition
Guangle Yao1,2,3; Tao Lei1; Xianyuan Liu1,3; Ping Jiang1
Source PublicationAPPLIED SCIENCES-BASEL
Volume8Issue:10Pages:1835
2018-10-01
Language英语
ISSN2076-3417
DOI10.3390/app8101835
Indexed BySCI
WOS IDWOS:000448653700130
SubtypeJ
AbstractAs an important branch of video analysis, human action recognition has attracted extensive research attention in computer vision and artificial intelligence communities. In this paper, we propose to model the temporal evolution of multi-temporal-scale atoms for action recognition. An action can be considered as a temporal sequence of action units. These action units which we referred to as action atoms, can capture the key semantic and characteristic spatiotemporal features of actions in different temporal scales. We first investigate Res3D, a powerful 3D CNN architecture and create the variants of Res3D for different temporal scale. In each temporal scale, we design some practices to transfer the knowledge learned from RGB to optical flow (OF) and build RGB and OF streams to extract deep spatiotemporal information using Res3D. Then we propose an unsupervised method to mine action atoms in the deep spatiotemporal space. Finally, we use long short-term memory (LSTM) to model the temporal evolution of atoms for action recognition. The experimental results show that our proposed multi-temporal-scale spatiotemporal atoms modeling method achieves recognition performance comparable to that of state-of-the-art methods on two challenging action recognition datasets: UCF101 and HMDB51.
Keywordaction recognition action atom convolutional neural network long short-term memory
Citation statistics
Cited Times:1[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ioe.ac.cn/handle/181551/9265
Collection光电测控技术研究室(三室)
Affiliation1.Institute of Optics and Electronics, Chinese Academy of Sciences, P.O. Box 350, Shuangliu, Chengdu 610209, China;
2.School of Optoelectronic Information, University of Electronic Science and Technology of China, No. 4, Section 2, North Jianshe Road, Chengdu 610054, China;
3.University of Chinese Academy of Sciences, 19 A Yuquan Rd, Shijingshan District, Beijing 100039, China
Recommended Citation
GB/T 7714
Guangle Yao,Tao Lei,Xianyuan Liu,et al. Temporal Modeling on Multi-Temporal-Scale Spatiotemporal Atoms for Action Recognition[J]. APPLIED SCIENCES-BASEL,2018,8(10):1835.
APA Guangle Yao,Tao Lei,Xianyuan Liu,&Ping Jiang.(2018).Temporal Modeling on Multi-Temporal-Scale Spatiotemporal Atoms for Action Recognition.APPLIED SCIENCES-BASEL,8(10),1835.
MLA Guangle Yao,et al."Temporal Modeling on Multi-Temporal-Scale Spatiotemporal Atoms for Action Recognition".APPLIED SCIENCES-BASEL 8.10(2018):1835.
Files in This Item:
File Name/Size DocType Version Access License
2018-2032.pdf(6127KB)期刊论文出版稿开放获取CC BY-NC-SAApplication Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Guangle Yao]'s Articles
[Tao Lei]'s Articles
[Xianyuan Liu]'s Articles
Baidu academic
Similar articles in Baidu academic
[Guangle Yao]'s Articles
[Tao Lei]'s Articles
[Xianyuan Liu]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Guangle Yao]'s Articles
[Tao Lei]'s Articles
[Xianyuan Liu]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.