Savran Kızıltepe, Rukiye and Gan, John Q and Escobar, Juan José (2023) A novel keyframe extraction method for video classification using deep neural networks. Neural Computing and Applications, 35 (34). pp. 24513-24524. DOI https://doi.org/10.1007/s00521-021-06322-x
Savran Kızıltepe, Rukiye and Gan, John Q and Escobar, Juan José (2023) A novel keyframe extraction method for video classification using deep neural networks. Neural Computing and Applications, 35 (34). pp. 24513-24524. DOI https://doi.org/10.1007/s00521-021-06322-x
Savran Kızıltepe, Rukiye and Gan, John Q and Escobar, Juan José (2023) A novel keyframe extraction method for video classification using deep neural networks. Neural Computing and Applications, 35 (34). pp. 24513-24524. DOI https://doi.org/10.1007/s00521-021-06322-x
Abstract
Combining convolutional neural networks (CNNs) and recurrent neural networks (RNNs) produces a powerful architecture for video classification problems as spatial–temporal information can be processed simultaneously and effectively. Using transfer learning, this paper presents a comparative study to investigate how temporal information can be utilized to improve the performance of video classification when CNNs and RNNs are combined in various architectures. To enhance the performance of the identified architecture for effective combination of CNN and RNN, a novel action template-based keyframe extraction method is proposed by identifying the informative region of each frame and selecting keyframes based on the similarity between those regions. Extensive experiments on KTH and UCF-101 datasets with ConvLSTM-based video classifiers have been conducted. Experimental results are evaluated using one-way analysis of variance, which reveals the effectiveness of the proposed keyframe extraction method in the sense that it can significantly improve video classification accuracy.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Deep learning; Convolutional neural networks; Recurrent neural networks; Keyframe extraction; Video classification |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 10 Aug 2021 15:19 |
Last Modified: | 16 May 2024 20:52 |
URI: | http://repository.essex.ac.uk/id/eprint/30868 |
Available files
Filename: SavranKızıltepe2021_Article_ANovelKeyframeExtractionMethod.pdf
Licence: Creative Commons: Attribution 3.0