1
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Lightweight hashing with contrastive self-cross XLNet and combinational similarity matching for content-based video retrieval

&
Received 16 Aug 2023, Accepted 08 Jun 2024, Published online: 04 Aug 2024

References

  • Anuranji, R., and H. Srimathi. 2020. “A Supervised Deep Convolutional Based Bidirectional Long Short Term Memory Video Hashing for Large Scale Video Retrieval Applications.” Digital Signal Processing 102:102729. https://doi.org/10.1016/j.dsp.2020.102729.
  • Avgoustinakis, P., G. Kordopatis-Zilos, S. Papadopoulos, A. L. Symeonidis, and I. Kompatsiaris. 2021. “Audio-Based Near-Duplicate Video Retrieval with Audio Similarity Learning.” 2020 25th International Conference on Pattern Recognition (ICPR), Italy, 5828–5835. IEEE.
  • Bai, J., B. Chen, Y. Li, D. Wu, W. Guo, S. T. Xia, and E. H. Yang. 2020. “Targeted Attack for Deep Hashing Based Retrieval.” European Conference on Computer Vision, 618–634. Cham: Springer. August.
  • Cao, W., W. Feng, Q. Lin, G. Cao, and Z. He. 2020. “A Review of Hashing Methods for Multimodal Retrieval.” Institute of Electrical and Electronics Engineers Access 8:15377–15391. https://doi.org/10.1109/ACCESS.2020.2968154.
  • Dong, J., X. Li, C. Xu, X. Yang, G. Yang, X. Wang, and M. Wang. 2021. “Dual Encoding for Video Retrieval by Text.” IEEE Transactions on Pattern Analysis and Machine Intelligence.
  • Falcon, A., G. Serra, and O. Lanz. 2022. “Learning Video Retrieval Models with Relevance-Aware Online Mining.” International Conference on Image Analysis and Processing, 182–194. Cham: Springer.
  • Gabeur, V., C. Sun, K. Alahari, and C. Schmid. 2020. “Multimodal Transformer for Video Retrieval.” European Conference on Computer Vision, 214–229. Cham: Springer August.
  • Gayathri, N., and K. Mahesh. 2020. “Improved Fuzzy-Based SVM Classification System Using Feature Extraction for Video Indexing and Retrieval.” International Journal of Fuzzy Systems 22 (5): 1716–1729. https://doi.org/10.1007/s40815-020-00884-z.
  • Hussain, A., M. Ahmad, T. Hussain, and I. Ullah. 2022. “Efficient Content Based Video Retrieval System by Applying AlexNet on Keyframes.” ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal 11 (2): 207–235. https://doi.org/10.14201/adcaij.27430.
  • Ji, K., J. Liu, W. Hong, L. Zhong, J. Wang, J. Chen, and W. Chu. 2022. “CRET: Cross-Modal Retrieval Transformer for Efficient Text-Video Retrieval.” Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Spain, 949–959.
  • Jo, W., G. Lim, J. Kim, J. Yun, and Y. Choi. 2022. “Exploring the Temporal Cues to Enhance Video Retrieval on Standardized CDVA.” Institute of Electrical and Electronics Engineers Access 10:38973–38981. https://doi.org/10.1109/ACCESS.2022.3165177.
  • Khan, M. N., A. Alam, and Y. K. Lee. 2020. “FALKON: large-scale content-based video retrieval utilizing deep-features and distributed in-memory computing.” 2020 IEEE International Conference on Big Data and Smart Computing (BigComp), Korea (South), 36–43. IEEE.
  • Kumar, V., V. Tripathi, and B. Pant. 2021. “Content Based Surgical Video Retrieval via Multi-Deep Features Fusion.” 2021 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, 1–5. IEEE.
  • Li, X., F. Zhou, C. Xu, J. Ji, and G. Yang. 2020. “Sea: Sentence Encoder Assembly for Video Retrieval by Textual Queries.” IEEE Transactions on Multimedia 23: 4351–4362. https://doi.org/10.1109/TMM.2020.3042067.
  • Lin, Q., W. Cao, and Z. He. 2022. “Level-Wise Aligned Dual Networks for Text–Video Retrieval.” EURASIP Journal on Advances in Signal Processing 2022 (1): 1–20. https://doi.org/10.1186/s13634-022-00887-y.
  • Nie, X., X. Zhou, Y. Shi, J. Sun, and Y. Yin. 2021. “Classification-Enhancement Deep Hashing for Large-Scale Video Retrieval.” Applied Soft Computing 109:107467. https://doi.org/10.1016/j.asoc.2021.107467.
  • Nixon, Lyndon, Evlampios Apostolidis, Foteini Markatopoulou, Ioannis Patras, and Vasileios Mezaris. 2019. “Multimodal Video Annotation for Retrieval and Discovery of Newsworthy Video in a News Verification Scenario.” MultiMedia Modeling: 25th International Conference, MMM 2019, 25:143–155. Thessaloniki, Greece Proceedings, Part I. Springer International Publishing, 8–11 January.
  • Paul, A. R., and E. G. M. Kanaga. 2021. “Query-Focused Content Retrieval from Surveillance Videos: Techniques and Challenges.” 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS). IEEE, 1:1777–1784.
  • Portillo-Quintero, J. A., J. C. Ortiz-Bayliss, and H. Terashima-Marín. 2021. “A Straightforward Framework for Video Retrieval Using Clip.” Mexican Conference on Pattern Recognition, Mexico, 3–12. Cham: Springer.
  • Qi, M., J. Qin, Y. Yang, Y. Wang, and J. Luo. 2021. “Semantics-Aware Spatial-Temporal Binaries for Cross-Modal Video Retrieval.” IEEE Transactions on Image Processing 30:2989–3004. https://doi.org/10.1109/TIP.2020.3048680.
  • Qiao, S., R. Wang, S. Shan, and X. Chen. 2021. “Deep Video Code for Efficient Face Video Retrieval.” Pattern Recognition 113:107754. https://doi.org/10.1016/j.patcog.2020.107754.
  • Rossetto, L., R. Gasser, J. Lokoč, W. Bailer, K. Schoeffmann, B. Muenzer, T. Souček, et al. 2020. “Interactive Video Retrieval in the Age of Deep Learning–Detailed Evaluation of VBS 2019.” IEEE Transactions on Multimedia 23:243–256. https://doi.org/10.1109/TMM.2020.2980944.
  • Sakketou, F., and N. Ampazis. 2020. “A Constrained Optimization Algorithm for Learning GloVe Embeddings with Semantic Lexicons.” Knowledge-Based Systems 195:105628. https://doi.org/10.1016/j.knosys.2020.105628.
  • Satar, B., Z. Hongyuan, X. Bresson, and J. H. Lim. 2021. “Semantic Role Aware Correlation Transformer for Text to Video Retrieval.” 2021 IEEE International Conference on Image Processing (ICIP). IEEE, 1334–1338. September.
  • Satar, B., H. Zhu, H. Zhang, and J. H. Lim. 2022. “RoME: Role-Aware Mixture-Of-Expert Transformer for Text-To-Video Retrieval.” arXiv Preprint arXiv: 2206.12845.
  • Tang, H., H. Liu, W. Xiao, and N. Sebe. 2019. “Fast and Robust Dynamic Hand Gesture Recognition via Keyframes Extraction and Feature Fusion.” Neurocomputing 331:424–433. https://doi.org/10.1016/j.neucom.2018.11.038.
  • Ullah, A., K. Muhammad, T. Hussain, S. W. Baik, and V. H. C. De Albuquerque. 2020. “Event-Oriented 3D Convolutional Features Selection and Hash Codes Generation Using PCA for Video Retrieval.” Institute of Electrical and Electronics Engineers Access 8:196529–196540. https://doi.org/10.1109/ACCESS.2020.3029834.
  • Wang, X., L. Zhu, and Y. Yang. 2021. “T2vlad: Global-Local Sequence Alignment for Text-Video Retrieval.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, 5079–5088.
  • Yang, X., J. Dong, Y. Cao, X. Wang, M. Wang, and T. S. Chua. 2020. “Tree-augmented cross-modal encoding for complex-query video retrieval.” Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, China, 1339–1348.
  • Ye, L., M. Rochan, Z. Liu, X. Zhang, and Y. Wang. 2021. “Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network.” IEEE Transactions on Pattern Analysis and Machine Intelligence 44 (7): 1–1. https://doi.org/10.1109/TPAMI.2021.3054384.
  • Zeng, H., H. Zhang, and L. Zhu. 2020. “Label Consistent Locally Linear Embedding Based Cross-Modal Hashing.” Information Processing & Management 57 (6): 102136. https://doi.org/10.1016/j.ipm.2019.102136.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.