• Home
  • Search
  • Video Indexing System Based on Multimodal Information Extraction Using Combination of ASR and OCR
  • Cite Icon1
  • https://doi.org/10.1007/978-3-030-96600-3_14Copy DOI Icon

Video Indexing System Based on Multimodal Information Extraction Using Combination of ASR and OCR

  • Jan 1, 2022
  • Sandeep Varma +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Abstract With the ever-increasing internet penetration across the world, there has been a huge surge in the content on the worldwide web. Video has proven to be one of the most popular media. The COVID-19 pandemic has further pushed the envelope, forcing learners to turn to E-Learning platforms. In the absence of relevant descriptions of these videos, it becomes imperative to generate metadata based on the content of the video. In the current paper, an attempt has been made to index videos based on the visual and audio content of the video. The visual content is extracted using an Optical Character Recognition (OCR) on the stack of frames obtained from a video while the audio content is generated using an Automatic Speech Recognition (ASR). The OCR and ASR generated texts are combined to obtain the final description of the respective video. The dataset contains 400 videos spread across 4 genres. To quantify the accuracy of our descriptions, clustering is performed using the video description to discern between the genres of video.KeywordsOptical Character RecognitionAutomatic Speech RecognitionVideo analyticsNatural language processingK-means clustering

Similar Papers
  • Conference Article
  • Citations11

TV Commercial Classification by using Multi-Modal Textual Information

  • Jul 01, 2006
  • Yantao Zheng +3
  • Conference Article
  • Citations6

Improved parcel sorting by combining automatic speech and character recognition

  • Jan 01, 2012
  • Amriteshwar Singh +2
  • Research Article

Consistency and variation in recognition of text and speech interrupted at variable rates

  • May 01, 2017
  • The Journal of the Acoustical Society of America
  • Valeriy Shafiro +2
  • Conference Article

An AI Powered Glasses Attachment for the Visually Impaired

  • Jan 01, 2025
  • AHFE international
  • Khac Trong Nguyen +1
  • Conference Article
  • Citations5

Assistive Mobile App for Children with Hearing & Speech Impairment Using Character and Speech Recognition

  • Oct 24, 2018
  • Mary Jane C Samonte +5
  • Research Article
  • Citations201

Content Based Lecture Video Retrieval Using Speech and Video Text Information

  • Apr 01, 2014
  • IEEE Transactions on Learning Technologies
  • Haojin Yang +1
  • Book Chapter
  • Citations10

Lecture Video Browsing Using Multimodal Information Resources

  • Jan 01, 2013
  • Haojin Yang +3
  • Research Article
  • Citations58

Structured Multimodal Attentions for TextVQA.

  • Dec 01, 2022
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Chenyu Gao +6
  • Research Article
  • Citations29

Beyond OCR + VQA: Towards end-to-end reading and reasoning for robust and accurate textvqa

  • Jan 21, 2023
  • Pattern Recognition
  • Gangyan Zeng +7
  • Research Article
  • Citations1

Creating electronic resources for African languages through digitisation: a technical report

  • Jan 26, 2023
  • Journal of the Digital Humanities Association of Southern Africa (DHASA)
  • Elsabé Taljard +2
  • Research Article
  • Citations10

MultiTec: A Data-Driven Multimodal Short Video Detection Framework for Healthcare Misinformation on TikTok

  • Oct 01, 2025
  • IEEE Transactions on Big Data
  • Lanyu Shang +3
  • Conference Article
  • Citations38

Beyond OCR + VQA

  • Oct 17, 2021
  • Gangyan Zeng +3
  • Research Article
  • Citations9

Speech To Sign Language Translator For Hearing Impaired

  • Apr 28, 2021
  • Turkish Journal of Computer and Mathematics Education (TURCOMAT)
  • P Ezhumalai
  • Conference Article

Tabula ex-cambio

  • Oct 19, 2009
  • Vincenzo Lombardo +2
  • Research Article

The Practice of Deep Learning Methods in Biodiversity Information Collection

  • Jul 02, 2019
  • Biodiversity Information Science and Standards
  • Jiangning Wang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.