Unspoken Sound: Identifying Trends in Non-Speech Audio Captioning on YouTube

Document Type

Conference Proceeding

Publication Date

5-11-2024

Abstract

High-quality closed captioning of both speech and non-speech elements (e.g., music, sound effects, manner of speaking, and speaker identification) is essential for the accessibility of video content, especially for d/Deaf and hard-of-hearing individuals. While many regions have regulations mandating captioning for television and movies, a regulatory gap remains for the vast amount of web-based video content, including the staggering 500+ hours uploaded to YouTube every minute. Advances in automatic speech recognition have bolstered the presence of captions on YouTube. However, the technology has notable limitations, including the omission of many non-speech elements, which are often crucial for understanding content narratives. This paper examines the contemporary and historical state of non-speech information (NSI) captioning on YouTube through the creation and exploratory analysis of a dataset of over 715k videos. We identify factors that influence NSI caption practices and suggest avenues for future research to enhance the accessibility of online video content.

Identifier

85194862559 (Scopus)

ISBN

[9798400703300]

Publication Title

Conference on Human Factors in Computing Systems - Proceedings

External Full Text Location

https://doi.org/10.1145/3613904.3642162

This document is currently not available here.

Share

COinS