Saved in:
Bibliographic Details
Main Author: Jin, Hongrui
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.13170
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909431731585024
author Jin, Hongrui
author_facet Jin, Hongrui
contents This article methodologically reflects on how social media scholars can effectively engage with speech-based data in their analyses. While contemporary media studies have embraced textual, visual, and relational data, the aural dimension remained comparatively under-explored. Building on the notion of secondary orality and rejection towards purely visual culture, the paper argues that considering voice and speech at scale enriches our understanding of multimodal digital content. The paper presents the TikTok Subtitles Toolkit that offers accessible speech processing readily compatible with existing workflows. In doing so, it opens new avenues for large-scale inquiries that blend quantitative insights with qualitative precision. Two illustrative cases highlight both opportunities and limitations of speech research: while genres like #storytime on TikTok benefit from the exploration of spoken narratives, nonverbal or music-driven content may not yield significant insights using speech data. The article encourages researchers to integrate aural exploration thoughtfully to complement existing methods, rather than replacing them. I conclude that the expansion of our methodological repertoire enables richer interpretations of platformised content, and our capacity to unpack digital cultures as they become increasingly multimodal.
format Preprint
id arxiv_https___arxiv_org_abs_2412_13170
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Re-calibrating methodologies in social media research: Challenge the visual, work with Speech
Jin, Hongrui
Social and Information Networks
Information Retrieval
68U35
H.5.1; H.5.2; J.4
This article methodologically reflects on how social media scholars can effectively engage with speech-based data in their analyses. While contemporary media studies have embraced textual, visual, and relational data, the aural dimension remained comparatively under-explored. Building on the notion of secondary orality and rejection towards purely visual culture, the paper argues that considering voice and speech at scale enriches our understanding of multimodal digital content. The paper presents the TikTok Subtitles Toolkit that offers accessible speech processing readily compatible with existing workflows. In doing so, it opens new avenues for large-scale inquiries that blend quantitative insights with qualitative precision. Two illustrative cases highlight both opportunities and limitations of speech research: while genres like #storytime on TikTok benefit from the exploration of spoken narratives, nonverbal or music-driven content may not yield significant insights using speech data. The article encourages researchers to integrate aural exploration thoughtfully to complement existing methods, rather than replacing them. I conclude that the expansion of our methodological repertoire enables richer interpretations of platformised content, and our capacity to unpack digital cultures as they become increasingly multimodal.
title Re-calibrating methodologies in social media research: Challenge the visual, work with Speech
topic Social and Information Networks
Information Retrieval
68U35
H.5.1; H.5.2; J.4
url https://arxiv.org/abs/2412.13170