Saved in:
Bibliographic Details
Main Authors: Lakatos, Robert, Pollner, Peter, Hajdu, Andras, Joo, Tamas
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2309.10561
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917611066884096
author Lakatos, Robert
Pollner, Peter
Hajdu, Andras
Joo, Tamas
author_facet Lakatos, Robert
Pollner, Peter
Hajdu, Andras
Joo, Tamas
contents Introduction: Covert tobacco advertisements often raise regulatory measures. This paper presents that artificial intelligence, particularly deep learning, has great potential for detecting hidden advertising and allows unbiased, reproducible, and fair quantification of tobacco-related media content. Methods: We propose an integrated text and image processing model based on deep learning, generative methods, and human reinforcement, which can detect smoking cases in both textual and visual formats, even with little available training data. Results: Our model can achieve 74\% accuracy for images and 98\% for text. Furthermore, our system integrates the possibility of expert intervention in the form of human reinforcement. Conclusions: Using the pre-trained multimodal, image, and text processing models available through deep learning makes it possible to detect smoking in different media even with few training data.
format Preprint
id arxiv_https___arxiv_org_abs_2309_10561
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A multimodal deep learning architecture for smoking detection with a small data approach
Lakatos, Robert
Pollner, Peter
Hajdu, Andras
Joo, Tamas
Computer Vision and Pattern Recognition
Artificial Intelligence
Introduction: Covert tobacco advertisements often raise regulatory measures. This paper presents that artificial intelligence, particularly deep learning, has great potential for detecting hidden advertising and allows unbiased, reproducible, and fair quantification of tobacco-related media content. Methods: We propose an integrated text and image processing model based on deep learning, generative methods, and human reinforcement, which can detect smoking cases in both textual and visual formats, even with little available training data. Results: Our model can achieve 74\% accuracy for images and 98\% for text. Furthermore, our system integrates the possibility of expert intervention in the form of human reinforcement. Conclusions: Using the pre-trained multimodal, image, and text processing models available through deep learning makes it possible to detect smoking in different media even with few training data.
title A multimodal deep learning architecture for smoking detection with a small data approach
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2309.10561