Social Media Ready Caption Generation for Brands

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Maheshwari, Himanshu, Goswami, Koustava, Saxena, Apoorv, Srinivasan, Balaji Vasan
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929196597510144
author Maheshwari, Himanshu
Goswami, Koustava
Saxena, Apoorv
Srinivasan, Balaji Vasan
author_facet Maheshwari, Himanshu
Goswami, Koustava
Saxena, Apoorv
Srinivasan, Balaji Vasan
contents Social media advertisements are key for brand marketing, aiming to attract consumers with captivating captions and pictures or logos. While previous research has focused on generating captions for general images, incorporating brand personalities into social media captioning remains unexplored. Brand personalities are shown to be affecting consumers' behaviours and social interactions and thus are proven to be a key aspect of marketing strategies. Current open-source multimodal LLMs are not directly suited for this task. Hence, we propose a pipeline solution to assist brands in creating engaging social media captions that align with the image and the brand personalities. Our architecture is based on two parts: a the first part contains an image captioning model that takes in an image that the brand wants to post online and gives a plain English caption; b the second part takes in the generated caption along with the target brand personality and outputs a catchy personality-aligned social media caption. Along with brand personality, our system also gives users the flexibility to provide hashtags, Instagram handles, URLs, and named entities they want the caption to contain, making the captions more semantically related to the social media handles. Comparative evaluations against various baselines demonstrate the effectiveness of our approach, both qualitatively and quantitatively.
format Preprint
id arxiv_https___arxiv_org_abs_2401_01637
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Social Media Ready Caption Generation for Brands
Maheshwari, Himanshu
Goswami, Koustava
Saxena, Apoorv
Srinivasan, Balaji Vasan
Computation and Language
Social media advertisements are key for brand marketing, aiming to attract consumers with captivating captions and pictures or logos. While previous research has focused on generating captions for general images, incorporating brand personalities into social media captioning remains unexplored. Brand personalities are shown to be affecting consumers' behaviours and social interactions and thus are proven to be a key aspect of marketing strategies. Current open-source multimodal LLMs are not directly suited for this task. Hence, we propose a pipeline solution to assist brands in creating engaging social media captions that align with the image and the brand personalities. Our architecture is based on two parts: a the first part contains an image captioning model that takes in an image that the brand wants to post online and gives a plain English caption; b the second part takes in the generated caption along with the target brand personality and outputs a catchy personality-aligned social media caption. Along with brand personality, our system also gives users the flexibility to provide hashtags, Instagram handles, URLs, and named entities they want the caption to contain, making the captions more semantically related to the social media handles. Comparative evaluations against various baselines demonstrate the effectiveness of our approach, both qualitatively and quantitatively.
title Social Media Ready Caption Generation for Brands
topic Computation and Language
url https://arxiv.org/abs/2401.01637