Imagen de Portada

ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teaming

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Tedeschi, Simone, Friedrich, Felix, Schramowski, Patrick, Kersting, Kristian, Navigli, Roberto, Nguyen, Huu, Li, Bo
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Computers and Society Machine Learning I.2
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

LLMs Lost in Translation: M-ALERT uncovers Cross-Linguistic Safety Inconsistencies
por: Friedrich, Felix, et al.
Publicado: (2024)

A Typology for Exploring the Mitigation of Shortcut Behavior
por: Friedrich, Felix, et al.
Publicado: (2022)

Beyond Overcorrection: Evaluating Diversity in T2I Models with DivBench
por: Friedrich, Felix, et al.
Publicado: (2025)

LIME: Making LLM Data More Efficient with Linguistic Metadata Embeddings
por: Sztwiertnia, Sebastian, et al.
Publicado: (2025)

No Safe Dose: How Training Data Drives Unsafe Image Generation
por: Friedrich, Felix, et al.
Publicado: (2026)

LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Models
por: Helff, Lukas, et al.
Publicado: (2024)

SCAR: Sparse Conditioned Autoencoders for Concept Detection and Steering in LLMs
por: Härle, Ruben, et al.
Publicado: (2024)

Exploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesis
por: Struppek, Lukas, et al.
Publicado: (2022)

Multilingual Text-to-Image Generation Magnifies Gender Stereotypes and Prompt Engineering May Not Help You
por: Friedrich, Felix, et al.
Publicado: (2024)

Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)
por: Verma, Apurv, et al.
Publicado: (2024)

Red Teaming for Large Language Models At Scale: Tackling Hallucinations on Mathematics Tasks
por: Buszydlik, Aleksander, et al.
Publicado: (2023)

Does CLIP Know My Face?
por: Hintersdorf, Dominik, et al.
Publicado: (2022)

Measuring and Guiding Monosemanticity
por: Härle, Ruben, et al.
Publicado: (2025)

Towards Red Teaming in Multimodal and Multilingual Translation
por: Ropers, Christophe, et al.
Publicado: (2024)

Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models
por: Pan, Leyi, et al.
Publicado: (2025)

LEDITS++: Limitless Image Editing using Text-to-Image Models
por: Brack, Manuel, et al.
Publicado: (2023)

Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur Protocols
por: Deiseroth, Björn, et al.
Publicado: (2025)

GuardVal: Dynamic Large Language Model Jailbreak Evaluation for Comprehensive Safety Testing
por: Zhang, Peiyan, et al.
Publicado: (2025)

How to Train your Text-to-Image Model: Evaluating Design Choices for Synthetic Training Captions
por: Brack, Manuel, et al.
Publicado: (2025)

Core Tokensets for Data-efficient Sequential Training of Transformers
por: Paul, Subarnaduti, et al.
Publicado: (2024)

T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings
por: Deiseroth, Björn, et al.
Publicado: (2024)

PL-Guard: Benchmarking Language Model Safety for Polish
por: Krasnodębska, Aleksandra, et al.
Publicado: (2025)

ART: Adaptive Relation Tuning for Generalized Relation Prediction
por: Sudhakaran, Gopika, et al.
Publicado: (2025)

MedDialogRubrics: A Comprehensive Benchmark and Evaluation Framework for Multi-turn Medical Consultations in Large Language Models
por: Gong, Lecheng, et al.
Publicado: (2026)

AtManRL: Towards Faithful Reasoning via Differentiable Attention Saliency
por: Höth, Max Henning, et al.
Publicado: (2026)

EmoNet-Voice: A Fine-Grained, Expert-Verified Benchmark for Speech Emotion Detection
por: Schuhmann, Christoph, et al.
Publicado: (2025)

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews
por: Li, Bowen, et al.
Publicado: (2026)

Improving Consistency in Large Language Models through Chain of Guidance
por: Raj, Harsh, et al.
Publicado: (2025)

CHRONOBERG: Capturing Language Evolution and Temporal Awareness in Foundation Models
por: Hegde, Niharika, et al.
Publicado: (2025)

The Need for Guardrails with Large Language Models in Medical Safety-Critical Settings: An Artificial Intelligence Application in the Pharmacovigilance Ecosystem
por: Hakim, Joe B, et al.
Publicado: (2024)

Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey
por: Huang, Yunpeng, et al.
Publicado: (2023)

Evaluating Large Language Models for IUCN Red List Species Information
por: Uryu, Shinya
Publicado: (2025)

ChemPro: A Progressive Chemistry Benchmark for Large Language Models
por: Baranwal, Aaditya, et al.
Publicado: (2026)

Assessing Large Language Models on Islamic Legal Reasoning: Evidence from Inheritance Law Evaluation
por: Bouchekif, Abdessalam, et al.
Publicado: (2025)

Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis
por: Scirè, Alessandro, et al.
Publicado: (2024)

IFMTBench: A Comprehensive Benchmark for Multilingual Translation Instruction Following
por: Sun, Mingrui, et al.
Publicado: (2026)

MPCC: A Novel Benchmark for Multimodal Planning with Complex Constraints in Multimodal Large Language Models
por: Ji, Yiyan, et al.
Publicado: (2025)

Credit C-GPT: A Domain-Specialized Large Language Model for Conversational Understanding in Vietnamese Debt Collection
por: Hong, Nhung Nguyen Thi, et al.
Publicado: (2026)

NOAH: Benchmarking Narrative Prior driven Hallucination and Omission in Video Large Language Models
por: Lee, Kyuho, et al.
Publicado: (2025)

Do Large Language Models Understand Word Senses?
por: Meconi, Domenico, et al.
Publicado: (2025)