Imagen de Portada

PRSM: A Measure to Evaluate CLIP's Robustness Against Paraphrases

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Schlegel, Udo, Weeber, Franziska, Lan, Jian, Seidl, Thomas
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Computers and Society Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Evaluating GPT-4 at Grading Handwritten Solutions in Math Exams
por: Caraeni, Adriana, et al.
Publicado: (2024)

Do Political Opinions Transfer Between Western Languages? An Analysis of Unaligned and Aligned Multilingual LLMs
por: Weeber, Franziska, et al.
Publicado: (2025)

FairPair: A Robust Evaluation of Biases in Language Models through Paired Perturbations
por: Dwivedi-Yu, Jane, et al.
Publicado: (2024)

CodeMirage: A Multi-Lingual Benchmark for Detecting AI-Generated and Paraphrased Source Code from Production-Level LLMs
por: Guo, Hanxi, et al.
Publicado: (2025)

Interpreting Latent Student Knowledge Representations in Programming Assignments
por: Fernandez, Nigel, et al.
Publicado: (2024)

Improving Socratic Question Generation using Data Augmentation and Preference Optimization
por: Kumar, Nischal Ashok, et al.
Publicado: (2024)

Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs
por: Scarlatos, Alexander, et al.
Publicado: (2024)

LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins
por: Iqbal, Umar, et al.
Publicado: (2023)

ELMES: An Automated Framework for Evaluating Large Language Models in Educational Scenarios
por: Wei, Shou'ang, et al.
Publicado: (2025)

Test Case-Informed Knowledge Tracing for Open-ended Coding Tasks
por: Duan, Zhangqi, et al.
Publicado: (2024)

Towards Robust Evaluation of Unlearning in LLMs via Data Transformations
por: Joshi, Abhinav, et al.
Publicado: (2024)

Fair Representation in Parliamentary Summaries: Measuring and Mitigating Inclusion Bias
por: Cunningham, Eoghan, et al.
Publicado: (2025)

MahaParaphrase: A Marathi Paraphrase Detection Corpus and BERT-based Models
por: Jadhav, Suramya, et al.
Publicado: (2025)

Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp
por: Hong, Rachel, et al.
Publicado: (2024)

SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty Prediction
por: Scarlatos, Alexander, et al.
Publicado: (2025)

DiVERT: Distractor Generation with Variational Errors Represented as Text for Math Multiple-choice Questions
por: Fernandez, Nigel, et al.
Publicado: (2024)

Revisiting the Robustness of Watermarking to Paraphrasing Attacks
por: Rastogi, Saksham, et al.
Publicado: (2024)

LIBRA: Measuring Bias of Large Language Model from a Local Context
por: Pang, Bo, et al.
Publicado: (2025)

AliMark: Enhancing Robustness of Sentence-Level Watermarking Against Text Paraphrasing
por: Li, Yuexin, et al.
Publicado: (2026)

Mitigating Paraphrase Attacks on Machine-Text Detectors via Paraphrase Inversion
por: Soto, Rafael Rivera, et al.
Publicado: (2024)

Evaluating LLMs for Demographic-Targeted Social Bias Detection: A Comprehensive Benchmark Study
por: Majumdar, Ayan, et al.
Publicado: (2025)

Evaluating the Promise and Pitfalls of LLMs in Hiring Decisions
por: Anzenberg, Eitan, et al.
Publicado: (2025)

Towards Explainable Evaluation Metrics for Machine Translation
por: Leiter, Christoph, et al.
Publicado: (2023)

RTP-LX: Can LLMs Evaluate Toxicity in Multilingual Scenarios?
por: de Wynter, Adrian, et al.
Publicado: (2024)

Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Models
por: Kumar, Abhishek, et al.
Publicado: (2024)

Beyond Overcorrection: Evaluating Diversity in T2I Models with DivBench
por: Friedrich, Felix, et al.
Publicado: (2025)

RDBE: Reasoning Distillation-Based Evaluation Enhances Automatic Essay Scoring
por: Mohammadkhani, Ali Ghiasvand
Publicado: (2024)

Generalization in Healthcare AI: Evaluation of a Clinical Large Language Model
por: Rahman, Salman, et al.
Publicado: (2024)

SyllabusQA: A Course Logistics Question Answering Dataset
por: Fernandez, Nigel, et al.
Publicado: (2024)

When Style Breaks Safety: Defending LLMs Against Superficial Style Alignment
por: Xiao, Yuxin, et al.
Publicado: (2025)

Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches
por: Azime, Israel Abebe, et al.
Publicado: (2025)

EigenBench: A Comparative Behavioral Measure of Value Alignment
por: Chang, Jonathn, et al.
Publicado: (2025)

Beyond Behaviorist Representational Harms: A Plan for Measurement and Mitigation
por: Chien, Jennifer, et al.
Publicado: (2024)

KASER: Knowledge-Aligned Student Error Simulator for Open-Ended Coding Tasks
por: Duan, Zhangqi, et al.
Publicado: (2026)

Toward LLM-Supported Automated Assessment of Critical Thinking Subskills
por: Peczuh, Marisa C., et al.
Publicado: (2025)

What-If Explanations Over Time: Counterfactuals for Time Series Classification
por: Schlegel, Udo, et al.
Publicado: (2026)

Unveiling the "Fairness Seesaw": Discovering and Mitigating Gender and Race Bias in Vision-Language Models
por: Lan, Jian, et al.
Publicado: (2025)

Augmenting Human-Annotated Training Data with Large Language Model Generation and Distillation in Open-Response Assessment
por: Borchers, Conrad, et al.
Publicado: (2025)

Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications
por: Dong, Wenhan, et al.
Publicado: (2025)

Intimate Partner Violence and Injury Prediction From Radiology Reports
por: Chen, Irene Y., et al.
Publicado: (2020)