Imagen de Portada

MAPS: A Multilingual Benchmark for Agent Performance and Security

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hofman, Omer, Brokman, Jonathan, Rachmil, Oren, Bose, Shamik, Pahuja, Vikas, Shimizu, Toshiya, Starostina, Trisha, Marchisio, Kelly, Goldfarb-Tarrant, Seraphina, Vainshtein, Roman
Formato:	Preprint
Publicado:	2025
Materias:	Databases Computation and Language Cryptography and Security
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysis
por: Brokman, Jonathan, et al.
Publicado: (2024)

Manifold Induced Biases for Zero-shot and Few-shot Detection of Generated Images
por: Brokman, Jonathan, et al.
Publicado: (2025)

Training-Free Policy Violation Detection via Activation-Space Whitening in LLMs
por: Rachmil, Oren, et al.
Publicado: (2025)

Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts
por: Chen, Hongyu, et al.
Publicado: (2025)

Identifying Memorization of Diffusion Models through $p$-Laplace Analysis: Estimators, Bounds and Applications
por: Brokman, Jonathan, et al.
Publicado: (2025)

Inference-Time Backdoors via Chat Templates: From LLM Supply Chains to Agentic System Compromise
por: Fogel, Ariel, et al.
Publicado: (2026)

General and Domain-Specific Zero-shot Detection of Generated Images via Conditional Likelihood
por: Betser, Roy, et al.
Publicado: (2025)

When Scanners Lie: Evaluator Instability in LLM Red-Teaming
por: Erez, Lidor, et al.
Publicado: (2026)

Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts
por: Seshadri, Preethi, et al.
Publicado: (2025)

The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm
por: Aakanksha, et al.
Publicado: (2024)

Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Them
por: Rajani, Neel, et al.
Publicado: (2025)

MultiContrievers: Analysis of Dense Retrieval Representations
por: Goldfarb-Tarrant, Seraphina, et al.
Publicado: (2024)

Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations
por: Seshadri, Preethi, et al.
Publicado: (2026)

AgenTRIM: Tool Risk Mitigation for Agentic AI
por: Betser, Roy, et al.
Publicado: (2026)

Mix Data or Merge Models? Optimizing for Diverse Multi-Task Learning
por: Aakanksha, et al.
Publicado: (2024)

The Multilingual Divide and Its Impact on Global AI Safety
por: Peppin, Aidan, et al.
Publicado: (2025)

Counterfactual-based Agent Influence Ranker for Agentic AI Workflows
por: Giloni, Amit, et al.
Publicado: (2025)

Large Language Models Generate Harmful Content Using a Distinct, Unified Mechanism
por: Orgad, Hadas, et al.
Publicado: (2026)

Adversarial Intent is a Latent Variable: Stateful Trust Inference for Securing Multimodal Agentic RAG
por: Singh, Inderjeet, et al.
Publicado: (2026)

A SMART Mnemonic Sounds like "Glue Tonic": Mixing LLMs with Student Feedback to Make Mnemonic Learning Stick
por: Balepur, Nishant, et al.
Publicado: (2024)

Learning is Forgetting: LLM Training As Lossy Compression
por: Conklin, Henry C., et al.
Publicado: (2026)

Spectral Total-Variation Processing of Shapes: Theory and Applications
por: Brokman, Jonathan, et al.
Publicado: (2022)

A Good Plan is Hard to Find: Aligning Models with Preferences is Misaligned with What Helps Users
por: Balepur, Nishant, et al.
Publicado: (2025)

How Important is Domain Specificity in Language Models and Instruction Finetuning for Biomedical Relation Extraction?
por: Brokman, Aviv, et al.
Publicado: (2024)

Minimal Inversions in Integer Matrices of Fixed RSK Shape
por: Pahuja, Nimisha
Publicado: (2026)

Correlations in the multispecies PASEP on a ring
por: Pahuja, Nimisha
Publicado: (2023)

Recognizing and Avoiding Misinformation: Evaluating Sources for a FYW Researched Writing Assignment
por: Trisha Kelly Travers
Publicado: (2024)

How Does Quantization Affect Multilingual LLMs?
por: Marchisio, Kelly, et al.
Publicado: (2024)

RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs
por: Dang, John, et al.
Publicado: (2024)

The Branch Not Taken: Predicting Branching in Online Conversations
por: Meital, Shai, et al.
Publicado: (2024)

A Benchmark for End-to-End Zero-Shot Biomedical Relation Extraction with LLMs: Experiments with OpenAI Models
por: Brokman, Aviv, et al.
Publicado: (2025)

Joint Task Assistance Planning via Nested Branch and Bound (Extended Version)
por: Daube, Omer, et al.
Publicado: (2026)

To $B$ or not to be in single-trace $T\bar T$ holography
por: Giveon, Amit, et al.
Publicado: (2024)

On String theory on deformed BTZ and $T\bar{T} + J\bar{T} + T\bar{J}$
por: Giveon, Amit, et al.
Publicado: (2025)

Benchmark Computations of Nearly Degenerate Singlet and Triplet states of N-heterocyclic Chromophores : I. Wavefunction-based Methods
por: Chanda, Shamik, et al.
Publicado: (2023)

Smiling warnings and silent complicity: An autoethnographic reflection on academic bullying and mobbing
por: Daniele Marchisio
Publicado: (2026)

Fronteras de oportunidad. El proyecto desde la lógica ambiental
por: Mariela Marchisio
Publicado: (2007)

EMPLEO DE UN LABORATORIO REMOTO PARA PROMOVER APRENDIZAJES SIGNIFICATIVOS EN LA ENSEÑANZA DE LOS DISPOSITIVOS ELECTRÓNICOS
por: Susana Marchisio
Publicado: (2011)

Correlations in the continuous multispecies TASEP on a ring
por: Pahuja, Nimisha, et al.
Publicado: (2022)

Thermodynamic Geometry Through Second Order Phase Transitions
por: Basri, Omer M., et al.
Publicado: (2025)