Imagen de Portada

Lost in Translation: Do LVLM Judges Generalize Across Languages?

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Laskar, Md Tahmid Rahman, Islam, Mohammed Saidul, Nayeem, Mir Tafseer, Bhuiyan, Amran, Rahman, Mizanur, Joty, Shafiq, Hoque, Enamul, Huang, Jimmy
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Deploying Tiny LVLM Judges for Real-World Evaluation of Chart Models: Lessons Learned and Best Practices
por: Laskar, Md Tahmid Rahman, et al.
Publicado: (2025)

Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning?
por: Laskar, Md Tahmid Rahman, et al.
Publicado: (2025)

From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Text
por: Mahbub, Ridwan, et al.
Publicado: (2025)

The Perils of Chart Deception: How Misleading Visualizations Affect Vision-Language Models
por: Mahbub, Ridwan, et al.
Publicado: (2025)

Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualization
por: Rahman, Mizanur, et al.
Publicado: (2026)

LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions
por: Rahman, Mizanur, et al.
Publicado: (2025)

Are Large Vision Language Models up to the Challenge of Chart Comprehension and Reasoning? An Extensive Investigation into the Capabilities and Limitations of LVLMs
por: Islam, Mohammed Saidul, et al.
Publicado: (2024)

Text2Vis: A Challenging and Diverse Benchmark for Generating Multimodal Visualizations from Text
por: Rahman, Mizanur, et al.
Publicado: (2025)

BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP
por: Kabir, Mohsinul, et al.
Publicado: (2023)

DataNarrative: Automated Data-Driven Storytelling with Visualizations and Texts
por: Islam, Mohammed Saidul, et al.
Publicado: (2024)

Evolution of ReID: From Early Methods to LLM Integration
por: Bhuiyan, Amran, et al.
Publicado: (2025)

Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judge
por: Laskar, Md Tahmid Rahman, et al.
Publicado: (2025)

A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations
por: Laskar, Md Tahmid Rahman, et al.
Publicado: (2024)

Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directions
por: Hoque, Enamul, et al.
Publicado: (2024)

ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering
por: Masry, Ahmed, et al.
Publicado: (2025)

Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Models
por: Alqahtani, Sawsan, et al.
Publicado: (2026)

Beyond Fertility: Analyzing STRR as a Metric for Multilingual Tokenization Evaluation
por: Nayeem, Mir Tafseer, et al.
Publicado: (2025)

DashboardQA: Benchmarking Multimodal Agents for Question Answering on Interactive Dashboards
por: Kartha, Aaryaman, et al.
Publicado: (2025)

DATAREEL: Automated Data-Driven Video Story Generation with Animations
por: Mahbub, Ridwan, et al.
Publicado: (2026)

XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags
por: Shohan, Faisal Tareque, et al.
Publicado: (2024)

Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Models
por: Islam, Shayekh Bin, et al.
Publicado: (2024)

Which English Do LLMs Prefer? Triangulating Structural Bias Towards American English in Foundation Models
por: Nayeem, Mir Tafseer, et al.
Publicado: (2026)

LFOSum: Summarizing Long-form Opinions with Large Language Models
por: Nayeem, Mir Tafseer, et al.
Publicado: (2024)

KidLM: Advancing Language Models for Children -- Early Insights and Future Directions
por: Nayeem, Mir Tafseer, et al.
Publicado: (2024)

Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges
por: Wang, Jiajia, et al.
Publicado: (2024)

Evaluating the Effectiveness of Cost-Efficient Large Language Models in Benchmark Biomedical Tasks
por: Jahan, Israt, et al.
Publicado: (2025)

A Comprehensive Evaluation of Large Language Models on Benchmark Biomedical Text Processing Tasks
por: Jahan, Israt, et al.
Publicado: (2023)

OpinioRAG: Towards Generating User-Centric Opinion Highlights from Large-scale Online Reviews
por: Nayeem, Mir Tafseer, et al.
Publicado: (2025)

ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning
por: Masry, Ahmed, et al.
Publicado: (2024)

State and politics in the transitional era of globalization: Twisting and turning toward authoritarian and hybrid regimes
por: Hafijur Rahman, et al.
Publicado: (2024)

Impact of Salinisation on the Neighbour-based Spatial Diversity of Tree Species in the Sundarbans Mangrove of Bangladesh
por: Rahman, Md Mizanur
Publicado: (2026)

SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations
por: Anik, Md Saidul Hoque, et al.
Publicado: (2025)

SurveyGen: Quality-Aware Scientific Survey Generation with Large Language Models
por: Bao, Tong, et al.
Publicado: (2025)

ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wild
por: Masry, Ahmed, et al.
Publicado: (2024)

Position: Beyond Assistance -- Reimagining LLMs as Ethical and Adaptive Co-Creators in Mental Health Care
por: Badawi, Abeer, et al.
Publicado: (2025)

A Heterogeneous Two-Stream Framework for Video Action Recognition with Comparative Fusion Analysis
por: Rahaman, Md. Afzalur, et al.
Publicado: (2026)

Dialectal Toxicity Detection: Evaluating LLM-as-a-Judge Consistency Across Language Varieties
por: Faisal, Fahim, et al.
Publicado: (2024)

Grid2Guide: A* Enabled Small Language Model for Indoor Navigation
por: Haque, Md. Wasiul, et al.
Publicado: (2025)

Future Mining: Learning for Safety and Security
por: Rahman, Md Sazedur, et al.
Publicado: (2026)

BEADs: Bias Evaluation Across Domains
por: Raza, Shaina, et al.
Publicado: (2024)