Imagen de Portada

BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Roy, Subhro, Thomson, Sam, Chen, Tongfei, Shin, Richard, Pauls, Adam, Eisner, Jason, Van Durme, Benjamin
Formato:	Preprint
Publicado:	2022
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Learning to Retrieve Iteratively for In-Context Learning
por: Chen, Yunmo, et al.
Publicado: (2024)

MICE for CATs: Model-Internal Confidence Estimation for Calibrating Agents with Tools
por: Subramani, Nishant, et al.
Publicado: (2025)

Zero and Few-shot Semantic Parsing with Ambiguous Inputs
por: Stengel-Eskin, Elias, et al.
Publicado: (2023)

Hierarchical corpus encoder: Fusing generative retrieval and dense indices
por: Chen, Tongfei, et al.
Publicado: (2025)

LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts
por: Hashemi, Helia, et al.
Publicado: (2024)

Multi-Field Adaptive Retrieval
por: Li, Millicent, et al.
Publicado: (2024)

Do Androids Know They're Only Dreaming of Electric Sheep?
por: CH-Wang, Sky, et al.
Publicado: (2023)

Interpreting User Requests in the Context of Natural Language Standing Instructions
por: Moghe, Nikita, et al.
Publicado: (2023)

LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
por: Wang, Boshi, et al.
Publicado: (2024)

Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo
por: Loula, João, et al.
Publicado: (2025)

Automating the Analysis of Parsing Algorithms (and other Dynamic Programs)
por: Vieira, Tim, et al.
Publicado: (2025)

DeonticBench: A Benchmark for Reasoning over Rules
por: Dou, Guangyao, et al.
Publicado: (2026)

RE-Adapt: Reverse Engineered Adaptation of Large Language Models
por: Fleshman, William, et al.
Publicado: (2024)

A Joint Multitask Model for Morpho-Syntactic Parsing
por: Inostroza, Demian, et al.
Publicado: (2025)

RenoBench: A Citation Parsing Benchmark
por: Sarin, Parth, et al.
Publicado: (2026)

Modelling Child Learning and Parsing of Long-range Syntactic Dependencies
por: Mahon, Louis, et al.
Publicado: (2025)

A Study on How Attention Scores in the BERT Model are Aware of Lexical Categories in Syntactic and Semantic Tasks on the GLUE Benchmark
por: Jang, Dongjun, et al.
Publicado: (2024)

LoRA-Augmented Generation (LAG) for Knowledge-Intensive Language Tasks
por: Fleshman, William, et al.
Publicado: (2025)

A Systematic Comparison of Syntactic Representations of Dependency Parsing
por: Wisniewski, Guillaume, et al.
Publicado: (2025)

Evaluating Semantic and Syntactic Understanding in Large Language Models for Payroll Systems
por: Maclean, Hendrika, et al.
Publicado: (2026)

Language Models and Logic Programs for Trustworthy Tax Reasoning
por: Jurayj, William, et al.
Publicado: (2025)

Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models
por: Li, Zhuowan, et al.
Publicado: (2022)

SCOPE: Tree-based Self-Correcting Online Log Parsing via Syntactic-Semantic Collaboration
por: Fan, Dongyi, et al.
Publicado: (2026)

arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generation
por: Wang, Weiqi, et al.
Publicado: (2025)

Compressed Chain of Thought: Efficient Reasoning Through Dense Representations
por: Cheng, Jeffrey, et al.
Publicado: (2024)

Let's Think Var-by-Var: Large Language Models Enable Ad Hoc Probabilistic Reasoning
por: Xia, Shepard, et al.
Publicado: (2024)

CAIT: A Syntactic Parsing Toolkit for Child-Adult InTeractions
por: Padovani, Francesca, et al.
Publicado: (2026)

Compactor: Calibrated Query-Agnostic KV Cache Compression with Approximate Leverage Scores
por: Chari, Vivek, et al.
Publicado: (2025)

Accelerating Language Model Workflows with Prompt Choreography
por: Bai, TJ, et al.
Publicado: (2025)

Tur[k]ingBench: A Challenge Benchmark for Web Agents
por: Xu, Kevin, et al.
Publicado: (2024)

Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models
por: Kryvosheieva, Daria, et al.
Publicado: (2024)

SEQR: Secure and Efficient QR-based LoRA Routing
por: Fleshman, William, et al.
Publicado: (2025)

SpectR: Dynamically Composing LM Experts with Spectral Routing
por: Fleshman, William, et al.
Publicado: (2025)

Urdu Dependency Parsing and Treebank Development: A Syntactic and Morphological Perspective
por: Habib, Nudrat
Publicado: (2024)

Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data
por: Zhang, Jingyu, et al.
Publicado: (2024)

Targeted Syntactic Evaluation of Language Models on Georgian Case Alignment
por: Gallagher, Daniel, et al.
Publicado: (2026)

LLMs Provide Unstable Answers to Legal Questions
por: Blair-Stanek, Andrew, et al.
Publicado: (2025)

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
por: Kim, Seungone, et al.
Publicado: (2024)

RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation
por: Fleshman, William, et al.
Publicado: (2024)

BLT: Can Large Language Models Handle Basic Legal Text?
por: Blair-Stanek, Andrew, et al.
Publicado: (2023)