Image de couverture de livre

BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Roy, Subhro, Thomson, Sam, Chen, Tongfei, Shin, Richard, Pauls, Adam, Eisner, Jason, Van Durme, Benjamin
Format:	Preprint
Publié:	2022
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Learning to Retrieve Iteratively for In-Context Learning
par: Chen, Yunmo, et autres
Publié: (2024)

MICE for CATs: Model-Internal Confidence Estimation for Calibrating Agents with Tools
par: Subramani, Nishant, et autres
Publié: (2025)

Zero and Few-shot Semantic Parsing with Ambiguous Inputs
par: Stengel-Eskin, Elias, et autres
Publié: (2023)

Hierarchical corpus encoder: Fusing generative retrieval and dense indices
par: Chen, Tongfei, et autres
Publié: (2025)

LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts
par: Hashemi, Helia, et autres
Publié: (2024)

Multi-Field Adaptive Retrieval
par: Li, Millicent, et autres
Publié: (2024)

Do Androids Know They're Only Dreaming of Electric Sheep?
par: CH-Wang, Sky, et autres
Publié: (2023)

Interpreting User Requests in the Context of Natural Language Standing Instructions
par: Moghe, Nikita, et autres
Publié: (2023)

LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
par: Wang, Boshi, et autres
Publié: (2024)

Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo
par: Loula, João, et autres
Publié: (2025)

Automating the Analysis of Parsing Algorithms (and other Dynamic Programs)
par: Vieira, Tim, et autres
Publié: (2025)

DeonticBench: A Benchmark for Reasoning over Rules
par: Dou, Guangyao, et autres
Publié: (2026)

RE-Adapt: Reverse Engineered Adaptation of Large Language Models
par: Fleshman, William, et autres
Publié: (2024)

A Joint Multitask Model for Morpho-Syntactic Parsing
par: Inostroza, Demian, et autres
Publié: (2025)

RenoBench: A Citation Parsing Benchmark
par: Sarin, Parth, et autres
Publié: (2026)

Modelling Child Learning and Parsing of Long-range Syntactic Dependencies
par: Mahon, Louis, et autres
Publié: (2025)

A Study on How Attention Scores in the BERT Model are Aware of Lexical Categories in Syntactic and Semantic Tasks on the GLUE Benchmark
par: Jang, Dongjun, et autres
Publié: (2024)

LoRA-Augmented Generation (LAG) for Knowledge-Intensive Language Tasks
par: Fleshman, William, et autres
Publié: (2025)

A Systematic Comparison of Syntactic Representations of Dependency Parsing
par: Wisniewski, Guillaume, et autres
Publié: (2025)

Evaluating Semantic and Syntactic Understanding in Large Language Models for Payroll Systems
par: Maclean, Hendrika, et autres
Publié: (2026)

Language Models and Logic Programs for Trustworthy Tax Reasoning
par: Jurayj, William, et autres
Publié: (2025)

Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models
par: Li, Zhuowan, et autres
Publié: (2022)

SCOPE: Tree-based Self-Correcting Online Log Parsing via Syntactic-Semantic Collaboration
par: Fan, Dongyi, et autres
Publié: (2026)

arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generation
par: Wang, Weiqi, et autres
Publié: (2025)

Compressed Chain of Thought: Efficient Reasoning Through Dense Representations
par: Cheng, Jeffrey, et autres
Publié: (2024)

Let's Think Var-by-Var: Large Language Models Enable Ad Hoc Probabilistic Reasoning
par: Xia, Shepard, et autres
Publié: (2024)

CAIT: A Syntactic Parsing Toolkit for Child-Adult InTeractions
par: Padovani, Francesca, et autres
Publié: (2026)

Compactor: Calibrated Query-Agnostic KV Cache Compression with Approximate Leverage Scores
par: Chari, Vivek, et autres
Publié: (2025)

Accelerating Language Model Workflows with Prompt Choreography
par: Bai, TJ, et autres
Publié: (2025)

Tur[k]ingBench: A Challenge Benchmark for Web Agents
par: Xu, Kevin, et autres
Publié: (2024)

Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models
par: Kryvosheieva, Daria, et autres
Publié: (2024)

SEQR: Secure and Efficient QR-based LoRA Routing
par: Fleshman, William, et autres
Publié: (2025)

SpectR: Dynamically Composing LM Experts with Spectral Routing
par: Fleshman, William, et autres
Publié: (2025)

Urdu Dependency Parsing and Treebank Development: A Syntactic and Morphological Perspective
par: Habib, Nudrat
Publié: (2024)

Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data
par: Zhang, Jingyu, et autres
Publié: (2024)

Targeted Syntactic Evaluation of Language Models on Georgian Case Alignment
par: Gallagher, Daniel, et autres
Publié: (2026)

LLMs Provide Unstable Answers to Legal Questions
par: Blair-Stanek, Andrew, et autres
Publié: (2025)

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
par: Kim, Seungone, et autres
Publié: (2024)

RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation
par: Fleshman, William, et autres
Publié: (2024)

BLT: Can Large Language Models Handle Basic Legal Text?
par: Blair-Stanek, Andrew, et autres
Publié: (2023)