Image de couverture de livre

StructEval: Deepen and Broaden Large Language Model Assessment via Structured Evaluation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cao, Boxi, Ren, Mengjie, Lin, Hongyu, Han, Xianpei, Zhang, Feng, Zhan, Junfeng, Sun, Le
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

StructEval: Benchmarking LLMs' Capabilities to Generate Structural Outputs
par: Yang, Jialin, et autres
Publié: (2025)

The Life Cycle of Knowledge in Big Language Models: A Survey
par: Cao, Boxi, et autres
Publié: (2023)

Learning or Self-aligning? Rethinking Instruction Fine-tuning
par: Ren, Mengjie, et autres
Publié: (2024)

Multi-Facet Counterfactual Learning for Content Quality Evaluation
par: Zheng, Jiasheng, et autres
Publié: (2024)

Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards
par: Ren, Mengjie, et autres
Publié: (2026)

Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination
par: Zheng, Jiasheng, et autres
Publié: (2026)

Towards Universal Dense Blocking for Entity Resolution
par: Wang, Tianshu, et autres
Publié: (2024)

Beyond Correctness: Benchmarking Multi-dimensional Code Generation for Large Language Models
par: Zheng, Jiasheng, et autres
Publié: (2024)

LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents
par: Peng, Xiaoxuan, et autres
Publié: (2026)

StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurization
par: Li, Zhuoqun, et autres
Publié: (2024)

The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model
par: Chen, Jiawei, et autres
Publié: (2024)

Meta-Cognitive Analysis: Evaluating Declarative and Procedural Knowledge in Datasets and Large Language Models
par: Li, Zhuoqun, et autres
Publié: (2024)

Not All Contexts Are Equal: Teaching LLMs Credibility-aware Generation
par: Pan, Ruotong, et autres
Publié: (2024)

Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models
par: Cao, Boxi, et autres
Publié: (2023)

When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models
par: Mao, Yingzhi, et autres
Publié: (2025)

Executing Natural Language-Described Algorithms with Large Language Models: An Investigation
par: Zheng, Xin, et autres
Publié: (2024)

ScaleBox: Enabling High-Fidelity and Scalable Code Verification for Large Language Models
par: Zheng, Jiasheng, et autres
Publié: (2026)

Rule or Story, Which is a Better Commonsense Expression for Talking with Large Language Models?
par: Bian, Ning, et autres
Publié: (2024)

AI for social science and social science of AI: A Survey
par: Xu, Ruoxi, et autres
Publié: (2024)

Large Language Models Often Say One Thing and Do Another
par: Xu, Ruoxi, et autres
Publié: (2025)

Critic-CoT: Boosting the reasoning abilities of large language model via Chain-of-thoughts Critic
par: Zheng, Xin, et autres
Publié: (2024)

URL: Universal Referential Knowledge Linking via Task-instructed Representation Compression
par: Li, Zhuoqun, et autres
Publié: (2024)

All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG
par: Wang, Dan, et autres
Publié: (2026)

Decoupling Reasoning and Confidence: Resurrecting Calibration in Reinforcement Learning from Verifiable Rewards
par: Ma, Zhengzhao, et autres
Publié: (2026)

Towards Scalable Automated Alignment of LLMs: A Survey
par: Cao, Boxi, et autres
Publié: (2024)

Beyond Text-Dominance: Understanding Modality Preference of Omni-modal Large Language Models
par: Yan, Xinru, et autres
Publié: (2026)

Memorizing is Not Enough: Deep Knowledge Injection Through Reasoning
par: Xu, Ruoxi, et autres
Publié: (2025)

Academically intelligent LLMs are not necessarily socially intelligent
par: Xu, Ruoxi, et autres
Publié: (2024)

SAISA: Towards Multimodal Large Language Models with Both Training and Inference Efficiency
par: Yuan, Qianhao, et autres
Publié: (2025)

Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching
par: Wang, Tianshu, et autres
Publié: (2024)

DBCopilot: Natural Language Querying over Massive Databases via Schema Routing
par: Wang, Tianshu, et autres
Publié: (2023)

Social Simulations with Large Language Model Risk Utopian Illusion
par: Bian, Ning, et autres
Publié: (2025)

ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models
par: Bian, Ning, et autres
Publié: (2023)

Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
par: Guan, Xinyan, et autres
Publié: (2024)

The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insights
par: Zhu, Wenhao, et autres
Publié: (2024)

Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces
par: Chen, Jiawei, et autres
Publié: (2026)

Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models
par: Xiang, Hao, et autres
Publié: (2024)

Few-shot Named Entity Recognition via Superposition Concept Discrimination
par: Chen, Jiawei, et autres
Publié: (2024)

Spiral of Silence: How is Large Language Model Killing Information Retrieval? -- A Case Study on Open Domain Question Answering
par: Chen, Xiaoyang, et autres
Publié: (2024)

REInstruct: Building Instruction Data from Unlabeled Corpus
par: Chen, Shu, et autres
Publié: (2024)