Copertina

Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhu, Hongyin, Peng, Hao, Lyu, Zhiheng, Hou, Lei, Li, Juanzi, Xiao, Jinghui
Natura:	Preprint
Pubblicazione:	2021
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Pre-training Distillation for Large Language Models: A Design Space Exploration
di: Peng, Hao, et al.
Pubblicazione: (2024)

AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge Reasoning
di: Xin, Amy, et al.
Pubblicazione: (2024)

R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models
di: Tu, Shangqing, et al.
Pubblicazione: (2024)

Adaptive Few-shot Prompting for Machine Translation with Pre-trained Language Models
di: Tang, Lei, et al.
Pubblicazione: (2025)

ADELIE: Aligning Large Language Models on Information Extraction
di: Qi, Yunjia, et al.
Pubblicazione: (2024)

MRCEval: A Comprehensive, Challenging and Accessible Machine Reading Comprehension Benchmark
di: Ma, Shengkun, et al.
Pubblicazione: (2025)

Constraint Back-translation Improves Complex Instruction Following of Large Language Models
di: Qi, Yunjia, et al.
Pubblicazione: (2024)

Challenges and Responses in the Practice of Large Language Models
di: Zhu, Hongyin
Pubblicazione: (2024)

Architectural Foundations for the Large Language Model Infrastructures
di: Zhu, Hongyin
Pubblicazione: (2024)

Unifying Ontology Construction and Semantic Alignment for Deterministic Enterprise Reasoning at Scale
di: Zhu, Hongyin
Pubblicazione: (2026)

Domain Pre-training Impact on Representations
di: Gonzalez-Gutierrez, Cesar, et al.
Pubblicazione: (2025)

KB-Plugin: A Plug-and-play Framework for Large Language Models to Induce Programs over Low-resourced Knowledge Bases
di: Zhang, Jiajie, et al.
Pubblicazione: (2024)

OpenEP: Open-Ended Future Event Prediction
di: Guan, Yong, et al.
Pubblicazione: (2024)

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
di: Yang, Kailai, et al.
Pubblicazione: (2025)

Event-level Knowledge Editing
di: Peng, Hao, et al.
Pubblicazione: (2024)

How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering
di: Liu, Jinxin, et al.
Pubblicazione: (2024)

Boundary-Guided Policy Optimization for Memory-efficient RL of Diffusion Large Language Models
di: Lin, Nianyi, et al.
Pubblicazione: (2025)

Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models
di: Liu, Yantao, et al.
Pubblicazione: (2024)

WildReward: Learning Reward Models from In-the-Wild Human Interactions
di: Peng, Hao, et al.
Pubblicazione: (2026)

Construct, Align, and Reason: Large Ontology Models for Enterprise Knowledge Management
di: Zhang, Yao, et al.
Pubblicazione: (2026)

Climate Change from Large Language Models
di: Zhu, Hongyin, et al.
Pubblicazione: (2023)

AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios
di: Qi, Yunjia, et al.
Pubblicazione: (2025)

RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
di: Liu, Yantao, et al.
Pubblicazione: (2024)

KoCo: Conditioning Language Model Pre-training on Knowledge Coordinates
di: Li, Yudong, et al.
Pubblicazione: (2026)

Knowledge-to-Jailbreak: Investigating Knowledge-driven Jailbreaking Attacks for Large Language Models
di: Tu, Shangqing, et al.
Pubblicazione: (2024)

Evaluating Generative Language Models in Information Extraction as Subjective Question Correction
di: Fan, Yuchen, et al.
Pubblicazione: (2024)

Pre-trained Language Model with Prompts for Temporal Knowledge Graph Completion
di: Xu, Wenjie, et al.
Pubblicazione: (2023)

StoryAlign: Evaluating and Training Reward Models for Story Generation
di: Xia, Haotian, et al.
Pubblicazione: (2026)

Reranking Passages with Coarse-to-Fine Neural Retriever Enhanced by List-Context Information
di: Zhu, Hongyin
Pubblicazione: (2023)

LLMAEL: Large Language Models are Good Context Augmenters for Entity Linking
di: Xin, Amy, et al.
Pubblicazione: (2024)

Guiding LLM Post-training Data Engineering with Model Internals from Sparse Autoencoders
di: Jing, Yi, et al.
Pubblicazione: (2026)

VerIF: Verification Engineering for Reinforcement Learning in Instruction Following
di: Peng, Hao, et al.
Pubblicazione: (2025)

Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems
di: Qiu, Zhangchi, et al.
Pubblicazione: (2023)

Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
di: Peng, Hao, et al.
Pubblicazione: (2025)

WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models
di: Tu, Shangqing, et al.
Pubblicazione: (2023)

Knowledge-augmented Pre-trained Language Models for Biomedical Relation Extraction
di: Sänger, Mario, et al.
Pubblicazione: (2025)

Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training
di: Luo, Zheheng, et al.
Pubblicazione: (2024)

MAVEN-Fact: A Large-scale Event Factuality Detection Dataset
di: Li, Chunyang, et al.
Pubblicazione: (2024)

Pre-training Limited Memory Language Models with Internal and External Knowledge
di: Zhao, Linxi, et al.
Pubblicazione: (2025)

TriCon-Fair: Triplet Contrastive Learning for Mitigating Social Bias in Pre-trained Language Models
di: Lyu, Chong, et al.
Pubblicazione: (2025)