Copertina

Eliminating Position Bias of Language Models: A Mechanistic Approach

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Ziqi, Zhang, Hanlin, Li, Xiner, Huang, Kuan-Hao, Han, Chi, Ji, Shuiwang, Kakade, Sham M., Peng, Hao, Ji, Heng
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Prescriptive Scaling Reveals the Evolution of Language Model Capabilities
di: Zhang, Hanlin, et al.
Pubblicazione: (2026)

Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning
di: Jin, Jikai, et al.
Pubblicazione: (2025)

Mind the Gap: Examining the Self-Improvement Capabilities of Large Language Models
di: Song, Yuda, et al.
Pubblicazione: (2024)

CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-training
di: Brandfonbrener, David, et al.
Pubblicazione: (2024)

Discovering Physics Laws of Dynamical Systems via Invariant Function Learning
di: Gui, Shurui, et al.
Pubblicazione: (2025)

A Hierarchical Language Model For Interpretable Graph Reasoning
di: Khurana, Sambhav, et al.
Pubblicazione: (2024)

Understanding Emergent In-Context Learning from a Kernel Regression Perspective
di: Han, Chi, et al.
Pubblicazione: (2023)

Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems
di: Qi, Zhenting, et al.
Pubblicazione: (2024)

Active Test-Time Adaptation: Theoretical Analyses and An Algorithm
di: Gui, Shurui, et al.
Pubblicazione: (2024)

EvoLM: In Search of Lost Language Model Training Dynamics
di: Qi, Zhenting, et al.
Pubblicazione: (2025)

Graph Structure and Feature Extrapolation for Out-of-Distribution Generalization
di: Li, Xiner, et al.
Pubblicazione: (2023)

Model Extrapolation Expedites Alignment
di: Zheng, Chujie, et al.
Pubblicazione: (2024)

SOLO: A Single Transformer for Scalable Vision-Language Modeling
di: Chen, Yangyi, et al.
Pubblicazione: (2024)

Large Language Models on Graphs: A Comprehensive Survey
di: Jin, Bowen, et al.
Pubblicazione: (2023)

Prioritizing Image-Related Tokens Enhances Vision-Language Pre-Training
di: Chen, Yangyi, et al.
Pubblicazione: (2025)

Repeat After Me: Transformers are Better than State Space Models at Copying
di: Jelassi, Samy, et al.
Pubblicazione: (2024)

Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants
di: Morwani, Depen, et al.
Pubblicazione: (2025)

Language Models for Controllable DNA Sequence Design
di: Su, Xingyu, et al.
Pubblicazione: (2025)

A Study on the Calibration of In-context Learning
di: Zhang, Hanlin, et al.
Pubblicazione: (2023)

Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
di: Hart, Anna, et al.
Pubblicazione: (2026)

In Good GRACEs: Principled Teacher Selection for Knowledge Distillation
di: Panigrahi, Abhishek, et al.
Pubblicazione: (2025)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
di: Prabhakar, Akshara, et al.
Pubblicazione: (2024)

Loss-to-Loss Prediction: Scaling Laws for All Datasets
di: Brandfonbrener, David, et al.
Pubblicazione: (2024)

Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
di: Li, Kenneth, et al.
Pubblicazione: (2024)

Invariant Tokenization of Crystalline Materials for Language Model Enabled Generation
di: Yan, Keqiang, et al.
Pubblicazione: (2025)

Curriculum Reinforcement Learning from Easy to Hard Tasks Improves LLM Reasoning
di: Parashar, Shubham, et al.
Pubblicazione: (2025)

Word Embeddings Are Steers for Language Models
di: Han, Chi, et al.
Pubblicazione: (2023)

The Role of Sparsity for Length Generalization in Transformers
di: Golowich, Noah, et al.
Pubblicazione: (2025)

How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective
di: Liu, Qi, et al.
Pubblicazione: (2025)

Mitigating Biases for Instruction-following Language Models via Bias Neurons Elimination
di: Yang, Nakyeong, et al.
Pubblicazione: (2023)

MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback
di: Wang, Xingyao, et al.
Pubblicazione: (2023)

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension
di: Yu, Yijiong, et al.
Pubblicazione: (2024)

Tracking the Feature Dynamics in LLM Training: A Mechanistic Study
di: Xu, Yang, et al.
Pubblicazione: (2024)

Scaling Reward Modeling without Human Supervision
di: Fan, Jingxuan, et al.
Pubblicazione: (2026)

Peer-Predictive Self-Training for Language Model Reasoning
di: Feng, Shi, et al.
Pubblicazione: (2026)

From Lists to Emojis: How Format Bias Affects Model Alignment
di: Zhang, Xuanchang, et al.
Pubblicazione: (2024)

TRACES: Proactive Safety Auditing for Multi-Turn LLM Agents via Trajectory-State Modeling
di: Li, Jiaqian, et al.
Pubblicazione: (2026)

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
di: Xiao, Guangxuan, et al.
Pubblicazione: (2022)

Fact Checking Beyond Training Set
di: Karisani, Payam, et al.
Pubblicazione: (2024)

Mitigating Spurious Correlations in LLMs via Causality-Aware Post-Training
di: Gui, Shurui, et al.
Pubblicazione: (2025)