Cover Image

Ethos: Rectifying Language Models in Orthogonal Parameter Space

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gao, Lei, Niu, Yue, Tang, Tingting, Avestimehr, Salman, Annavaram, Murali
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Edge Private Graph Neural Networks with Singular Value Perturbation
by: Tang, Tingting, et al.
Published: (2024)

MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines
by: Gao, Lei, et al.
Published: (2024)

Differentially Private Retrieval-Augmented Generation
by: Tang, Tingting, et al.
Published: (2026)

Differentially Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

Adaptive Verifiable Coded Computing: Towards Fast, Secure and Private Distributed Machine Learning
by: Tang, Tingting, et al.
Published: (2021)

Differentially Private Knowledge Distillation via Synthetic Text Generation
by: Flemings, James, et al.
Published: (2024)

DELTA: Dynamic Layer-Aware Token Attention for Efficient Long-Context Reasoning
by: Zarch, Hossein Entezari, et al.
Published: (2025)

DEL: Context-Aware Dynamic Exit Layer for Efficient Self-Speculative Decoding
by: Zarch, Hossein Entezari, et al.
Published: (2025)

Estimating Privacy Leakage of Augmented Contextual Knowledge in Language Models
by: Flemings, James, et al.
Published: (2024)

Revisiting OPRO: The Limitations of Small-Scale LLMs as Optimizers
by: Zhang, Tuo, et al.
Published: (2024)

Uncertainty Quantification for Hallucination Detection in Large Language Models: Foundations, Methodology, and Future Directions
by: Kang, Sungmin, et al.
Published: (2025)

Leveraging Uncertainty Estimation for Efficient LLM Routing
by: Zhang, Tuo, et al.
Published: (2025)

LRD-MPC: Efficient MPC Inference through Low-rank Decomposition
by: Tang, Tingting, et al.
Published: (2026)

Rectified Sparse Attention
by: Sun, Yutao, et al.
Published: (2025)

Rectifying Belief Space via Unlearning to Harness LLMs' Reasoning
by: Niwa, Ayana, et al.
Published: (2025)

A Method for Building Large Language Models with Predefined KV Cache Capacity
by: Yi, Zhonghua, et al.
Published: (2024)

Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training
by: Lee, Sunwoo, et al.
Published: (2024)

KVPR: Efficient LLM Inference with I/O-Aware KV Cache Partial Recomputation
by: Jiang, Chaoyi, et al.
Published: (2024)

UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter-Efficient Fine-Tuning of Large Models
by: Zhang, Xueyan, et al.
Published: (2025)

Domain-Adaptive Continued Pre-Training of Small Language Models
by: Faroz, Salman
Published: (2025)

MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs
by: Bakman, Yavuz Faruk, et al.
Published: (2024)

ATP: Enabling Fast LLM Serving via Attention on Top Principal Keys
by: Niu, Yue, et al.
Published: (2024)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
by: Ma, Xinyu, et al.
Published: (2024)

The Rise of Parameter Specialization for Knowledge Storage in Large Language Models
by: Hong, Yihuai, et al.
Published: (2025)

Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs
by: Yaldiz, Duygu Nur, et al.
Published: (2024)

Fox-1: Open Small Language Model for Cloud and Edge
by: Hu, Zijian, et al.
Published: (2024)

O-Edit: Orthogonal Subspace Editing for Language Model Sequential Editing
by: Cai, Yuchen, et al.
Published: (2024)

Reject Only Critical Tokens: Pivot-Aware Speculative Decoding
by: Ziashahabi, Amir, et al.
Published: (2025)

Full Parameter Fine-tuning for Large Language Models with Limited Resources
by: Lv, Kai, et al.
Published: (2023)

Adapting Large Language Models for Time Series Modeling via a Novel Parameter-efficient Adaptation Method
by: Zhang, Juyuan, et al.
Published: (2025)

Ethos and Pathos in Online Group Discussions: Corpora for Polarisation Issues in Social Media
by: Gajewska, Ewelina, et al.
Published: (2024)

Contextual Compression Encoding for Large Language Models: A Novel Framework for Multi-Layered Parameter Space Pruning
by: Schmitt, Barnaby, et al.
Published: (2025)

Adaptively Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

Selecting Large Language Model to Fine-tune via Rectified Scaling Law
by: Lin, Haowei, et al.
Published: (2024)

Diversifying the Mixture-of-Experts Representation for Language Models with Orthogonal Optimizer
by: Liu, Boan, et al.
Published: (2023)

Fast NF4 Dequantization Kernels for Large Language Model Inference
by: Qi, Xiangbo, et al.
Published: (2026)

MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models
by: Luo, Tongxu, et al.
Published: (2024)

CryptoMamba: Leveraging State Space Models for Accurate Bitcoin Price Prediction
by: Sepehri, Mohammad Shahab, et al.
Published: (2025)

Orthogonal Low-rank Adaptation in Lie Groups for Continual Learning of Large Language Models
by: Cao, Kefan, et al.
Published: (2025)

GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Art
by: Lei, Yiming, et al.
Published: (2025)