Cover Image

Fast and Low-Cost Genomic Foundation Models via Outlier Removal

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Luo, Haozheng, Qiu, Chenghao, Su, Maojiang, Zhou, Zhihan, Mehta, Zoe, Ye, Guo, Hu, Jerry Yao-Chieh, Liu, Han
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On Flow Matching KL Divergence
by: Su, Maojiang, et al.
Published: (2025)

In-Context Deep Learning via Transformer Models
by: Wu, Weimin, et al.
Published: (2024)

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models
by: Wu, Weimin, et al.
Published: (2025)

Minimalist Softmax Attention Provably Learns Constrained Boolean Functions
by: Hu, Jerry Yao-Chieh, et al.
Published: (2025)

Mind the Inconspicuous: Revealing the Hidden Weakness in Aligned LLMs' Refusal Boundaries
by: Yu, Jiahao, et al.
Published: (2024)

A Theoretical Analysis of Discrete Flow Matching Generative Models
by: Su, Maojiang, et al.
Published: (2025)

Discrete Flow Matching Policy Optimization
by: Su, Maojiang, et al.
Published: (2026)

GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models
by: Luo, Haozheng, et al.
Published: (2025)

Decoupled Alignment for Robust Plug-and-Play Adaptation
by: Luo, Haozheng, et al.
Published: (2024)

Outlier-Efficient Hopfield Layers for Large Transformer-Based Models
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Attention Sinks and Outliers in Attention Residuals
by: Luo, Haozheng, et al.
Published: (2026)

FROST: Filtering Reasoning Outliers with Attention for Efficient Reasoning
by: Luo, Haozheng, et al.
Published: (2026)

DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genome
by: Zhou, Zhihan, et al.
Published: (2023)

Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Outlier Removal in Cryo-EM via Radial Profiles
by: Kapnulin, Lev, et al.
Published: (2024)

Open-Ended Multi-Modal Relational Reasoning for Video Question Answering
by: Luo, Haozheng, et al.
Published: (2020)

Attention Mechanism, Max-Affine Partition, and Universal Approximation
by: Liu, Hude, et al.
Published: (2025)

On Statistical Rates and Provably Efficient Criteria of Latent Diffusion Transformers (DiTs)
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

On Computational Limits of Modern Hopfield Models: A Fine-Grained Complexity Analysis
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Conv-CoA: Improving Open-domain Question Answering in Large Language Models via Conversational Chain-of-Action
by: Pan, Zhenyu, et al.
Published: (2024)

Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models
by: Wu, Dennis, et al.
Published: (2024)

In-Context Algorithm Emulation in Fixed-Weight Transformers
by: Hu, Jerry Yao-Chieh, et al.
Published: (2025)

Transformer Approximations from ReLUs
by: Hu, Jerry Yao-Chieh, et al.
Published: (2026)

AdaHOP: Fast and Accurate Low-Precision Training via Outlier-Pattern-Aware Rotation
by: Kim, Seonggon, et al.
Published: (2026)

TaxDistill: Improving Metagenomic Taxonomic Annotation via Distilled Genomic Foundation Models
by: Ye, Rongye, et al.
Published: (2026)

Semantic Outlier Removal with Embedding Models and LLMs
by: Akbiyik, Eren, et al.
Published: (2025)

ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks
by: Ye, Dongxin, et al.
Published: (2026)

A New Outlier Removal Strategy Based on Reliability of Correspondence Graph for Fast Point Cloud Registration
by: Yan, Li, et al.
Published: (2022)

Pareto-Optimal Energy Alignment for Designing Nature-Like Antibodies
by: Wen, Yibo, et al.
Published: (2024)

Differentially Private Kernel Density Estimation
by: Liu, Erzhi, et al.
Published: (2024)

On Differentially Private String Distances
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

SGOR: Outlier Removal by Leveraging Semantic and Geometric Information for Robust Point Cloud Registration
by: Zhao, Guiyu, et al.
Published: (2024)

Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
by: Pan, Zhenyu, et al.
Published: (2024)

Is It a Free Lunch for Removing Outliers during Pretraining?
by: Liao, Baohao, et al.
Published: (2024)

Are Hallucinations Bad Estimations?
by: Liu, Hude, et al.
Published: (2025)

On Structured State-Space Duality
by: Hu, Jerry Yao-Chieh, et al.
Published: (2025)

STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Prediction
by: Wu, Dennis, et al.
Published: (2023)

Nonparametric Modern Hopfield Models
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Universal Approximation with Softmax Attention
by: Hu, Jerry Yao-Chieh, et al.
Published: (2025)