Imagen de Portada

Unlocking Noisy Real-World Corpora for Foundation Model Pre-Training via Quality-Aware Tokenization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gollwitzer, Arvid E., Latawa, Paridhi, de Gruijl, David, Subramanian, Deepak A., de la Colina, Adrián Noriega
Formato:	Preprint
Publicado:	2026
Materias:	Artificial Intelligence Computational Engineering, Finance, and Science Genomics Computational Finance
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

TrinityDNA: A Bio-Inspired Foundational Model for Efficient Long-Sequence DNA Modeling
por: Yang, Qirong, et al.
Publicado: (2025)

scVGAE: A Novel Approach using ZINB-Based Variational Graph Autoencoder for Single-Cell RNA-Seq Imputation
por: Inoue, Yoshitaka
Publicado: (2024)

Gene and RNA Editing: Methods, Enabling Technologies, Applications, and Future Directions
por: Aledhari, Mohammed, et al.
Publicado: (2024)

From In Silico to In Vitro: A Comprehensive Guide to Validating Bioinformatics Findings
por: Wang, Tianyang, et al.
Publicado: (2025)

AirLift: A Fast and Comprehensive Technique for Remapping Alignments between Reference Genomes
por: Kim, Jeremie S., et al.
Publicado: (2019)

DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genome
por: Zhou, Zhihan, et al.
Publicado: (2023)

SHAP zero Explains Biological Sequence Models with Near-zero Marginal Cost for Future Queries
por: Tsui, Darin, et al.
Publicado: (2024)

Beyond the Alphabet: Deep Signal Embedding for Enhanced DNA Clustering
por: Abraham, Hadas, et al.
Publicado: (2024)

ChromFound: Towards A Universal Foundation Model for Single-Cell Chromatin Accessibility Data
por: Jiao, Yifeng, et al.
Publicado: (2025)

AntigenLM: Structure-Aware DNA Language Modeling for Influenza
por: Pei, Yue, et al.
Publicado: (2026)

dnaGrinder: a lightweight and high-capacity genomic foundation model
por: Zhao, Qihang, et al.
Publicado: (2024)

DNABERT-S: Pioneering Species Differentiation with Species-Aware DNA Embeddings
por: Zhou, Zhihan, et al.
Publicado: (2024)

Tokenized but Illiquid? Evidence from Real-World Asset Markets
por: Mafrur, Rischan
Publicado: (2026)

Btrim: A fast, lightweight adapter and quality trimming program for next-generation sequencing technologies
por: Kong, Yong
Publicado: (2014)

A Linear Time Quantum Algorithm for Pairwise Sequence Alignment
por: Khan, Md. Rabiul Islam, et al.
Publicado: (2023)

Beyond TVL: An Explainable Risk Scoring Framework for Tokenized Real-World Assets
por: Mafrur, Rischan, et al.
Publicado: (2026)

Revisiting K-mer Profile for Effective and Scalable Genome Representation Learning
por: Celikkanat, Abdulkadir, et al.
Publicado: (2024)

Decentralized Token Economy Theory (DeTEcT)
por: Sadykhov, Rem, et al.
Publicado: (2023)

RNA-GPT: Multimodal Generative System for RNA Sequence Understanding
por: Xiao, Yijia, et al.
Publicado: (2024)

Impacts of Economic Policies on Wealth Distribution in Token Economies
por: Sadykhov, Rem, et al.
Publicado: (2026)

GraphPINE: Graph Importance Propagation for Interpretable Drug Response Prediction
por: Inoue, Yoshitaka, et al.
Publicado: (2025)

Fast assessment of non-Gaussian inputs in structural dynamics exploiting modal solutions
por: Trapp, Arvid, et al.
Publicado: (2024)

Tokenizing Stock Prices for Enhanced Multi-Step Forecast and Prediction
por: Zhu, Zhuohang, et al.
Publicado: (2025)

SoK: Stablecoins for Digital Transformation -- Design, Metrics, and Application with Real World Asset Tokenization as a Case Study
por: Zhang, Luyao
Publicado: (2025)

AI-Trader: Benchmarking Autonomous Agents in Real-Time Financial Markets
por: Fan, Tianyu, et al.
Publicado: (2025)

When Dimensionality Hurts: The Role of LLM Embedding Compression for Noisy Regression Tasks
por: Drinkall, Felix, et al.
Publicado: (2025)

Decoding RWA Tokenized U.S. Treasuries: Functional Dissection and Address Role Inference
por: Luo, Junliang, et al.
Publicado: (2025)

Tokenize Everything, But Can You Sell It? RWA Liquidity Challenges and the Road Ahead
por: Mafrur, Rischan
Publicado: (2025)

Identifying and Quantifying Financial Bubbles with the Hyped Log-Periodic Power Law Model
por: Cao, Zheng, et al.
Publicado: (2025)

DeTEcT: Dynamic and Probabilistic Parameters Extension
por: Sadykhov, Rem, et al.
Publicado: (2024)

Koedds: A National Real Estate Investment Analysis
por: Kouma, Sean, et al.
Publicado: (2025)

How Much is Enough? The Diminishing Returns of Tokenization Training Data
por: Reddy, Varshini, et al.
Publicado: (2025)

VERAFI: Verified Agentic Financial Intelligence through Neurosymbolic Policy Generation
por: Akinfaderin, Adewale, et al.
Publicado: (2025)

An empirical study of market risk factors for Bitcoin
por: Singh, Shubham
Publicado: (2024)

Machine Learning Methods for Pricing Financial Derivatives
por: Fan, Lei, et al.
Publicado: (2024)

ChemFM as a Scaling Law Guided Foundation Model Pre-trained on Informative Chemicals
por: Cai, Feiyang, et al.
Publicado: (2024)

Transforming Japan Real Estate
por: Haque, Diabul
Publicado: (2024)

Modeling of Measurement Error in Financial Returns Data
por: Jasra, Ajay, et al.
Publicado: (2024)

PRAGMA: Revolut Foundation Model
por: Ostroukhov, Maxim, et al.
Publicado: (2026)

Generative Pre-Trained Diffusion Paradigm for Zero-Shot Time Series Forecasting
por: Yang, Jiarui, et al.
Publicado: (2024)