Cover Image

Transformers from Compressed Representations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Alcazar, Juan C. Leon, Soldan, Mattia, Saatialsoruji, Mohammad, Pardo, Alejandro, Itani, Hani, Perez, Juan Camilo, Ghanem, Bernard
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Compressed-Language Models for Understanding Compressed File Formats: a JPEG Exploration
by: Pérez, Juan C., et al.
Published: (2024)

Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Think
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2025)

Evaluation of Test-Time Adaptation Under Computational Time Constraints
by: Alfarra, Motasem, et al.
Published: (2023)

MatchDiffusion: Training-free Generation of Match-cuts
by: Pardo, Alejandro, et al.
Published: (2024)

SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

MoDA: Modulation Adapter for Fine-Grained Visual Grounding in Instructional MLLMs
by: Barrios, Wayner, et al.
Published: (2025)

CURE: Curriculum-guided Multi-task Training for Reliable Anatomy Grounded Report Generation
by: Messina, Pablo, et al.
Published: (2026)

Hala Technical Report: Building Arabic-Centric Instruction & Translation Models at Scale
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2025)

On the Importance of Pretraining Data Alignment for Atomic Property Prediction
by: Ghunaim, Yasir, et al.
Published: (2025)

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning
by: Yang, Yibo, et al.
Published: (2024)

Structured-Noise Masked Modeling for Video, Audio and Beyond
by: Bhowmik, Aritra, et al.
Published: (2025)

Hybrid Dynamic Pruning: A Pathway to Efficient Transformer Inference
by: Jaradat, Ghadeer, et al.
Published: (2024)

PhysioWave: A Multi-Scale Wavelet-Transformer for Physiological Signal Representation
by: Chen, Yanlong, et al.
Published: (2025)

MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing
by: Zhang, Tong, et al.
Published: (2025)

Motor Imagery EEG Signal Classification Using Minimally Random Convolutional Kernel Transform and Hybrid Deep Learning
by: Hwaidi, Jamal, et al.
Published: (2025)

Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning
by: Ghanem, Abdelghani, et al.
Published: (2026)

Zero-Shot Instruction Following in RL via Structured LTL Representations
by: Giuri, Mattia, et al.
Published: (2025)

DiffCLIP: Differential Attention Meets CLIP
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2025)

Zero-Shot Instruction Following in RL via Structured LTL Representations
by: Jackermeier, Mathias, et al.
Published: (2026)

Optimizing Deep Neural Networks using Safety-Guided Self Compression
by: Zbeeb, Mohammad, et al.
Published: (2025)

Understanding Transformers for Time Series: Rank Structure, Flow-of-ranks, and Compressibility
by: Yu, Annan, et al.
Published: (2025)

Unforgotten Safety: Preserving Safety Alignment of Large Language Models with Continual Learning
by: Alssum, Lama, et al.
Published: (2025)

SAVeS: Steering Safety Judgments in Vision-Language Models via Semantic Cues
by: Hinojosa, Carlos, et al.
Published: (2026)

Learning Semantic Segmentation with Query Points Supervision on Aerial Images
by: Rivier, Santiago, et al.
Published: (2023)

Robust Basis Spline Decoupling for the Compression of Transformer Models
by: De Jonghe, Joppe, et al.
Published: (2026)

Simple Path Structural Encoding for Graph Transformers
by: Airale, Louis, et al.
Published: (2025)

Toward Efficient Influence Function: Dropout as a Compression Tool
by: Zhang, Yuchen, et al.
Published: (2025)

Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
by: Kim, Minseon, et al.
Published: (2025)

Projected Compression: Trainable Projection for Efficient Transformer Compression
by: Stefaniak, Maciej, et al.
Published: (2025)

An Embarrassingly Simple Defense Against LLM Abliteration Attacks
by: Shairah, Harethah Abu, et al.
Published: (2025)

Turning the Spell Around: Lightweight Alignment Amplification via Rank-One Safety Injection
by: Shairah, Harethah Abu, et al.
Published: (2025)

Scaling Graph Transformers: A Comparative Study of Sparse and Dense Attention
by: Dimitrov, Leon
Published: (2025)

Privacy-Enhancing Infant Cry Classification with Federated Transformers and Denoising Regularization
by: Owino, Geofrey, et al.
Published: (2025)

ColorMAE: Exploring data-independent masking strategies in Masked AutoEncoders
by: Hinojosa, Carlos, et al.
Published: (2024)

Graph Propagation Transformer for Graph Representation Learning
by: Chen, Zhe, et al.
Published: (2023)

Machine Learning and Transformers for Thyroid Carcinoma Diagnosis: A Review
by: Habchi, Yassine, et al.
Published: (2024)

Learning Isometric Embeddings of Road Networks using Multidimensional Scaling
by: Pardo, Juan Carlos Climent
Published: (2025)

AraLingBench A Human-Annotated Benchmark for Evaluating Arabic Linguistic Capabilities of Large Language Models
by: Zbeeb, Mohammad, et al.
Published: (2025)

Conservative Contextual Bandits: Beyond Linear Representations
by: Deb, Rohan, et al.
Published: (2024)

nGPT: Normalized Transformer with Representation Learning on the Hypersphere
by: Loshchilov, Ilya, et al.
Published: (2024)