Cover Image

Sparse Fine-Tuning of Transformers for Generative Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Wei, Yu, Jingxi, Miao, Zichen, Qiu, Qiang
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Models
by: Miao, Zichen, et al.
Published: (2025)

Large Convolutional Model Tuning via Filter Subspace
by: Chen, Wei, et al.
Published: (2024)

Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization
by: Miao, Zichen, et al.
Published: (2024)

Sparse-Tuning: Adapting Vision Transformers with Efficient Fine-tuning and Inference
by: Liu, Ting, et al.
Published: (2024)

DiTASK: Multi-Task Fine-Tuning with Diffeomorphic Transformations
by: Mantri, Krishna Sri Ipsit, et al.
Published: (2025)

On the Suitability of Reinforcement Fine-Tuning to Visual Tasks
by: Chen, Xiaxu, et al.
Published: (2025)

Expert Pyramid Tuning: Efficient Parameter Fine-Tuning for Expertise-Driven Task Allocation
by: Zhang, Jia-Chen, et al.
Published: (2026)

TS-SAM: Fine-Tuning Segment-Anything Model for Downstream Tasks
by: Yu, Yang, et al.
Published: (2024)

S2FT: Parameter-Efficient Fine-Tuning in Sparse Spectrum Domain
by: Zhang, Baoquan, et al.
Published: (2026)

Mixed Text Recognition with Efficient Parameter Fine-Tuning and Transformer
by: Chang, Da, et al.
Published: (2024)

TAVP: Task-Adaptive Visual Prompt for Cross-domain Few-shot Segmentation
by: Yang, Jiaqi, et al.
Published: (2024)

Multi-Task Dense Prediction Fine-Tuning with Mixture of Fine-Grained Experts
by: Xu, Yangyang, et al.
Published: (2025)

Fine-Tuning Video Transformers for Word-Level Bangla Sign Language: A Comparative Analysis for Classification Tasks
by: Shawon, Jubayer Ahmed Bhuiyan, et al.
Published: (2025)

Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach
by: Dong, Wei, et al.
Published: (2024)

Bidirectional Progressive Transformer for Interaction Intention Anticipation
by: Zhang, Zichen, et al.
Published: (2024)

Mesh-RFT: Enhancing Mesh Generation via Fine-grained Reinforcement Fine-Tuning
by: Liu, Jian, et al.
Published: (2025)

Uni-MuMER: Unified Multi-Task Fine-Tuning of Vision-Language Model for Handwritten Mathematical Expression Recognition
by: Li, Yu, et al.
Published: (2025)

An Efficient and Effective Transformer Decoder-Based Framework for Multi-Task Visual Grounding
by: Chen, Wei, et al.
Published: (2024)

Sparse Transformer for Ultra-sparse Sampled Video Compressive Sensing
by: Cao, Miao, et al.
Published: (2025)

QuantTune: Optimizing Model Quantization with Adaptive Outlier-Driven Fine Tuning
by: Chen, Jiun-Man, et al.
Published: (2024)

Seeing Clearly, Forgetting Deeply: Revisiting Fine-Tuned Video Generators for Driving Simulation
by: Chang, Chun-Peng, et al.
Published: (2025)

Exploring Task-Solving Paradigm for Generalized Cross-Domain Face Anti-Spoofing via Reinforcement Fine-Tuning
by: Jiang, Fangling, et al.
Published: (2025)

Pose-RFT: Enhancing MLLMs for 3D Pose Generation via Hybrid Action Reinforcement Fine-Tuning
by: Li, Bao, et al.
Published: (2025)

Switch Diffusion Transformer: Synergizing Denoising Tasks with Sparse Mixture-of-Experts
by: Park, Byeongjun, et al.
Published: (2024)

Many-Task Federated Fine-Tuning via Unified Task Vectors
by: Tsouvalas, Vasileios, et al.
Published: (2025)

Lossless Token Merging Even Without Fine-Tuning in Vision Transformers
by: Lee, Jaeyeon, et al.
Published: (2025)

Remodeling Semantic Relationships in Vision-Language Fine-Tuning
by: Wu, Xiangyang, et al.
Published: (2025)

5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks
by: Yin, Dongshuo, et al.
Published: (2024)

SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning
by: Nguyen, Bac, et al.
Published: (2024)

Peregrine: One-Shot Fine-Tuning for FHE Inference of General Deep CNNs
by: Ling, Huaming, et al.
Published: (2025)

Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language Reasoning
by: Li, Rongjie, et al.
Published: (2024)

EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation
by: Tan, Xiaofeng, et al.
Published: (2026)

Temporal2Seq: A Unified Framework for Temporal Video Understanding Tasks
by: Yang, Min, et al.
Published: (2024)

Dynamic Embedding of Hierarchical Visual Features for Efficient Vision-Language Fine-Tuning
by: Wei, Xinyu, et al.
Published: (2025)

Fine-Tuning Stable Diffusion XL for Stylistic Icon Generation: A Comparison of Caption Size
by: Sultan, Youssef, et al.
Published: (2024)

Fine-Grained Prototypes Distillation for Few-Shot Object Detection
by: Wang, Zichen, et al.
Published: (2024)

FAAR: Efficient Frequency-Aware Multi-Task Fine-Tuning via Automatic Rank Selection
by: Fontana, Maxime, et al.
Published: (2026)

Learning to Customize Text-to-Image Diffusion In Diverse Context
by: Kim, Taewook, et al.
Published: (2024)

Fine-Tuning Visual Autoregressive Models for Subject-Driven Generation
by: Chung, Jiwoo, et al.
Published: (2025)

DFSAttn: Dynamic Fine-grained Sparse Attention for Efficient Video Generation
by: Hu, Jie, et al.
Published: (2026)