Copertina

Self-Training for Sample-Efficient Active Learning for Text Classification with Pre-Trained Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Schröder, Christopher, Heyer, Gerhard
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Text Quality-Based Pruning for Efficient Training of Language Models
di: Sharma, Vasu, et al.
Pubblicazione: (2024)

Learning Dynamics in Continual Pre-Training for Large Language Models
di: Wang, Xingjin, et al.
Pubblicazione: (2025)

STARLING: Self-supervised Training of Text-based Reinforcement Learning Agent with Large Language Models
di: Basavatia, Shreyas, et al.
Pubblicazione: (2024)

Learning to Detect Language Model Training Data via Active Reconstruction
di: Yin, Junjie Oscar, et al.
Pubblicazione: (2026)

Reinforcement Learning on Pre-Training Data
di: Li, Siheng, et al.
Pubblicazione: (2025)

Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
di: Abbes, Istabrak, et al.
Pubblicazione: (2025)

Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models
di: Zhang, Jun, et al.
Pubblicazione: (2025)

EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
di: Chen, Mengzhao, et al.
Pubblicazione: (2024)

Self-Training Elicits Concise Reasoning in Large Language Models
di: Munkhbat, Tergel, et al.
Pubblicazione: (2025)

Federated Learning with Layer Skipping: Efficient Training of Large Language Models for Healthcare NLP
di: Zhang, Lihong, et al.
Pubblicazione: (2025)

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models
di: Park, Jungwoo, et al.
Pubblicazione: (2025)

Sliding Window Attention Training for Efficient Large Language Models
di: Fu, Zichuan, et al.
Pubblicazione: (2025)

DIDS: Domain Impact-aware Data Sampling for Large Language Model Training
di: Shi, Weijie, et al.
Pubblicazione: (2025)

Language Models May Verbatim Complete Text They Were Not Explicitly Trained On
di: Liu, Ken Ziyu, et al.
Pubblicazione: (2025)

Query-Conditioned Test-Time Self-Training for Large Language Models
di: Song, Chaehee, et al.
Pubblicazione: (2026)

Self-Trained Verification for Training- and Test-Time Self-Improvement
di: Wu, Chen Henry, et al.
Pubblicazione: (2026)

Pointer-Guided Pre-Training: Infusing Large Language Models with Paragraph-Level Contextual Awareness
di: Hillebrand, Lars, et al.
Pubblicazione: (2024)

DACP: Domain-Adaptive Continual Pre-Training of Large Language Models for Phone Conversation Summarization
di: Fu, Xue-Yong, et al.
Pubblicazione: (2025)

CURE: Controlled Unlearning for Robust Embeddings -- Mitigating Conceptual Shortcuts in Pre-Trained Language Models
di: Kocak, Aysenur, et al.
Pubblicazione: (2025)

Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training
di: Zhuang, Yuchen, et al.
Pubblicazione: (2025)

Document-Level In-Context Few-Shot Relation Extraction via Pre-Trained Language Models
di: Ozyurt, Yilmazcan, et al.
Pubblicazione: (2023)

EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
di: Chen, Wenxi, et al.
Pubblicazione: (2024)

AdaSTaR: Adaptive Data Sampling for Training Self-Taught Reasoners
di: Koh, Woosung, et al.
Pubblicazione: (2025)

Regurgitative Training: The Value of Real Data in Training Large Language Models
di: Zhang, Jinghui, et al.
Pubblicazione: (2024)

Learning to Reason Efficiently with A* Post-Training
di: Opedal, Andreas, et al.
Pubblicazione: (2026)

Toward Understanding BERT-Like Pre-Training for DNA Foundation Models
di: Liang, Chaoqi, et al.
Pubblicazione: (2023)

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention
di: Lv, Xingtai, et al.
Pubblicazione: (2024)

OpenELM: An Efficient Language Model Family with Open Training and Inference Framework
di: Mehta, Sachin, et al.
Pubblicazione: (2024)

Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training
di: Pan, Rui, et al.
Pubblicazione: (2025)

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
di: Xiao, Guangxuan, et al.
Pubblicazione: (2022)

Training Language Models with Language Feedback at Scale
di: Scheurer, Jérémy, et al.
Pubblicazione: (2023)

Automated Multi-Language to English Machine Translation Using Generative Pre-Trained Transformers
di: Pelofske, Elijah, et al.
Pubblicazione: (2024)

Towards Efficient Resume Understanding: A Multi-Granularity Multi-Modal Pre-Training Approach
di: Jiang, Feihu, et al.
Pubblicazione: (2024)

Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models
di: Pan, Bowen, et al.
Pubblicazione: (2024)

Reinforcement Learning for Reasoning in Large Language Models with One Training Example
di: Wang, Yiping, et al.
Pubblicazione: (2025)

TableTime: Reformulating Time Series Classification as Training-Free Table Understanding with Large Language Models
di: Wang, Jiahao, et al.
Pubblicazione: (2024)

Active Preference Optimization for Sample Efficient RLHF
di: Das, Nirjhar, et al.
Pubblicazione: (2024)

Training Language Models to Explain Their Own Computations
di: Li, Belinda Z., et al.
Pubblicazione: (2025)

Training Optimal Large Diffusion Language Models
di: Ni, Jinjie, et al.
Pubblicazione: (2025)

Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning
di: Xi, Zhiheng, et al.
Pubblicazione: (2024)