Copertina

Extracting Interpretable Task-Specific Circuits from Large Language Models for Faster Inference

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	García-Carrasco, Jorge, Maté, Alejandro, Trujillo, Juan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

How does GPT-2 Predict Acronyms? Extracting and Understanding a Circuit via Mechanistic Interpretability
di: García-Carrasco, Jorge, et al.
Pubblicazione: (2024)

Detecting and Understanding Vulnerabilities in Language Models via Mechanistic Interpretability
di: García-Carrasco, Jorge, et al.
Pubblicazione: (2024)

Refining ADHD diagnosis with EEG: The impact of preprocessing and temporal segmentation on classification accuracy
di: García-Ponsoda, Sandra, et al.
Pubblicazione: (2024)

Finding Interpretable Prompt-Specific Circuits in Language Models
di: Franco, Gabriel, et al.
Pubblicazione: (2026)

FlashDecoding++: Faster Large Language Model Inference on GPUs
di: Hong, Ke, et al.
Pubblicazione: (2023)

Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference
di: Kim, Geonhee, et al.
Pubblicazione: (2024)

Faster MoE LLM Inference for Extremely Large Models
di: Yang, Haoqi, et al.
Pubblicazione: (2025)

Revisiting In-context Learning Inference Circuit in Large Language Models
di: Cho, Hakaze, et al.
Pubblicazione: (2024)

Faster, Smaller, and Smarter: Task-Aware Expert Merging for Online MoE Inference
di: Han, Ziyi, et al.
Pubblicazione: (2025)

EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees
di: Li, Yuhui, et al.
Pubblicazione: (2024)

Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Models
di: Cao, Jinghan, et al.
Pubblicazione: (2026)

HashAttention: Semantic Sparsity for Faster Inference
di: Desai, Aditya, et al.
Pubblicazione: (2024)

Towards Interpretable Sequence Continuation: Analyzing Shared Circuits in Large Language Models
di: Lan, Michael, et al.
Pubblicazione: (2023)

PARALLELPROMPT: Extracting Parallelism from Large Language Model Queries
di: Kolawole, Steven, et al.
Pubblicazione: (2025)

Structural Inference: Interpreting Small Language Models with Susceptibilities
di: Baker, Garrett, et al.
Pubblicazione: (2025)

Towards Faster Language Model Inference Using Mixture-of-Experts Flow Matching
di: Li, Aihua
Pubblicazione: (2026)

Inference-Time Decomposition of Activations (ITDA): A Scalable Approach to Interpreting Large Language Models
di: Leask, Patrick, et al.
Pubblicazione: (2025)

ChipExpert: The Open-Source Integrated-Circuit-Design-Specific Large Language Model
di: Xu, Ning, et al.
Pubblicazione: (2024)

On Faster Marginalization with Squared Circuits via Orthonormalization
di: Loconte, Lorenzo, et al.
Pubblicazione: (2024)

Enabling the Application of Graph Neural Networks on Graphs With Unknown Connectivity
di: Jorge García‐Carrasco, et al.
Pubblicazione: (2025)

Circuit Component Reuse Across Tasks in Transformer Language Models
di: Merullo, Jack, et al.
Pubblicazione: (2023)

Enhancing Large Language Models with Faster Code Preprocessing for Vulnerability Detection
di: Gonçalves, José, et al.
Pubblicazione: (2025)

Conda: Column-Normalized Adam for Training Large Language Models Faster
di: Wang, Junjie, et al.
Pubblicazione: (2025)

Extracting Interpretable Models from Tree Ensembles: Computational and Statistical Perspectives
di: Liu, Brian, et al.
Pubblicazione: (2025)

Extracting Spatiotemporal Data from Gradients with Large Language Models
di: Zheng, Lele, et al.
Pubblicazione: (2024)

Geospatial Mechanistic Interpretability of Large Language Models
di: De Sabbata, Stef, et al.
Pubblicazione: (2025)

Task-Circuit Quantization: Leveraging Knowledge Localization and Interpretability for Compression
di: Xiao, Hanqi, et al.
Pubblicazione: (2025)

$K$-MSHC: Unmasking Minimally Sufficient Head Circuits in Large Language Models with Experiments on Syntactic Classification Tasks
di: Chowdhary, Pratim, et al.
Pubblicazione: (2025)

LAMP: Extracting Local Decision Surfaces From Large Language Models
di: Chen, Ryan, et al.
Pubblicazione: (2025)

Unlock the Potential of Large Language Models for Predictive Tabular Tasks in Data Science with Table-Specific Pretraining
di: Yang, Yazheng, et al.
Pubblicazione: (2024)

Do as I do (Safely): Mitigating Task-Specific Fine-tuning Risks in Large Language Models
di: Eiras, Francisco, et al.
Pubblicazione: (2024)

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models
di: Liao, Xiaoxuan, et al.
Pubblicazione: (2025)

Interpreting Learned Feedback Patterns in Large Language Models
di: Marks, Luke, et al.
Pubblicazione: (2023)

Route Sparse Autoencoder to Interpret Large Language Models
di: Shi, Wei, et al.
Pubblicazione: (2025)

GeoLLM: Extracting Geospatial Knowledge from Large Language Models
di: Manvi, Rohin, et al.
Pubblicazione: (2023)

Domain Specific Benchmarks for Evaluating Multimodal Large Language Models
di: Anjum, Khizar, et al.
Pubblicazione: (2025)

Towards Interpretable Foundation Models of Robot Behavior: A Task Specific Policy Generation Approach
di: Sheidlower, Isaac, et al.
Pubblicazione: (2024)

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators
di: Chitty-Venkata, Krishna Teja, et al.
Pubblicazione: (2024)

Inference-Time Reward Hacking in Large Language Models
di: Khalaf, Hadi, et al.
Pubblicazione: (2025)

Sparser, Faster, Lighter Transformer Language Models
di: Cetin, Edoardo, et al.
Pubblicazione: (2026)