Cover Image

From Correlation to Cause: A Five-Stage Methodology for Feature Analysis in Transformer Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Munigety, Caleb
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Silent Signals to Natural Language: A Dual-Stage Transformer-LLM Approach
by: Sivasubramaniam, Nithyashree
Published: (2025)

Sycophancy in Large Language Models: Causes and Mitigations
by: Malmqvist, Lars
Published: (2024)

The Dark Patterns of Personalized Persuasion in Large Language Models: Exposing Persuasive Linguistic Features for Big Five Personality Traits in LLMs Responses
by: Mieleszczenko-Kowszewicz, Wiktoria, et al.
Published: (2024)

Advanced Unstructured Data Processing for ESG Reports: A Methodology for Structured Transformation and Enhanced Analysis
by: Peng, Jiahui, et al.
Published: (2024)

From Text to Transformation: A Comprehensive Review of Large Language Models' Versatility
by: Kaur, Pravneet, et al.
Published: (2024)

Disentangling Feature Structure: A Mathematically Provable Two-Stage Training Dynamics in Transformers
by: Gong, Zixuan, et al.
Published: (2025)

A Two-Stage Architecture for NDA Analysis: LLM-based Segmentation and Transformer-based Clause Classification
by: Begnini, Ana, et al.
Published: (2026)

Which Programming Language and What Features at Pre-training Stage Affect Downstream Logical Inference Performance?
by: Uchiyama, Fumiya, et al.
Published: (2024)

Cause and Effect: Can Large Language Models Truly Understand Causality?
by: Ashwani, Swagata, et al.
Published: (2024)

Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparison
by: Jeong, Jihoon
Published: (2026)

PRISM: A Methodology for Auditing Biases in Large Language Models
by: Azzopardi, Leif, et al.
Published: (2024)

Causal Language Control in Multilingual Transformers via Sparse Feature Steering
by: Chou, Cheng-Ting, et al.
Published: (2025)

Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer
by: Kahana, Adar, et al.
Published: (2024)

Methodology of Adapting Large English Language Models for Specific Cultural Contexts
by: Zhang, Wenjing, et al.
Published: (2024)

Predicting the Big Five Personality Traits in Chinese Counselling Dialogues Using Large Language Models
by: Yan, Yang, et al.
Published: (2024)

Arabic Dialect Classification using RNNs, Transformers, and Large Language Models: A Comparative Analysis
by: Essameldin, Omar A., et al.
Published: (2025)

A Multi-Stage Workflow for the Review of Marketing Content with Reasoning Large Language Models
by: Purpura, Alberto, et al.
Published: (2025)

Classifying Cancer Stage with Open-Source Clinical Large Language Models
by: Chang, Chia-Hsuan, et al.
Published: (2024)

Decoding Emergent Big Five Traits in Large Language Models: Temperature-Dependent Expression and Architectural Clustering
by: Zacharopoulos, Christos-Nikolaos, et al.
Published: (2025)

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology
by: Kim, Minsang, et al.
Published: (2024)

Assessing Robustness to Spurious Correlations in Post-Training Language Models
by: Shuieh, Julia, et al.
Published: (2025)

A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations
by: Wang, Jinqiang, et al.
Published: (2024)

Probing Ethical Framework Representations in Large Language Models: Structure, Entanglement, and Methodological Challenges
by: Xu, Weilun, et al.
Published: (2026)

Multiple-Choice Question Generation Using Large Language Models: Methodology and Educator Insights
by: Biancini, Giorgio, et al.
Published: (2025)

GRAMMAR: Grounded and Modular Methodology for Assessment of Closed-Domain Retrieval-Augmented Language Model
by: Li, Xinzhe, et al.
Published: (2024)

Word Meanings in Transformer Language Models
by: Grindrod, Jumbly, et al.
Published: (2025)

LLM-Augmented Knowledge Base Construction For Root Cause Analysis
by: Tran, Nguyen Phuc, et al.
Published: (2026)

Applications of Large Language Model Reasoning in Feature Generation
by: Chandra, Dharani
Published: (2025)

Explore Spurious Correlations at the Concept Level in Language Models for Text Classification
by: Zhou, Yuhang, et al.
Published: (2023)

A Multi-Stage Large Language Model Framework for Extracting Suicide-Related Social Determinants of Health
by: Wang, Song, et al.
Published: (2025)

Critique-RL: Training Language Models for Critiquing through Two-Stage Reinforcement Learning
by: Xi, Zhiheng, et al.
Published: (2025)

Scatter-Based Innovation Propagation in Large Language Models for Multi-Stage Process Adaptation
by: Su, Hong
Published: (2025)

Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models
by: Zhao, Yida, et al.
Published: (2024)

A Systematic Study of Compositional Syntactic Transformer Language Models
by: Zhao, Yida, et al.
Published: (2025)

Intra-Layer Recurrence in Transformers for Language Modeling
by: Nguyen, Anthony, et al.
Published: (2025)

Inconsistent Tokenizations Cause Language Models to be Perplexed by Japanese Grammar
by: Gambardella, Andrew, et al.
Published: (2025)

Empathetic Cascading Networks: A Multi-Stage Prompting Technique for Reducing Social Biases in Large Language Models
by: Xin, Wangjiaxuan
Published: (2025)

A Two-Stage Proactive Dialogue Generator for Efficient Clinical Information Collection Using Large Language Model
by: Li, Xueshen, et al.
Published: (2024)

Shared Emotion Geometry Across Small Language Models: A Cross-Architecture Study of Representation, Behavior, and Methodological Confounds
by: Jeong, Jihoon
Published: (2026)

Synthetic Feature Augmentation Improves Generalization Performance of Language Models
by: Choudhary, Ashok, et al.
Published: (2025)