Image de couverture de livre

Testing the spin-bath view of self-attention: A Hamiltonian analysis of GPT-2 Transformer

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Bhattacharjee, Satadeep, Lee, Seung-Cheol
Format:	Preprint
Publié:	2025
Sujets:	Materials Science Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Magnetization dynamics in skyrmions due to high-speed carrier injections from Dirac half-metals
par: Bhattacharjee, Satadeep, et autres
Publié: (2024)

Periodic Materials Generation using Text-Guided Joint Diffusion Model
par: Das, Kishalay, et autres
Publié: (2025)

LLM Meets Diffusion: A Hybrid Framework for Crystal Material Generation
par: Khastagir, Subhojyoti, et autres
Publié: (2025)

Filtered Spectral Projection for Quantum Principal Component Analysis
par: Hossain, Sk Mujaffar, et autres
Publié: (2026)

Customizing PBE Exchange-Correlation functionals: A comprehensive approach for band gap prediction in diverse semiconductors
par: Bhattacharjee, Satadeep, et autres
Publié: (2023)

A Hybrid Machine Learning Framework for Predicting Hydrogen Storage Capacities in Metal Hydrides: Unsupervised Feature Learning with Deep Neural Networks
par: Bhattacharjee, Satadeep, et autres
Publié: (2024)

Quantum Simulations of Battery Electrolytes with VQE-qEOM and SQD: Active-Space Design, Dissociation, and Excited States of LiPF$_6$, NaPF$_6$, and FSI Salts
par: Hossain, Sk Mujaffar, et autres
Publié: (2025)

Tuning the Electronic and Magnetic Properties of Double Transition Metal MCrCT$_2$ (M = Ti, Mo) Janus MXenes for Enhanced Spintronics and Nanoelectronics
par: Ram, Swetarekha, et autres
Publié: (2024)

Tunable Thermal Expansion in Functionalized 2D Boron Nitride: A First-Principles Investigation
par: Hossain, Sk Mujaffar, et autres
Publié: (2025)

Controlling Moisture for Enhanced Ozone Decomposition: A Study of Water Effects on CeO$_2$ Surfaces and Catalytic Activity
par: Gupta, Suchitra, et autres
Publié: (2024)

Role of Oxygen during Methane Oxidation on Pd$_1$/PdO$_1$@CeO$_2$ Surface: A Combined Density Functional Theory, Microkinetic, and Machine Learning Approach
par: Tomar, Shalini, et autres
Publié: (2025)

Origin of unexpected weak Gilbert damping in the LSMO/Pt bilayer system
par: Das, Pritam, et autres
Publié: (2024)

SR-CGCNN: Shared Recurrent Convolution in Crystal Graph Neural Networks for Materials Property Prediction
par: Bhattacharjee, Satadeep
Publié: (2026)

Calculation of Gilbert damping and magnetic moment of inertia using torque-torque correlation model within ab initio Wannier framework
par: Bajaj, Robin, et autres
Publié: (2024)

Multi-site mixing and entropy stabilization of CsPbI$_{3}$ with potential application in photovoltaics
par: Koshi, Namitha Anna, et autres
Publié: (2025)

Mechanistic Insights into Complete Methane Oxidation on Single-Atom Pd Supported by SSZ-13 Zeolite: A First-Principles Study
par: Behatha, Anuroopa, et autres
Publié: (2025)

Integrating Density Functional Theory with Deep Neural Networks for Accurate Voltage Prediction in Alkali-Metal-Ion Battery Materials
par: Hossain, Sk Mujaffar, et autres
Publié: (2025)

Enhancement of spin Hall angle by an order of magnitude via Cu intercalation in MoS$_2$/CoFeB heterostructures
par: Mishra, Abhisek, et autres
Publié: (2024)

A self-driving lab for solution-processed electrochromic thin films
par: Dahms, Selma, et autres
Publié: (2025)

Universal crystal material property prediction via multi-view geometric fusion in graph transformers
par: Zhang, Liang, et autres
Publié: (2025)

E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Products
par: Li, Yunyang, et autres
Publié: (2025)

Establishing Deep InfoMax as an effective self-supervised learning methodology in materials informatics
par: Moran, Michael, et autres
Publié: (2024)

Predicting Atomistic Transitions with Transformers
par: Tischler, Henry, et autres
Publié: (2026)

POINT$^{2}$: A Polymer Informatics Training and Testing Database
par: Xu, Jiaxin, et autres
Publié: (2025)

AQCat25: Unlocking spin-aware, high-fidelity machine learning potentials for heterogeneous catalysis
par: Allam, Omar, et autres
Publié: (2025)

MicroLad: 2D-to-3D Microstructure Reconstruction and Generation via Latent Diffusion and Score Distillation
par: Lee, Kang-Hyun, et autres
Publié: (2025)

A recipe for scalable attention-based MLIPs: unlocking long-range accuracy with all-to-all node attention
par: Qu, Eric, et autres
Publié: (2026)

Quotient Complex Transformer (QCformer) for Perovskite Data Analysis
par: You, Xinyu, et autres
Publié: (2025)

Complete and Efficient Graph Transformers for Crystal Material Property Prediction
par: Yan, Keqiang, et autres
Publié: (2024)

Synthesizability Prediction of Crystalline Structures with a Hierarchical Transformer and Uncertainty Quantification
par: Ebrahimzadeh, Danial, et autres
Publié: (2025)

Generative Inverse Design of Crystal Structures via Diffusion Models with Transformers
par: Takahara, Izumi, et autres
Publié: (2024)

Graph Transformer Networks for Accurate Band Structure Prediction: An End-to-End Approach
par: Gong, Weiyi, et autres
Publié: (2024)

Advancing atomic electron tomography with neural networks
par: Lee, Juhyeok, et autres
Publié: (2025)

Accurate predictive model of band gap with selected important features based on explainable machine learning
par: Lee, Joohwi, et autres
Publié: (2025)

Physics-based reward driven image analysis in microscopy
par: Barakati, Kamyar, et autres
Publié: (2024)

First-principles study of bulk stacking, $J_{\rm eff}$ picture, magnetic Hamiltonian, $g$ factors, and structural distortions of $α$-RuCl$_3$
par: Hong, Seung-Ju, et autres
Publié: (2026)

Local Symmetry Breaking in Skyrmion-Hosting Centrosymmetric Hexagonal Compounds
par: Singh, Anupam K., et autres
Publié: (2024)

Towards Harmonization of SO(3)-Equivariance and Expressiveness: a Hybrid Deep Learning Framework for Electronic-Structure Hamiltonian Prediction
par: Yin, Shi, et autres
Publié: (2024)

Machine learning enhanced atom probe tomography analysis: a snapshot review
par: Li, Yue, et autres
Publié: (2025)

TraceGrad: a Framework Learning Expressive SO(3)-equivariant Non-linear Representations for Electronic-Structure Hamiltonian Prediction
par: Yin, Shi, et autres
Publié: (2024)