Size is Not the Solution: Deformable Convolutions for Effective Physics Aware Deep Learning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Beerman, Jack T., Roy, Shobhan, Udaykumar, H. S., Baek, Stephen S.
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911381891055616
author Beerman, Jack T.
Roy, Shobhan
Udaykumar, H. S.
Baek, Stephen S.
author_facet Beerman, Jack T.
Roy, Shobhan
Udaykumar, H. S.
Baek, Stephen S.
contents Physics-aware deep learning (PADL) enables rapid prediction of complex physical systems, yet current convolutional neural network (CNN) architectures struggle with highly nonlinear flows. While scaling model size addresses complexity in broader AI, this approach yields diminishing returns for physics modeling. Drawing inspiration from Hybrid Lagrangian-Eulerian (HLE) numerical methods, we introduce deformable physics-aware recurrent convolutions (D-PARC) to overcome the rigidity of CNNs. Across Burgers' equation, Navier-Stokes, and reactive flows, D-PARC achieves superior fidelity compared to substantially larger architectures. Analysis reveals that kernels display anti-clustering behavior, evolving into a learned "active filtration" strategy distinct from traditional h- or p-adaptivity. Effective receptive field analysis confirms that D-PARC autonomously concentrates resources in high-strain regions while coarsening focus elsewhere, mirroring adaptive refinement in computational mechanics. This demonstrates that physically intuitive architectural design can outperform parameter scaling, establishing that strategic learning in lean networks offers a more effective path forward for PADL than indiscriminate network expansion.
format Preprint
id arxiv_https___arxiv_org_abs_2601_11657
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Size is Not the Solution: Deformable Convolutions for Effective Physics Aware Deep Learning
Beerman, Jack T.
Roy, Shobhan
Udaykumar, H. S.
Baek, Stephen S.
Machine Learning
Artificial Intelligence
Physics-aware deep learning (PADL) enables rapid prediction of complex physical systems, yet current convolutional neural network (CNN) architectures struggle with highly nonlinear flows. While scaling model size addresses complexity in broader AI, this approach yields diminishing returns for physics modeling. Drawing inspiration from Hybrid Lagrangian-Eulerian (HLE) numerical methods, we introduce deformable physics-aware recurrent convolutions (D-PARC) to overcome the rigidity of CNNs. Across Burgers' equation, Navier-Stokes, and reactive flows, D-PARC achieves superior fidelity compared to substantially larger architectures. Analysis reveals that kernels display anti-clustering behavior, evolving into a learned "active filtration" strategy distinct from traditional h- or p-adaptivity. Effective receptive field analysis confirms that D-PARC autonomously concentrates resources in high-strain regions while coarsening focus elsewhere, mirroring adaptive refinement in computational mechanics. This demonstrates that physically intuitive architectural design can outperform parameter scaling, establishing that strategic learning in lean networks offers a more effective path forward for PADL than indiscriminate network expansion.
title Size is Not the Solution: Deformable Convolutions for Effective Physics Aware Deep Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2601.11657