Cover Image

What comes after transformers? -- A selective survey connecting ideas in deep learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Schneider, Johannes
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Memorization in deep learning: A survey
by: Wei, Jiaheng, et al.
Published: (2024)

Economic span selection of bridge based on deep reinforcement learning
by: Zhang, Leye, et al.
Published: (2024)

On the consistency of hyper-parameter selection in value-based deep reinforcement learning
by: Obando-Ceron, Johan, et al.
Published: (2024)

Geometric deep learning for galaxy-halo connection: a case study for galaxy intrinsic alignments
by: Jagvaral, Yesukhei, et al.
Published: (2024)

TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions
by: Cheng, Sibo, et al.
Published: (2024)

On the selection and effectiveness of pseudo-absences for species distribution modeling with deep learning
by: Zbinden, Robin, et al.
Published: (2024)

Designing a double deep reinforcement learning selection tool for resilient demand prediction
by: Benziane, Bilel Abderrahmane, et al.
Published: (2026)

Towards modeling evolving longitudinal health trajectories with a transformer-based deep learning model
by: Moen, Hans, et al.
Published: (2024)

Exploring the impact of traffic signal control and connected and automated vehicles on intersections safety: A deep reinforcement learning approach
by: Karbasi, Amir Hossein, et al.
Published: (2024)

What changes after deployment? A survey on On-device Learning in TinyML
by: Pavan, Massimo, et al.
Published: (2026)

What limits performance of weakly supervised deep learning for chest CT classification?
by: Tushar, Fakrul Islam, et al.
Published: (2024)

Autoregressive deep learning for real-time simulation of soft tissue dynamics during virtual neurosurgery
by: Greifeneder, Fabian, et al.
Published: (2026)

Multimodal deep learning approach to predicting neurological recovery from coma after cardiac arrest
by: Krones, Felix H., et al.
Published: (2024)

Transfer learning with affine model transformation
by: Minami, Shunya, et al.
Published: (2022)

Topic Modeling with Fine-tuning LLMs and Bag of Sentences
by: Schneider, Johannes
Published: (2024)

Improving Next Tokens via Second-to-Last Predictions with Generate and Refine
by: Schneider, Johannes
Published: (2024)

Efficient and Flexible Topic Modeling using Pretrained Embeddings and Bag of Sentences
by: Schneider, Johannes
Published: (2023)

Focus on Likely Classes for Test-Time Prediction
by: Schneider, Johannes
Published: (2025)

Dynamic layer selection in decoder-only transformers
by: Glavas, Theodore, et al.
Published: (2024)

An overview of condensation phenomenon in deep learning
by: Xu, Zhi-Qin John, et al.
Published: (2025)

A transformer-based deep reinforcement learning approach to spatial navigation in a partially observable Morris Water Maze
by: Eggen, Marte, et al.
Published: (2024)

Automated data processing and feature engineering for deep learning and big data applications: a survey
by: Mumuni, Alhassan, et al.
Published: (2024)

Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models
by: Testolin, Alberto
Published: (2023)

Transduce: learning transduction grammars for string transformation
by: Frydman, Francis, et al.
Published: (2023)

A general framework for deep learning
by: Kengne, William, et al.
Published: (2025)

Aspects of importance sampling in parameter selection for neural networks using ridgelet transform
by: Homma, Hikaru, et al.
Published: (2024)

Generalized Bayesian deep reinforcement learning
by: Roy, Shreya Sinha, et al.
Published: (2024)

A Survey of Deep Learning: From Activations to Transformers
by: Schneider, Johannes, et al.
Published: (2023)

Survival modeling using deep learning, machine learning and statistical methods: A comparative analysis for predicting mortality after hospital admission
by: Wang, Ziwen, et al.
Published: (2024)

Automating aggregation strategy selection in federated learning
by: Pang, Dian S. Y., et al.
Published: (2026)

Mathematical theory of deep learning
by: Petersen, Philipp, et al.
Published: (2024)

Statistically guided deep learning
by: Kohler, Michael, et al.
Published: (2025)

A deep reinforcement learning platform for antibiotic discovery
by: Cao, Hanqun, et al.
Published: (2025)

A survey and taxonomy of loss functions in machine learning
by: Ciampiconi, Lorenzo, et al.
Published: (2023)

State of the art applications of deep learning within tracking and detecting marine debris: A survey
by: Moorton, Zoe, et al.
Published: (2024)

What can we learn from signals and systems in a transformer? Insights for probabilistic modeling and inference architecture
by: Chang, Heng-Sheng, et al.
Published: (2025)

An invariance constrained deep learning network for PDE discovery
by: Chen, Chao, et al.
Published: (2024)

Continuous latent representations for modeling precipitation with deep learning
by: Radhakrishnan, Gokul, et al.
Published: (2024)

Schrödinger bridge based deep conditional generative learning
by: Huang, Hanwen
Published: (2024)

Dragonfly: a modular deep reinforcement learning library
by: Viquerat, Jonathan, et al.
Published: (2025)