Cover Image

Deep Learning with Pretrained 'Internal World' Layers: A Gemma 3-Based Modular Architecture for Wildfire Prediction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jadouli, Ayoub, Amrani, Chaker El
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Advanced Wildfire Prediction in Morocco: Developing a Deep Learning Dataset from Multisource Observations
by: Jadouli, Ayoub, et al.
Published: (2024)

Enhancing Wildfire Forecasting Through Multisource Spatio-Temporal Data, Deep Learning, Ensemble Models and Transfer Learning
by: Jadouli, Ayoub, et al.
Published: (2024)

Parallel Multi-path Feed Forward Neural Networks (PMFFNN) for Long Columnar Datasets: A Novel Approach to Complexity Reduction
by: Jadouli, Ayoub, et al.
Published: (2024)

Deep Autoencoders for Unsupervised Anomaly Detection in Wildfire Prediction
by: Üstek, İrem, et al.
Published: (2024)

A Survey of State Representation Learning for Deep Reinforcement Learning
by: Echchahed, Ayoub, et al.
Published: (2025)

Full-Parameter Continual Pretraining of Gemma2: Insights into Fluency and Domain Knowledge
by: Šliogeris, Vytenis, et al.
Published: (2025)

JaxWildfire: A GPU-Accelerated Wildfire Simulator for Reinforcement Learning
by: Çakır, Ufuk, et al.
Published: (2025)

Bridging Foundation Models and Efficient Architectures: A Modular Brain Imaging Framework with Local Masking and Pretrained Representation Learning
by: Wang, Yanwen, et al.
Published: (2025)

Advancing Wildfire Risk Prediction via Morphology-Aware Curriculum Contrastive Learning
by: Scudo, Fabrizio Lo, et al.
Published: (2025)

Causal Graph Neural Networks for Wildfire Danger Prediction
by: Zhao, Shan, et al.
Published: (2024)

Spectral Manifold Regularization for Stable and Modular Routing in Deep MoE Architectures
by: Delibasoglu, Ibrahim
Published: (2026)

Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2
by: Lieberum, Tom, et al.
Published: (2024)

Characterizing and Predicting Wildfire Evacuation Behavior: A Dual-Stage ML Approach
by: Polock, Sazzad Bin Bashar, et al.
Published: (2026)

Explainable Global Wildfire Prediction Models using Graph Neural Networks
by: Chen, Dayou, et al.
Published: (2024)

Does Your Wildfire Prediction Model Actually Work, or Just Score Well?
by: Xu, Yangshuang, et al.
Published: (2026)

Boosting Relational Deep Learning with Pretrained Tabular Models
by: Lachi, Veronica, et al.
Published: (2025)

Towards Empirical Interpretation of Internal Circuits and Properties in Grokked Transformers on Modular Polynomials
by: Furuta, Hiroki, et al.
Published: (2024)

Hydra: A Modular Architecture for Efficient Long-Context Reasoning
by: Chaudhary, Siddharth, et al.
Published: (2025)

Nested Learning: The Illusion of Deep Learning Architectures
by: Behrouz, Ali, et al.
Published: (2025)

Proof of Concept: Multi-Target Wildfire Risk Prediction and Large Language Model Synthesis
by: Caron, Nicolas, et al.
Published: (2026)

Predictive and Prescriptive AI toward Optimizing Wildfire Suppression
by: Boussioux, Leonard, et al.
Published: (2026)

Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretraining
by: Cheng, Jie, et al.
Published: (2024)

Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Tensorflow Pretrained Models
by: Chen, Keyu, et al.
Published: (2024)

Fair-FLIP: Fair Deepfake Detection with Fairness-Oriented Final Layer Input Prioritising
by: Szandala, Tomasz, et al.
Published: (2025)

TxGemma: Efficient and Agentic LLMs for Therapeutics
by: Wang, Eric, et al.
Published: (2025)

Engineering Verifiable Modularity in Transformers via Per-Layer Supervision
by: Kerce, J. Clayton
Published: (2026)

Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
by: Lee, Dongkwan, et al.
Published: (2025)

Modular Deep Learning for Multivariate Time-Series: Decoupling Imputation and Downstream Tasks
by: Raj, Joseph Arul, et al.
Published: (2024)

A Scalable Pretraining Framework for Link Prediction with Efficient Adaptation
by: Song, Yu, et al.
Published: (2025)

A Novel Multi-Task Teacher-Student Architecture with Self-Supervised Pretraining for 48-Hour Vasoactive-Inotropic Trend Analysis in Sepsis Mortality Prediction
by: Jin, Houji, et al.
Published: (2025)

Understanding Asynchronous Inference Methods for Vision-Language-Action Models
by: Agouzoul, Ayoub
Published: (2026)

Product Interaction: An Algebraic Formalism for Deep Learning Architectures
by: Dong, Haonan, et al.
Published: (2026)

The Importance of Architecture Choice in Deep Learning for Climate Applications
by: Dräger, Simon, et al.
Published: (2024)

On the Importance of Pretraining Data Alignment for Atomic Property Prediction
by: Ghunaim, Yasir, et al.
Published: (2025)

A Pretrained Probabilistic Transformer for City-Scale Traffic Volume Prediction
by: Shen, Shiyu, et al.
Published: (2025)

CALM: A CKA-Guided Adaptive Layer-Wise Modularization Framework for LLM Quantization
by: Zhang, Jinhao, et al.
Published: (2025)

Simulation Distillation: Pretraining World Models in Simulation for Rapid Real-World Adaptation
by: Levy, Jacob, et al.
Published: (2026)

LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels
by: Maes, Lucas, et al.
Published: (2026)

Model-Based Reinforcement Learning with Multi-Task Offline Pretraining
by: Pan, Minting, et al.
Published: (2023)

Beyond Multi-Token Prediction: Pretraining LLMs with Future Summaries
by: Mahajan, Divyat, et al.
Published: (2025)