Fundamental Concepts of Sustainable Development of Artificial Intelligence Systems: Learning, Long-Term Memory, and Knowledge Structuring

Fuente: Zenodo
Enregistré dans:
Détails bibliographiques
Auteur principal: Sakovykh, Lev M.
Format: Recurso digital
Langue:anglais
Publié: Zenodo 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866901313931968512
author Sakovykh, Lev M.
author_facet Sakovykh, Lev M.
contents <p><span lang="EN-US">Recent advances in large language models (LLMs) and generative AI have demonstrated impressive capabilities across a wide range of tasks, achieving human-level performance on many academic and professional benchmarks. However, the current deep learning paradigm faces fundamental limitations that hinder the sustainable development of AI systems. These include enormous computational and environmental costs of training, the persistence of hallucinations, lack of interpretability, and catastrophic forgetting when models are sequentially updated.</span></p> <p><span lang="EN-US">This work analyzes three interconnected foundational concepts essential for building more robust and sustainable AI: knowledge acquisition (learning paradigms), knowledge retention (long-term memory and model stability), and knowledge organization (structure, logic, and interpretability). We provide a structured analysis of the strengths and limitations of existing approaches — from supervised, unsupervised, and reinforcement learning to continual learning techniques, Retrieval-Augmented Generation (RAG), knowledge graphs, Chain-of-Thought prompting, and neuro-symbolic architectures.</span></p> <p><span lang="EN-US">The analysis highlights that overcoming the limitations of today’s scaling-focused paradigm requires a shift toward hybrid systems that integrate neural learning with explicit, modular, and symbolically grounded knowledge representations. These findings suggest promising research directions, including the integration of RAG with knowledge graphs and the development of architectures with explicit knowledge structuring, which may form the basis for more adaptive, interpretable, and environmentally sustainable AI systems.</span></p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_19422635
institution Zenodo
language eng
publishDate 2026
publisher Zenodo
record_format zenodo
spellingShingle Fundamental Concepts of Sustainable Development of Artificial Intelligence Systems: Learning, Long-Term Memory, and Knowledge Structuring
Sakovykh, Lev M.
sustainable AI, continual learning, catastrophic forgetting, long-term memory, neuro-symbolic AI, knowledge representation, interpretability, large language models.
<p><span lang="EN-US">Recent advances in large language models (LLMs) and generative AI have demonstrated impressive capabilities across a wide range of tasks, achieving human-level performance on many academic and professional benchmarks. However, the current deep learning paradigm faces fundamental limitations that hinder the sustainable development of AI systems. These include enormous computational and environmental costs of training, the persistence of hallucinations, lack of interpretability, and catastrophic forgetting when models are sequentially updated.</span></p> <p><span lang="EN-US">This work analyzes three interconnected foundational concepts essential for building more robust and sustainable AI: knowledge acquisition (learning paradigms), knowledge retention (long-term memory and model stability), and knowledge organization (structure, logic, and interpretability). We provide a structured analysis of the strengths and limitations of existing approaches — from supervised, unsupervised, and reinforcement learning to continual learning techniques, Retrieval-Augmented Generation (RAG), knowledge graphs, Chain-of-Thought prompting, and neuro-symbolic architectures.</span></p> <p><span lang="EN-US">The analysis highlights that overcoming the limitations of today’s scaling-focused paradigm requires a shift toward hybrid systems that integrate neural learning with explicit, modular, and symbolically grounded knowledge representations. These findings suggest promising research directions, including the integration of RAG with knowledge graphs and the development of architectures with explicit knowledge structuring, which may form the basis for more adaptive, interpretable, and environmentally sustainable AI systems.</span></p>
title Fundamental Concepts of Sustainable Development of Artificial Intelligence Systems: Learning, Long-Term Memory, and Knowledge Structuring
topic sustainable AI, continual learning, catastrophic forgetting, long-term memory, neuro-symbolic AI, knowledge representation, interpretability, large language models.
url https://doi.org/10.5281/zenodo.19422635