Cover Image

An AI System Evaluation Framework for Advancing AI Safety: Terminology, Taxonomy, Lifecycle Mapping

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xia, Boming, Lu, Qinghua, Zhu, Liming, Xing, Zhenchang
Format:	Preprint
Published:	2024
Subjects:	Software Engineering Artificial Intelligence Computers and Society Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Privacy and Copyright Protection in Generative AI: A Lifecycle Perspective
by: Zhang, Dawen, et al.
Published: (2023)

Evaluation-Driven Development and Operations of LLM Agents: A Process Model and Reference Architecture
by: Xia, Boming, et al.
Published: (2024)

A Taxonomy of Foundation Model based Systems through the Lens of Software Architecture
by: Lu, Qinghua, et al.
Published: (2023)

Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agents
by: Shamsujjoha, Md, et al.
Published: (2024)

Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents
by: Lu, Qinghua, et al.
Published: (2023)

Towards a Responsible AI Metrics Catalogue: A Collection of Metrics for AI Accountability
by: Xia, Boming, et al.
Published: (2023)

A Taxonomy of Architecture Options for Foundation Model-based Agents: Analysis and Decision Model
by: Zhou, Jingwen, et al.
Published: (2024)

Uncertainty Propagation in LLM-Based Systems
by: Xia, Boming, et al.
Published: (2026)

NeurIPS Should Require Reproducibility Standards for Frontier AI Safety Claims
by: Vishwarupe, Varad, et al.
Published: (2026)

A Reference Architecture for Designing Foundation Model based Systems
by: Lu, Qinghua, et al.
Published: (2023)

Standardization Trends on Safety and Trustworthiness Technology for Advanced AI
by: Jeon, Jonghong
Published: (2024)

A Conceptual Framework for Ethical Evaluation of Machine Learning Systems
by: Gupta, Neha R., et al.
Published: (2024)

Rethinking Technological Readiness in the Era of AI Uncertainty
by: Browne, S. Tucker, et al.
Published: (2025)

Trust in Software Supply Chains: Blockchain-Enabled SBOM and the AIBOM Future
by: Xia, Boming, et al.
Published: (2023)

Decentralised Governance-Driven Architecture for Designing Foundation Model based Systems: Exploring the Role of Blockchain in Responsible AI
by: Liu, Yue, et al.
Published: (2023)

Green AI in Action: Strategic Model Selection for Ensembles in Production
by: Nijkamp, Nienke, et al.
Published: (2024)

Legal Aspects for Software Developers Interested in Generative AI Applications
by: Herbold, Steffen, et al.
Published: (2024)

Leveraging Generative AI for Enhancing Automated Assessment in Programming Education Contests
by: Dascalescu, Stefan, et al.
Published: (2025)

Permissive-Washing in the Open AI Supply Chain: A Large-Scale Audit of License Integrity
by: Jewitt, James, et al.
Published: (2026)

DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systems
by: Seedat, Nabeel, et al.
Published: (2022)

Optimizing Travel Itineraries with AI Algorithms in a Microservices Architecture: Balancing Cost, Time, Preferences, and Sustainability
by: Barua, Biman, et al.
Published: (2024)

Are ChatGPT and Other Similar Systems the Modern Lernaean Hydras of AI?
by: Ioannidis, Dimitrios, et al.
Published: (2023)

Towards Equitable Agile Research and Development of AI and Robotics
by: Hundt, Andrew, et al.
Published: (2024)

Still Manual? Automated Linter Configuration via DSL-Based LLM Compilation of Coding Standards
by: Zhang, Zejun, et al.
Published: (2026)

Towards Advancing Code Generation with Large Language Models: A Research Roadmap
by: Jin, Haolin, et al.
Published: (2025)

To Be Forgotten or To Be Fair: Unveiling Fairness Implications of Machine Unlearning Methods
by: Zhang, Dawen, et al.
Published: (2023)

Consolidating TinyML Lifecycle with Large Language Models: Reality, Illusion, or Opportunity?
by: Wu, Guanghan, et al.
Published: (2025)

Blockchain-Enabled Accountability in Data Supply Chain: A Data Bill of Materials Approach
by: Liu, Yue, et al.
Published: (2024)

The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligence
by: White, Matt, et al.
Published: (2024)

Advancing Software Security and Reliability in Cloud Platforms through AI-based Anomaly Detection
by: Saleh, Sabbir M., et al.
Published: (2024)

Explainable Artificial Intelligence Techniques for Software Development Lifecycle: A Phase-specific Survey
by: Arora, Lakshit, et al.
Published: (2025)

The Impact of Environment Configurations on the Stability of AI-Enabled Systems
by: Rahman, Musfiqur, et al.
Published: (2024)

SETA: Statistical Fault Attribution for Compound AI Systems
by: Chowdhury, Sayak, et al.
Published: (2026)

Operationalising Artificial Intelligence Bills of Materials (AIBOMs) for Verifiable AI Provenance and Lifecycle Assurance
by: Radanliev, Petar, et al.
Published: (2026)

Code Reborn AI-Driven Legacy Systems Modernization from COBOL to Java
by: Bandarupalli, Gopichand
Published: (2025)

VibeTensor: System Software for Deep Learning, Fully Generated by AI Agents
by: Xu, Bing, et al.
Published: (2026)

What's documented in AI? Systematic Analysis of 32K AI Model Cards
by: Liang, Weixin, et al.
Published: (2024)

AIPC: Agent-Based Automation for AI Model Deployment with Qualcomm AI Runtime
by: Su, Jianhao, et al.
Published: (2026)

A Cartography of Open Collaboration in Open Source AI: Mapping Practices, Motivations, and Governance in 14 Open Large Language Model Projects
by: Linåker, Johan, et al.
Published: (2025)

Predicting Open Source Software Sustainability with Deep Temporal Neural Hierarchical Architectures and Explainable AI
by: Karim, S M Rakib Ul, et al.
Published: (2026)