Skip to main content
SAICA-KG

Papers

Trustworthy Agentic AI: Balancing Autonomy with Human Oversight

S. Atri · 2025 · International journal of computer science and mobile computing

Source →DOI: 10.47760/ijcsmc.2025.v14i11.013
failure-mode-taxonomyagentic-aisupervisionautonomy

TL;DR

Agentic AI systems increasingly plan, decide, and execute actions across tools and data sources with minimal supervision. To be deployable in safety- and compliance-sensitive environments, autonomy must be bounded by transparent decision making, predictable behavior, and recoverable failure modes.

Abstract

Agentic AI systems increasingly plan, decide, and execute actions across tools and data sources with minimal supervision. To be deployable in safety- and compliance-sensitive environments, autonomy must be bounded by transparent decision making, predictable behavior, and recoverable failure modes. This paper proposes a practical pattern for trustworthy agentic AI that integrates a policy gate, typed tools and effects, human-in-the-loop (HITL) controls, layered safety monitors, and rigorous verification via evidence logs. We align these choices with the NIST AI Risk Management Framework and its Generative AI Profile, ISO/IEC 42001 for AI management systems, and the staged implementation of the EU AI Act [1–6].

Editorial notes

Pattern paper proposing a trustworthy-agentic-AI architecture built from a policy gate, typed tools and effects, human-in-the-loop (HITL) controls, layered safety monitors, and evidence logs, aligned to NIST AI RMF, ISO/IEC 42001, and the EU AI Act. Light on empirical content but useful as a supervision-vocabulary anchor for SAICA-KG's ControlParadigm (policy gate, HITL) and TemporalPhase (real-time monitor vs. ex-post evidence log) partitions. Relates to SAICA-KG failure modes: scope_creep, security_vulnerability, incomplete_execution. Cite for the typed-effects framing when arguing that supervision must be explicit at the tool boundary.

View raw YAML on GitHub →