Authors :
Shatrunjay Kumar Singh
Volume/Issue :
Volume 11 - 2026, Issue 8 - August
Google Scholar :
https://tinyurl.com/4frv4s6m
DOI :
https://doi.org/10.38124/ijisrt/26aug422
Note : A published paper may take 4-5
working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and
ResearchGate.
Abstract :
Agentic artificial intelligence can decompose legal objectives, retrieve authorities, invoke external tools, draft documents, communicate with stakeholders, and execute multi-step workflows. In high-risk legal settings, a final approval click is not an adequate control: errors can propagate across a trajectory, evidence can be withheld from the reviewer, confidential data can cross an unauthorized boundary, and a human may be asked to approve an artifact that no longer matches the version later executed. This paper proposes Human-in-the-Loop Control for Legal Agents (HILC-Legal), a riskadaptive governance architecture that separates language generation from authorization and separates authorization from execution. The architecture combines hard policy constraints, a calibrated action-risk score, evidence packets, competenceaware reviewer routing, version-bound authorization tokens, a least-privilege execution broker, provenance logging, and post-action monitoring. We define six control invariants for legally consequential agent behavior and a four-tier oversight policy ranging from bounded read-only assistance to human-in-command decision making. We also specify an evaluation protocol covering unsafe action escape, authority and evidence fidelity, confidentiality preservation, approval-version consistency, reviewer correction yield, automation bias, workload, calibration, and recovery. The proposal is a design and evaluation framework; it does not claim deployment results. Its central argument is that meaningful human oversight is an engineered control property - requiring information, competence, authority, time, and effective intervention mechanisms - rather than the mere presence of a person in a workflow.
Keywords :
Human-in-the-Loop, Legal Agents, Agentic AI, High-Risk Legal Work, Human Oversight, Legal Ethics, Risk-Adaptive Control, Auditability, Privilege, Authorization.
References :
- American Bar Association Standing Committee on Ethics and Professional Responsibility. (2024). Formal Opinion 512: Generative Artificial Intelligence Tools.
- Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for Human-AI Interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1-13.
- Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mane, D. (2016). Concrete Problems in AI Safety. arXiv:1606.06565.
- Autio, C., Schwartz, R., Dunietz, J., Jain, S., Stanley, M., Tabassi, E., Hall, P., & Roberts, K. (2024). Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. NIST AI 600-1. Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2021). Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1-16.
- Chiodo, M., Muller, D., Siewert, P., Wetherall, J.-L., Yasmine, Z., & Burden, J. (2025). Formalising Human-in-the-Loop: Computational Reductions, Failure Modes, and Legal-Moral Responsibility. arXiv:2505.10426. European Parliament and Council of the European Union. (2024). Regulation (EU) 2024/1689 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act), Article 14.
- Guha, N., Nyarko, J., Ho, D. E., Re, C., Chilton, A., Narayana, A., Chohlas-Wood, A., Peters, A., Waldon, B., Rockmore, D. N., et al. (2023). LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models. Advances in Neural Information Processing Systems, 36.
- Magesh, V., Surani, F., Dahl, M., Suzgun, M., Manning, C. D., & Ho, D. E. (2025). Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools. Journal of Empirical Legal Studies, 22, 216-242. Nannini, L., Smith, A. L., Maggini, M. J., Panai, E., Feliciano, S., Tiulkanov, A., Maran, E., Gealy, J., & Bisconti, P. (2026). AI Agents Under EU Law. arXiv:2604.04604.
- Nguyen, H. T., Fungwacharakorn, W., Wehnert, S., Zin, M. M., Kong, Y., Xue, J., Araszkiewicz, M., Goebel, R., & Satoh, K. (2026). GDPR Auto-Formalization with AI Agents and Human Verification. arXiv:2604.14607. Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000). A Model for Types and Levels of Human Interaction with Automation. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 30(3), 286-297. Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020). Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 33-44.
- Sinha, A., Ranganathan, S., Dharmaratnakar, A., & Das, D. (2026). Human-on-the-Loop Orchestration for AI-Assisted Legal Discovery. arXiv:2606.19812.
- Tabassi, E. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1.
Agentic artificial intelligence can decompose legal objectives, retrieve authorities, invoke external tools, draft documents, communicate with stakeholders, and execute multi-step workflows. In high-risk legal settings, a final approval click is not an adequate control: errors can propagate across a trajectory, evidence can be withheld from the reviewer, confidential data can cross an unauthorized boundary, and a human may be asked to approve an artifact that no longer matches the version later executed. This paper proposes Human-in-the-Loop Control for Legal Agents (HILC-Legal), a riskadaptive governance architecture that separates language generation from authorization and separates authorization from execution. The architecture combines hard policy constraints, a calibrated action-risk score, evidence packets, competenceaware reviewer routing, version-bound authorization tokens, a least-privilege execution broker, provenance logging, and post-action monitoring. We define six control invariants for legally consequential agent behavior and a four-tier oversight policy ranging from bounded read-only assistance to human-in-command decision making. We also specify an evaluation protocol covering unsafe action escape, authority and evidence fidelity, confidentiality preservation, approval-version consistency, reviewer correction yield, automation bias, workload, calibration, and recovery. The proposal is a design and evaluation framework; it does not claim deployment results. Its central argument is that meaningful human oversight is an engineered control property - requiring information, competence, authority, time, and effective intervention mechanisms - rather than the mere presence of a person in a workflow.
Keywords :
Human-in-the-Loop, Legal Agents, Agentic AI, High-Risk Legal Work, Human Oversight, Legal Ethics, Risk-Adaptive Control, Auditability, Privilege, Authorization.