⚠ Official Notice: www.ijisrt.com is the official website of the International Journal of Innovative Science and Research Technology (IJISRT) Journal for research paper submission and publication. Please beware of fake or duplicate websites using the IJISRT name.



Human-in-the-Loop Control for High-Risk Legal Agents


Authors : Shatrunjay Kumar Singh

Volume/Issue : Volume 11 - 2026, Issue 8 - August


Google Scholar : https://tinyurl.com/4frv4s6m

DOI : https://doi.org/10.38124/ijisrt/26aug422

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.


Abstract : Agentic artificial intelligence can decompose legal objectives, retrieve authorities, invoke external tools, draft documents, communicate with stakeholders, and execute multi-step workflows. In high-risk legal settings, a final approval click is not an adequate control: errors can propagate across a trajectory, evidence can be withheld from the reviewer, confidential data can cross an unauthorized boundary, and a human may be asked to approve an artifact that no longer matches the version later executed. This paper proposes Human-in-the-Loop Control for Legal Agents (HILC-Legal), a riskadaptive governance architecture that separates language generation from authorization and separates authorization from execution. The architecture combines hard policy constraints, a calibrated action-risk score, evidence packets, competenceaware reviewer routing, version-bound authorization tokens, a least-privilege execution broker, provenance logging, and post-action monitoring. We define six control invariants for legally consequential agent behavior and a four-tier oversight policy ranging from bounded read-only assistance to human-in-command decision making. We also specify an evaluation protocol covering unsafe action escape, authority and evidence fidelity, confidentiality preservation, approval-version consistency, reviewer correction yield, automation bias, workload, calibration, and recovery. The proposal is a design and evaluation framework; it does not claim deployment results. Its central argument is that meaningful human oversight is an engineered control property - requiring information, competence, authority, time, and effective intervention mechanisms - rather than the mere presence of a person in a workflow.

Keywords : Human-in-the-Loop, Legal Agents, Agentic AI, High-Risk Legal Work, Human Oversight, Legal Ethics, Risk-Adaptive Control, Auditability, Privilege, Authorization.

References :

  1. American Bar Association Standing Committee on Ethics and Professional Responsibility. (2024). Formal Opinion 512:  Generative Artificial Intelligence Tools.
  2. Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for Human-AI Interaction. Proceedings of the 2019 CHI  Conference on Human Factors in Computing Systems, 1-13.
  3. Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mane, D. (2016). Concrete Problems in AI Safety.  arXiv:1606.06565.
  4. Autio, C., Schwartz, R., Dunietz, J., Jain, S., Stanley, M., Tabassi, E., Hall, P., & Roberts, K. (2024). Artificial  Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. NIST AI 600-1. Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2021). Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance. Proceedings of the 2021 CHI  Conference on Human Factors in Computing Systems, 1-16.
  5. Chiodo, M., Muller, D., Siewert, P., Wetherall, J.-L., Yasmine, Z., & Burden, J. (2025). Formalising Human-in-the-Loop:  Computational Reductions, Failure Modes, and Legal-Moral Responsibility. arXiv:2505.10426. European Parliament and Council of the European Union. (2024). Regulation (EU) 2024/1689 laying down harmonised  rules on artificial intelligence (Artificial Intelligence Act), Article 14.
  6. Guha, N., Nyarko, J., Ho, D. E., Re, C., Chilton, A., Narayana, A., Chohlas-Wood, A., Peters, A., Waldon, B., Rockmore,  D. N., et al. (2023). LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large  Language Models. Advances in Neural Information Processing Systems, 36.
  7. Magesh, V., Surani, F., Dahl, M., Suzgun, M., Manning, C. D., & Ho, D. E. (2025). Hallucination-Free? Assessing the  Reliability of Leading AI Legal Research Tools. Journal of Empirical Legal Studies, 22, 216-242. Nannini, L., Smith, A. L., Maggini, M. J., Panai, E., Feliciano, S., Tiulkanov, A., Maran, E., Gealy, J., & Bisconti, P.  (2026). AI Agents Under EU Law. arXiv:2604.04604.
  8. Nguyen, H. T., Fungwacharakorn, W., Wehnert, S., Zin, M. M., Kong, Y., Xue, J., Araszkiewicz, M., Goebel, R., &  Satoh, K. (2026). GDPR Auto-Formalization with AI Agents and Human Verification. arXiv:2604.14607. Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000). A Model for Types and Levels of Human Interaction with  Automation. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 30(3), 286-297. Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P.  (2020). Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing.  Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 33-44.
  9. Sinha, A., Ranganathan, S., Dharmaratnakar, A., & Das, D. (2026). Human-on-the-Loop Orchestration for AI-Assisted  Legal Discovery. arXiv:2606.19812.
  10. Tabassi, E. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1.

Agentic artificial intelligence can decompose legal objectives, retrieve authorities, invoke external tools, draft documents, communicate with stakeholders, and execute multi-step workflows. In high-risk legal settings, a final approval click is not an adequate control: errors can propagate across a trajectory, evidence can be withheld from the reviewer, confidential data can cross an unauthorized boundary, and a human may be asked to approve an artifact that no longer matches the version later executed. This paper proposes Human-in-the-Loop Control for Legal Agents (HILC-Legal), a riskadaptive governance architecture that separates language generation from authorization and separates authorization from execution. The architecture combines hard policy constraints, a calibrated action-risk score, evidence packets, competenceaware reviewer routing, version-bound authorization tokens, a least-privilege execution broker, provenance logging, and post-action monitoring. We define six control invariants for legally consequential agent behavior and a four-tier oversight policy ranging from bounded read-only assistance to human-in-command decision making. We also specify an evaluation protocol covering unsafe action escape, authority and evidence fidelity, confidentiality preservation, approval-version consistency, reviewer correction yield, automation bias, workload, calibration, and recovery. The proposal is a design and evaluation framework; it does not claim deployment results. Its central argument is that meaningful human oversight is an engineered control property - requiring information, competence, authority, time, and effective intervention mechanisms - rather than the mere presence of a person in a workflow.

Keywords : Human-in-the-Loop, Legal Agents, Agentic AI, High-Risk Legal Work, Human Oversight, Legal Ethics, Risk-Adaptive Control, Auditability, Privilege, Authorization.

Paper Submission Last Date
31 - October - 2026

SUBMIT YOUR PAPER CALL FOR PAPERS
Video Explanation for Published paper

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe