⚠ Official Notice: www.ijisrt.com is the official website of the International Journal of Innovative Science and Research Technology (IJISRT) Journal for research paper submission and publication. Please beware of fake or duplicate websites using the IJISRT name.



An LLM-Augmented Multi-Modal Forensic Reasoning Framework for Detecting Tampered and AI-Generated Digital Images and Digital Documents


Authors : K. Karthika M. E.; Sriram K.; Venkatesh R.; Vignesh T.; Vel Murugan M.

Volume/Issue : Volume 11 - 2026, Issue 11 - November


Google Scholar : https://tinyurl.com/2fnj3er4

DOI : https://doi.org/10.38124/ijisrt/26nov686

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.


Abstract : Tampering detection of images, and of AI-generated (GAN/diffusion-synthesized) images in particular, and forensic inconsistencies of PDF, OOXML, and legacy binary documents are important issues related to the evaluation of integrity, authenticity and trustworthiness of digital evidence. Traditional single-signal detectors provide a label lacking interpretable evidence trail and thus are useless when justification of the verdict is needed. This paper introduces a desktop forensic analysis software called ForensiX AI that performs analysis of image and document forensics.

Keywords : Digital Image Forensics, Document Forensics, Tampered Image Detection, AI-Generated Image Detection, PDF/OOXML Forensics, Convolutional Neural Networks, Large Language Models, Consensus Reasoning, Explainable AI.

References :

    1. N. Krawetz, "A Picture's Worth: Digital Image Analysis and Forensics," Black Hat Briefings USA, 2007.
    2. J. Lukáš, J. Fridrich, and M. Goljan, "Digital Camera Identification from Sensor Pattern Noise," IEEE Trans. Inf. Forensics Security, vol. 1, no. 2, pp. 205–214, 2006.
    3. J. Frank, T. Eisenhofer, L. Schönherr, A. Fischer, D. Kolossa, and T. Holz, "Leveraging Frequency Analysis for Deep Fake Image Recognition," in Proc. ICML, 2020, pp. 3247–3258.
    4. J. Dong, W. Wang, and T. Tan, "CASIA Image Tampering Detection Evaluation Database," in Proc. IEEE ChinaSIP, 2013, pp. 422–426.
    5. J. J. Bird and A. Lotfi, "CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images," IEEE Access, vol. 12, pp. 15642–15650, 2024.
    6. K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," in Proc. IEEE CVPR, 2016, pp. 770–778.
    7. C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger, "On Calibration of Modern Neural Networks," in Proc. ICML, 2017, pp. 1321–1330.
    8. R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, "Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization," in Proc. IEEE ICCV, 2017, pp. 618–626.
    9. L. Verdoliva, "Media Forensics and DeepFakes: An Overview," IEEE J. Sel. Topics Signal Process., vol. 14, no. 5, pp. 910–932, 2020.
    10. S. Yin, C. Fu, S. Zhao, K. Li, X. Sun, T. Xu, and E. Chen, "A Survey on Multimodal Large Language Models," arXiv preprint arXiv:2306.13549, 2023.
    11. E. Kee, M. K. Johnson, and H. Farid, "Digital Image Authentication From JPEG Headers," IEEE Trans. Inf. Forensics Security, vol. 6, no. 3, pp. 1066–1075, 2011.
    12. T. G. Dietterich, "Ensemble Methods in Machine Learning," in Multiple Classifier Systems (Lecture Notes in Computer Science, vol. 1857), Springer, 2000, pp. 1–15.
    13. A. Barredo Arrieta et al., "Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI," Information Fusion, vol. 58, pp. 82–115, 2020.
    14. A. Paszke et al., "PyTorch: An Imperative Style, High-Performance Deep Learning Library," in Proc. NeurIPS, 2019.
    15. Ollama, GitHub repository. [Online]. Available: https://github.com/ollama/ollama (accessed 2026).
    16. H. Farid, "Exposing Digital Forgeries From JPEG Ghosts," IEEE Trans. Inf. Forensics Security, vol. 4, no. 1, pp. 154–160, 2009.
    17. N. B. Abd Warif, A. W. A. Wahab, M. Y. I. Idris, R. Ramli, R. Salleh, S. Shamshirband, and K.-K. R. Choo, "Copy-Move Forgery Detection: Survey, Challenges and Future Directions," J. Netw. Comput. Appl., vol. 75, pp. 259–278, 2016.
    18. Q. McNemar, "Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages," Psychometrika, vol. 12, no. 2, pp. 153–157, 1947.
    19. E. B. Wilson, "Probable Inference, the Law of Succession, and Statistical Inference," J. Amer. Statist. Assoc., vol. 22, no. 158, pp. 209–212, 1927.
    20. H. Liu, C. Li, Q. Wu, and Y. J. Lee, "Visual Instruction Tuning," in Proc. NeurIPS, vol. 36, pp. 34892–34916, 2023.
    21. A. Q. Jiang, A. Sablayrolles, A. Mensch, C. Bamford, D. S. Chaplot, D. de las Casas, F. Bressand, G. Lengyel, G. Lample, L. Saulnier, et al., "Mistral 7B," arXiv preprint arXiv:2310.06825, 2023.
    22. D. P. Kingma and J. Ba, "Adam: A Method for Stochastic Optimization," in Proc. ICLR, 2015.
    23. Gemma Team, T. Mesnard, C. Hardin, R. Dadashi, S. Bhupatiraju, S. Pathak, et al., "Gemma: Open Models Based on Gemini Research and Technology," arXiv preprint arXiv:2403.08295, 2024.
    24. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks," in Proc. NeurIPS, 2012, pp. 1097–1105.
    25. S. Ioffe and C. Szegedy, "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift," in Proc. ICML, 2015, pp. 448–456.
    26. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A Simple Way to Prevent Neural Networks from Overfitting," J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929–1958, 2014.
    27. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, "Attention Is All You Need," in Proc. NeurIPS, 2017, pp. 5998–6008.
    28. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A Large-Scale Hierarchical Image Database," in Proc. IEEE CVPR, 2009, pp. 248–255.
    29. H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, et al., "LLaMA: Open and Efficient Foundation Language Models," arXiv preprint arXiv:2302.13971, 2023.
    30. OpenAI, "GPT-4 Technical Report," arXiv preprint arXiv:2303.08774, 2023.
    31. T.-T. Ng and S.-F. Chang, "A Model for Image Splicing," in Proc. IEEE ICIP, 2004, pp. 1169–1172.
    32. R. Salloum, Y. Ren, and C.-C. J. Kuo, "Image Splicing Localization Using a Multi-Task Fully Convolutional Network (MFCN)," J. Vis. Commun. Image Represent., vol. 51, pp. 201–209, 2018.
    33. A. C. Popescu and H. Farid, "Exposing Digital Forgeries by Detecting Traces of Resampling," IEEE Trans. Signal Process., vol. 53, no. 2, pp. 758–767, 2005.
    34. A. Rössler, D. Cozzolino, L. Verdoliva, C. Riess, J. Thies, and M. Nießner, "FaceForensics++: Learning to Detect Manipulated Facial Images," in Proc. IEEE ICCV, 2019, pp. 1–11.
    35. V. Christlein, C. Riess, J. Jordan, C. Riess, and E. Angelopoulou, "An Evaluation of Popular Copy-Move Forgery Detection Approaches," IEEE Trans. Inf. Forensics Security, vol. 7, no. 6, pp. 1841–1854, 2012.

Tampering detection of images, and of AI-generated (GAN/diffusion-synthesized) images in particular, and forensic inconsistencies of PDF, OOXML, and legacy binary documents are important issues related to the evaluation of integrity, authenticity and trustworthiness of digital evidence. Traditional single-signal detectors provide a label lacking interpretable evidence trail and thus are useless when justification of the verdict is needed. This paper introduces a desktop forensic analysis software called ForensiX AI that performs analysis of image and document forensics.

Keywords : Digital Image Forensics, Document Forensics, Tampered Image Detection, AI-Generated Image Detection, PDF/OOXML Forensics, Convolutional Neural Networks, Large Language Models, Consensus Reasoning, Explainable AI.

Paper Submission Last Date
30 - November - 2026

SUBMIT YOUR PAPER CALL FOR PAPERS
Video Explanation for Published paper

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe