DISCOVER: A Data-Driven Integrated Approach for Semantic Inconsistencies Verification

Semantic Forensics (SemaFor)

Publications

Journal Papers

  1. L. Abady, M. Barni, A. Garzelli, and B. Tondi, "GAN Generation of Synthetic Multispectral Satellite Images", Image and Signal Processing for Remote Sensing, vol. 11533, pp. 115330, September 2020. doi: 10.1117/12.2575765
  2. D. D. Cortivo, S. Mandelli, P. Bestagini, and S. Tubaro, “CNN-Based Multi-Modal Camera Model Identification on Video Sequences”, MDPI Journal of Imaging, vol. 7, no. 8, 135, August 2021. doi: 10.3390/jimaging7080135
  3. A. Ferreira, N. Purnekar, and M. Barni, "Ensembling Shallow Siamese Neural Network Architectures for Printed Documents Verification in Data-Scarcity Scenarios", IEEE Access, vol. 9, pp. 133924-133939, September 2021. doi: 10.1109/ACCESS.2021.3110297
  4. Y. Niu, B. Tondi, Y. Zhao, R. Ni, and M. Barni, "Image Splicing Detection, Localization and Attribution via JPEG Primary Quantization Matrix Estimation and Clustering", IEEE Transactions on Information Forensics and Security, vol. 16, pp. 5397-5412, November 2021. doi: 10.1109/TIFS.2021.3129654
  5. F. Picetti, S. Mandelli, P. Bestagini, V. Lipari, and S. Tubaro, “DIPPAS: a deep image prior PRNU anonymization scheme”, EURASIP Journal on Information Security, 2, February 2022. doi: 10.1186/s13635-022-00128-7
  6. E. D. Cannas, N. Bonettini, S. Mandelli, P. Bestagini, and S. Tubaro, "Amplitude SAR Imagery Splicing Localization", IEEE Access, vol. 10, pp. 33882-33899, March 2022. doi: 10.1109/ACCESS.2022.3161836
  7. S. Mandelli, D. Cozzolino, J. P. Cardenuto, D. Moreira, P. Bestagini, W. Scheirer, A. Rocha, L. Verdoliva, S. Tubaro, and E. J. Delp, “Forensic Analysis of Synthetically Generated Western Blot Images”, IEEE Access, vol. 10, pp. 59919–59932, May 2022. doi: 10.1109/ACCESS.2022.3179116
  8. J. Horváth, Z. Xiang, E. D. Cannas, P. Bestagini, S. Tubaro, and E. J. Delp, “Sat U-net: a fusion based method for forensic splicing localization in satellite images”, Proceedings of the SPIE, vol. 12100, May 2022. doi: 10.1117/12.2616150
  9. J. Wang, B. Tondi, and M. Barni, "An Eyes-Based Siamese Neural Network for the Detection of GAN-Generated Face Images", Frontiers in Signal Processing, vol. 2, pp. 918725, July 2022. doi: 10.3389/frsip.2022.918725
  10. D. Salvi, B. C. Hosler, P. Bestagini, M. C. Stamm, and S. Tubaro, “TIMIT-TTS: a Text-to-Speech Dataset for Multimodal Synthetic Media Detection”, IEEE Access, vol. 11, pp. 50851-50866, September 2022. doi: 10.1109/ACCESS.2023.3276480
  11. D. Moreira, J. P. Cardenuto, R. Shao, S. Baireddy, D. Cozzolino, D. Gragnaniello, W. Abd-Almageed, P. Bestagini, S. Tubaro, A. Rocha, W. Scheirer, L. Verdoliva, and E. J. Delp, "SILA: A System for Scientific Image Analysis", Scientific Reports, vol. 12, pp. 18306, October 2022. doi: 10.1038/s41598-022-21535-3
  12. L. Abady, E. D. Cannas, P. Bestagini, B. Tondi, S. Tubaro, and M. Barni, " An Overview on the Generation and Detection of Synthetic and Manipulated Satellite Images", APSIPA Transactions on Signal and Information Processing, vol. 11:1, November 2022. doi: 10.1561/116.00000142
  13. L. Abady, J. Horváth, B. Tondi, E. J. Delp, and M. Barni, "Manipulation and generation of synthetic satellite images using deep learning models", Journal of Applied Remote Sensing, vol. 16:4, November 2022. doi: 10.1117/1.JRS.16.046504
  14. J.Wang, O. Alamayreh, B. Tondi, A. Costanzo, and M. Barni," Detecting Deepfake Videos in Data Scarcity Conditions by Means of Video Coding Features", APSIPA Transactions on Signal and Information Processing, vol. 11:2, December 2022. doi: 10.1561/116.00000032
  15. D. Salvi, H. Liu, S. Mandelli, P. Bestagini, W. Zhou, W. Zhang, and S. Tubaro, “A Robust Approach to Multimodal Deepfake Detection”, Journal of Imaging, vol. 9, no. 6, June 2023. doi: 10.3390/jimaging9060122
  16. D. U. Leonzio, L. Cuccovillo, P. Bestagini, M. Marcon, P. Aichroth, and S. Tubaro, “Audio Splicing Detection and Localization Based on Acquisition Device Traces”, IEEE Transactions on Information Forensics and Security, vol. 18, pp. 4157-4172, July 2023. doi: 10.1109/TIFS.2023.3293415
  17. E. D. Cannas, S. Mandelli, P. Bestagini, S. Tubaro, and E. J. Delp, “Deep Image Prior Amplitude SAR Image Anonymization”, Remote Sensing, vol. 15, no. 15, July 2023. doi: 10.3390/rs15153750
  18. M. Barni, P. Campisi, E. J. Delp, G. Doërr, J. Fridrich, N. Memon, F. Pérez-González, A. Rocha, L. Verdoliva, and M. Wu, “Information Forensics and Security: A quarter-century-long journey”, IEEE Signal Processing Magazine, vol. 40, no. 5, pp. 67-79, July 2023. doi: 10.1109/MSP.2023.3275319
  19. D. Cozzolino, K. Nagano, L. Thomaz, A. Majumdar, and L. Verdoliva, “Synthetic Image Detection: Highlights from the IEEE Video and Image Processing Cup 2022 Student Competition”, IEEE Signal Processing Magazine, vol. 40, no. 7, pp. 94-100, November 2023. doi: 10.1109/MSP.2023.3294720
  20. J. P. Cardenuto, J. Yang, R. Padilha, R. Wan, D. Moreira, H. Li, S. Wang, F. Andaló, S. Marcel, and A. Rocha, “The Age of Synthetic Realities: Challenges and Opportunities”, APSIPA Transactions on Signal and Information Processing, vol. 12, no. 44, November 2023. doi: 10.1561/116.00000138
  21. L. Abady, G. M. Dimitri, and M. Barni, “A One-Class Classifier for the Detection of GAN Manipulated Multi-Spectral Satellite Images”, Remote Sensing, vol. 16, no. 5, pp. 781, February 2024. doi: 10.3390/rs16050781
  22. W. Theisen, M. Yankoski, K. Hook, E. Verdeja, W. Scheirer, and T. Weninger, “An Avalanche of Images on Telegram Preceded Russia's Full-Scale Invasion of Ukraine”, arXiv: 2402.14947, Under Review, February 2024. doi: 10.48550/arXiv.2402.14947
  23. L. Abady, M. Barni, A. Garzelli, and B. Tondi, “Generation of synthetic generative adversarial network-based multispectral satellite images with improved sharpness”, Journal of Applied Remote Sensing, vol. 18, no. 1, February 2024. doi: 10.1117/1.JRS.18.014510
  24. D. Tariang, R. Corvi, D. Cozzolino, G. Poggi, K. Nagano, and L. Verdoliva, “Synthetic Image Verification in the Era of Generative Artificial Intelligence: What Works and What Isn’t There yet”, IEEE Security & Privacy, pp. 37-49, vol. 22, no. 3, June 2024. doi: 10.1109/MSEC.2024.3376637
  25. L. Abady, J. Wang, B. Tondi, and M.Barni, “A Siamese-based Verification System for Open-set Architecture Attribution of Synthetic Images”, Pattern Recognition Letters, pp. 75-81, vol. 180, no. C, July 2024. doi: 10.1016/j.patrec.2024.03.002
  26. O. Alamayreh, C. Fascella, S. Mandelli, B. Tondi, P. Bestagini, and M. Barni, “Just Dance: detection of human body reenactment fake videos”, EURASIP Journal on Image and Video Processing, no. 21, August 2024. doi: 10.1186/s13640-024-00635-2
  27. J. P. Cardenuto, D. Moreira, and A. Rocha, “Unveiling Scientific Articles from Paper Mills with Provenance Analysis”, PLOS One, vol. 19, no. 10, October 2024. doi: 10.1371/journal.pone.0312666

Conference Papers

  1. J. Horvath, D. Mas Montserrat, and E. J. Delp, "Nested Attention U-Net(NAU-N): A Splicing Detection Method for Satellite Images", Proceedings of the ICPR International Workshops and Challenges, Pattern Recognition, pp. 516–529, January 2021. doi: 10.1007/978-3-030-68780-9_41
  2. W. Li, B. Tondi, R. Ni, and M. Barni, "Increased-confidence Adversarial Examples for Deep Learning Counter-Forensics", Proceedings of the International Conference on Pattern Recognition, pp. 411-424, February 2021. doi: 10.1007/978-3-030-68780-9_34 arXiv: 2005.06023
  3. W. Theisen, J. Brogan, P. B. Thomas, D. Moreira, P. Phoa, T. Weninger, and W. Scheirer, "Automatic Discovery of Political Meme Genres with Diverse Appearances", Proceedings of the International AAAI Conference on Web and Social Media, pp. 714-726, June 2021. arXiv: 2001.06122
  4. B. Hosler, D. Salvi, A. Murray, F. Antonacci, P. Bestagini, S. Tubaro, and M. C. Stamm, "Do Deepfakes Feel Emotions? A Semantic Approach to Detecting Deepfakes Via Emotional Inconsistencies", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 1013-1022, June 2021, Nashville, TN, USA. doi: 10.1109/CVPRW53098.2021.00112
  5. Z. Xiang, J. Horváth, S. Baireddy, P. Bestagini, S. Tubaro, and E. J. Delp, "Forensic Analysis of Video Files Using Metadata", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 1042-1051, June 2021, Nashville, TN, USA. doi: CVPRW53098.2021.00115 arXiv: 2105.06361
  6. J. Horváth, S. Baireddy, H. Hao, D. M. Montserrat, and E. J. Delp, "Manipulation Detection in Satellite Images Using Vision Transformer", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 1032-1041, June 2021, Nashville, TN, USA. doi: 10.1109/CVPRW53098.2021.00114 arXiv: 2105.06373
  7. D. Cozzolino, J. Thies, A. Rössler, M. Nießner, and L. Verdoliva, "SpoC: Spoofing Camera Fingerprints", Proceedings of the Computer Vision and Pattern Recognition Workshops, pp. 990-1000, June 2021, Nashville, TN, USA. doi: 10.1109/CVPRW53098.2021.00110 arXiv:1911.12069
  8. D. Gragnaniello, D. Cozzolino, F. Marra, G. Poggi, and L. Verdoliva, "Are GAN Generated Images Easy to Detect? A Critical Analysis of the State-Of-The-Art", Proceedings of the IEEE International Conference on Multimedia and Expo, pp. 1-6, July 2021. doi: 10.1109/ICME51207.2021.9428429 arXiv: 2104.02617
  9. O. Alamayreh and M. Barni, "Detection of GAN-Synthesized street videos", Proceedings of the European Signal Processing Conference, pp. 811-815, Dublin, Ireland, August 2021. doi: 10.23919/EUSIPCO54536.2021.9616262
  10. D. Cozzolino, A. Roessler, J. Thies, M. Niessner, and L. Verdoliva, "ID-Reveal: Identity-aware Deepfake Video Detection", Proceedings of the International Conference on Computer Vision, pp. 15088-15097, October 2021, Montreal, QC, Canada. doi: 10.1109/ICCV48922.2021.01483 arXiv: 2012.02512v2
  11. E. R. Bartusiak and E. J. Delp, "Synthesized Speech Detection Using Convolutional Transformer-Based Spectrogram Analysis", Proceedings of the Asilomar Conference on Signals, Systems, and Computers, pp. 1426-1430, October 2021, Asilomar, CA, USA. doi: 10.1109/IEEECONF53345.2021.9723142 arXiv: 2205.01800
  12. D. Cozzolino, D. Gragnaniello, G. Poggi, and L. Verdoliva, "Towards Universal GAN Image Detection", Proceedings of the International Conference on Visual Communications and Image Processing, pp. 1-5, December 2021, Munich, Germany. doi: 10.1109/VCIP53242.2021.9675329 arXiv: 2112.12606
  13. E. Conti, D. Salvi, C. Borrelli, B. Hosler, P. Bestagini, F. Antonacci, A. Sarti, M. C. Stamm, and S. Tubaro, “Deepfake Speech Detection Through Emotion Recognition: A Semantic Approach”, Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 8962-8966, May 2022, Singapore. doi: 10.1109/ICASSP43922.2022.9747186
  14. Z. Xiang, P. Bestagini, S. Tubaro, and E. J. Delp, "Forensic Analysis and Localization of Multiply Compressed MP3 Audio Using Transformers", Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 2929-2933, May 2022, Singapore. doi: 10.1109/ICASSP43922.2022.9747639
  15. E. D. Cannas, J. Horváth, S. Baireddy, P. Bestagini, E. J. Delp, and S. Tubaro, “Panchromatic Imagery Copy-Paste Localization Through Data-Driven Sensor Attribution”, Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 2889-2893, May 2022, Singapore. doi: 10.1109/ICASSP43922.2022.9746308
  16. J. Wang, O. Alamayreh, B. Tondi, and M. Barni, "An Architecture for the detection of GAN-generated Flood Images with Localization Capabilities", Proceedings of the IEEE Image Video and Multidimensional Signal Processing Workshop, pp. 1-5, Nafplio, Greece, June 2022. doi: 10.1109/IVMSP54334.2022.9816324 arxiv:2205.07073
  17. L. Attorresi, D. Salvi, C. Borrelli, P. Bestagini, and S. Tubaro, “Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detection”, Proceedings of the ICPR International Workshops and Challenges, pp. 247-263, August 2022, Montreal, QC, Canada. doi: 10.1007/978-3-031-37742-6_21
  18. Z. Xiang, P. Bestagini, S. Tubaro, and E. J. Delp, "H4VDM: H.264 Video Device Matching", Proceedings of the International Conference on Pattern Recognition Workshops, pp. 300-319, August 2022, Montréal, Canada. doi: 10.1007/978-3-031-37742-6_24
  19. S. Mandelli, N. Bonettini, P. Bestagini, and S. Tubaro, “Detecting GAN-Generated Images By Orthogonal Training Of Multiple CNNs”, Proceedings of the International Conference on Image Processing, pp. 3091-3095, October 2022, Bordeaux, France. doi: 10.1109/ICIP46576.2022.9897310
  20. L. Abady, G. M. Dimitri, and M.Barni, "Detection and Localization of GAN Manipulated Multi-spectral Satellite Images", Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, pp. 339-344, October 2022, Bruges, Belgium. doi: 10.14428/esann/2022.ES2022-39
  21. D. Lin, B. Tondi, B. Li, and M. Barni, "Exploiting temporal information to prevent the transferability of adversarial examples against deep fake detectors", Proceedings of the IEEE International Joint Conference on Biometrics, pp. 1-8, October 2022, Abu Dhabi, United Arab Emirates. doi: 10.1109/IJCB54206.2022.10007959
  22. A. Pianese, D. Cozzolino, G. Poggi, and L. Verdoliva, "Deepfake Audio Detection by Speaker Verification", Proceedings of the International Workshop on Information Forensics and Security, pp. 1-6, December 2022, Shanghai, China. doi: 10.1109/WIFS55849.2022.9975428 arxiv:2209.14098
  23. D. Salvi, P. Bestagini, and S. Tubaro, “Exploring the Synthetic Speech Attribution Problem Through Data-Driven Detectors”, Proceedings of the International Workshop on Information Forensics and Security, pp. 1-6, December 2022, Shanghai, China. doi: 10.1109/WIFS55849.2022.9975440
  24. W. Theisen, D. Cedre, Z. Carmichael, D. Moreira, T. Weninger, and W. Scheirer, "Motif Mining: Finding and Summarizing Remixed Image Content", Proceedings of the Winter Conference on Applications of Computer Vision, pp. 1319-1328, January 2023, Waikoloa, HI, USA. doi: 10.1109/WACV56688.2023.00137 arxiv:2203.08327
  25. A. K. S. Yadav, E. R. Bartusiak, K. Bhagtani, and E. J. Delp, "Synthetic speech attribution using self supervised audio spectrogram transformer", Proceedings of the Media Watermarking, Security, and Forensics Conference, IS&T Electronic Imaging Symposium, pp. 372-1-372-11, San Francisco, CA, January 2023. doi: 10.2352/EI.2023.35.4.MWSF-372
  26. A. K. S. Yadav, Z. Xiang, E. R. Bartusiak, P. Bestagini, S. Tubaro, and E. J. Delp, "ASSD: Synthetic Speech Detection in the AAC Compressed Domain", Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 1-5, Rhodes Island, Greece, June 2023. doi: 10.1109/ICASSP49357.2023.10095043
  27. D. Cozzolino, A. Pianese, M. Nießner, and L. Verdoliva, "Audio-Visual Person-of-Interest DeepFake Detection", Proceedings of the IEEE/CVF Computer Vision and Pattern Recognition Workshops, pp. 943-952, June 2023, Vancouver, BC, Canada. doi: 10.1109/CVPRW59228.2023.00101 arXiv:2204.03083
  28. J. Wang, B. Tondi, and M. Barni, "Classification of Synthetic Facial Attributes by Means of Hybrid Classification/Localization Patch-Based Analysis", Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1-5, June 2023, Rhodes Island, Greece. doi: 10.1109/ICASSP49357.2023.10094861
  29. Z. Xiang, A. K. S. Yadav, S. Tubaro, P. Bestagini, and E. J. Delp, "Extracting Efficient Spectrograms From MP3 Compressed Speech Signals for Synthetic Speech Detection", Proceedings of the ACM Workshop on Information Hiding and Multimedia Security, pp. 163-168, Chicago, USA, June 2023. doi: 10.1145/3577163.3595104
  30. R. Corvi, D. Cozzolino, G. Poggi, K. Nagano, and L. Verdoliva, "Intriguing properties of synthetic images: from generative adversarial networks to diffusion models", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop on Media Forensics, pp. 973-982, June 2023, Vancouver, BC, Canada. doi: 10.1109/CVPRW59228.2023.00104 arXiv:2304.06408
  31. Z. Xiang, A. K. S. Yadav, P. Bestagini, S. Tubaro, and E. J. Delp, "MTN: Forensic Analysis of MP4 Container Metadata Using Graph Neural Networks", Proceedings of the IEEE/CVF Computer Vision and Pattern Recognition Workshops, pp. 963-972, Vancouver, Canada, June 2023. doi: 10.1109/CVPRW59228.2023.00103
  32. R. Corvi, D. Cozzolino, G. Zingarini, G. Poggi, K. Nagano, and L. Verdoliva, "On The Detection of Synthetic Images Generated by Diffusion Models", Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1-5, June 2023, Rhodes Island, Greece. doi :10.1109/ICASSP49357.2023.10095167 arxiv:2211.00680
  33. J. Wang, O. Alamayreh, B. Tondi, and M. Barni, "Open Set Classification of GAN-based Image Manipulations via a ViT-based Hybrid Architecture", Proceedings of the IEEE/CVF Computer Vision and Pattern Recognition, Workshop on Media Forensics, pp. 953-962, June 2023, Vancouver, Canada. doi: 10.1109/CVPRW59228.2023.00102 doi: 10.48550/arXiv.2304.05212
  34. D. Salvi, P. Bestagini, and S. Tubaro, “Reliability Estimation for Synthetic Speech Detection”, Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1-5, June 2023, Rhodes Island, Greece. doi: 10.1109/ICASSP49357.2023.10095524
  35. K. Bhagtani, E. R. Bartusiak, A. K. S. Yadav, P. Bestagini, and E. J. Delp, "Synthesized Speech Attribution Using The Patchout Spectrogram Attribution Transformer", Proceedings of the ACM Workshop on Information Hiding and Multimedia Security, pp. 157-162, Chicago, USA, June 2023. doi: 10.1145/3577163.3595112
  36. D. Salvi, P. Bestagini, and S. Tubaro, “Synthetic Speech Detection through Audio Folding”, Proceedings of the ACM International Workshop on Multimedia AI against Disinformation, pp. 3-9, June 2023, Thessaloniki, Greece. doi: 10.1145/3592572.3592844
  37. F. Guillaro, D. Cozzolino, A. Sud, N. Dufour, and L. Verdoliva, "TruFor: Leveraging All-Round Clues for Trustworthy Image Forgery Detection and Localization", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 20606-20615, June 2023, Vancouver, BC, Canada. doi: 10.1109/CVPR52729.2023.01974 arXiv:2212.10957
  38. O. Alamayreh, G. M. Dimitri, J. Wang, B. Tondi, and M. Barni, "Which Country is This Picture From? New Data and Methods For Dnn-Based Country Recognition", Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1-5, June 2023, Rhodes Island, Greece. doi: 10.1109/ICASSP49357.2023.10094908
  39. A. Ferreira, and M. Barni, "Attacking and Defending Printer Source Attribution Classifiers in the Physical Domain", Proceedings of the Pattern Recognition, Computer Vision, and Image Processing, ICPR International Workshops and Challenges, vol 13644, pp. 347-363, August 2023, Montreal, QC, Canada. doi: 10.1007/978-3-031-37742-6_27
  40. H. Maaren, D. Vanden Bussche, F. Guillaro, D. Cozzolino, G. Van Wallendael, P. Lambert, and L. Verdoliva, "Comprint: Image Forgery Detection and Localization using Compression Fingerprints", Proceedings of the International Conference on Pattern Recognition International Workshops and Challenges, pp. 281-299, August 2023, Montréal, QC, Canada. doi: 10.1007/978-3-031-37742-6_23 arxiv:2210.02227
  41. O. Alamayreh, J. Wang, G. M. Dimitri, B. Tondi, and M. Barni, “A Siamese Based System for City Verification”, Proceedings of the European Conference on Artificial Intelligence, pp. 69-76, September 2023, Kraków, Poland. doi: 10.3233/FAIA230255
  42. D. Salvi, P. Bestagini, and S. Tubaro, “Towards Frequency Band Explainability in Synthetic Speech Detection”, Proceedings of the European Signal Processing Conference, pp. 620-624, September 2023, Helsinki, Finland. doi: 10.23919/EUSIPCO58844.2023.10289804
  43. M. Barni, A. Costanzo, G. M. Dimitri, and B. Tondi, “A GPU-accelerated algorithm for copy move detection in large-scale satellite images”, Proceedings of the SPIE Image and Signal Processing for Remote Sensing, p. 1528, October 2023, Amsterdam, Netherlands. doi: 10.1117/12.2683812
  44. K. Bhagtani, A. K. S. Yadav, Z. Xiang, P. Bestagini, and E. J. Delp, "FGSSAT : Unsupervised Fine-Grain Attribution of Unknown Speech Synthesizers Using Transformer Networks", Proceedings of the IEEE Asilomar Conference on Signals, Systems, and Computers, pp. 1135-1140, October 2023, Asilomar, CA, USA. doi: 10.1109/IEEECONF59524.2023.10476982
  45. E. R. Bartusiak, K. Bhagtani, A. K. S. Yadav, and E. J. Delp, "Transformer Ensemble for Synthesized Speech Detection", Proceedings of the IEEE Asilomar Conference on Signals, Systems, and Computers, pp. 1100-1105, October 2023, Pacific Grove, CA, USA. doi: 10.1109/IEEECONF59524.2023.10477041
  46. D. Salvi, M. Pezzoli, S. Mandelli, P. Bestagini, and S. Tubaro, “Are you Really Alone? Detecting the use of Speech Separation Techniques on Audio Recordings”, Proceedings of the International Workshop on Information Forensics and Security, pp. 1-6, December 2023, Nürnberg, Germany. doi: 10.1109/WIFS58808.2023.10374717
  47. A. K. S. Yadav, K. Bhagtani, Z. Xiang, P. Bestagini, S. Tubaro, and E. J. Delp, "DSVAE: Disentangled Representation Learning for Synthetic Speech Detection", Proceedings of the IEEE International Conference on Machine Learning and Applications, pp. 472-479, December 2023, Florida, USA. doi: 10.1109/ICMLA58977.2023.00072 arXiv:2304.03323
  48. E. D. Cannas, S. Baireddy, P. Bestagini, S. Tubaro, and E. J. Delp, “Enhancement Strategies For Copy-Paste Generation & Localization in RGB Satellite Imagery”, Proceedings of the International Workshop on Information Forensics and Security, pp. 1-6, December 2023, Nürnberg, Germany. doi: 10.1109/WIFS58808.2023.10374637
  49. A. K. S. Yadav, Z. Xiang, K. Bhagtani, P. Bestagini, S. Tubaro, and E. J. Delp, "PS3DT: Synthetic Speech Detection Using Patched Spectrogram Transformer", Proceedings of the IEEE International Conference on Machine Learning and Applications, pp. 496-503, December 2023, Florida, USA. doi: 10.1109/ICMLA58977.2023.00075
  50. W. Theisen and W. Scheirer, “C-CLIP: Contrastive Image-Text Encoders to Close the Descriptive-Commentative Gap”, Proceedings of the Winter Conference on Applications of Computer Vision, pp. 7226-7235, January 2024, Waikoloa, Hawaii. doi: 10.1109/WACV57701.2024.00708
  51. W. Theisen and W. Scheirer, “N-Modal Contrastive Losses with Applications to Social Media Data in Trimodal Space”, arXiv:2403.12747, March 2024. doi: 10.48550/arXiv.2403.12747
  52. E. D. Cannas, P. Beaus, P. Bestagini, F. Marques, and S. Tubaro, “A One-Class Approach To Detect Super-Resolution Satellite Imagery With Spectral Features”, Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 4685-4689, April 2024, Seoul, Korea. doi: 10.1109/ICASSP48485.2024.10446619
  53. A. K. S. Yadav, K. Bhagtani, S. Baireddy, P. Bestagini, S. Tubaro, and E. J. Delp, “Mdrt: Multi-Domain Synthetic Speech Localization”, Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 11171-11175, April 2024, Seoul, Korea. doi: 10.1109/ICASSP48485.2024.10446471
  54. G. Zingarini, D. Cozzolino, R. Corvi, G. Poggi, and L. Verdoliva, “M3Dsynth: A Dataset of Medical 3D images with AI-Generated Local Manipulations”, Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 13176-13180, April 2024, Seoul, Korea. doi: 10.1109/ICASSP48485.2024.10446605
  55. R. Shao, R. Schwarz, C. Clifton, and E. J. Delp, “A Natural Approach for Synthetic Short-Form Text Analysis”, Proceedings of the Joint International Conference on Computational Linguistics, Language Resources and Evaluation, pp. 1034–1042, May 2024, Torino, Italia.
  56. K. Bhagtani, A. K. S. Yadav, P. Bestagini, and E. J. Delp, “Are Recent Deepfake Speech Generators Detectable?”, Proceedings of the ACM Workshop on Information Hiding and Multimedia Security, pp. 277-282, June 2024, Baiona, Spain. doi: 10.1145/3658664.3659658
  57. A. K. S. Yadav, K. Bhagtani, D. Salvi, P. Bestagini, and E. J. Delp, “FairSSD: Understanding Bias in Synthetic Speech Detectors”, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 4418-4428, June 2024, Seattle, WA, USA. doi: 10.48550/arXiv.2404.10989
  58. N. Purnekar, L.Abady, B.Tondi, and M.Barni, “Improving the Robustness of Synthetic Images Detection by Means of Print and Scan Augmentation”, Proceedings of the ACM Workshop on Information Hiding and Multimedia Security, pp. 65-73, June 2024, Baiona, Spain. doi: 10.1145/3658664.3659635
  59. E. D. Cannas, S. Mandelli, P. Bestagini, and S. Tubaro, “Investigating Translation Invariance and Shiftability in CNNs for Robust Multimedia Forensics: A JPEG Case Study”, Proceedings of the ACM Workshop on Information Hiding and Multimedia Security, pp. 53-63, June 2024, Baiona, Spain. doi: 10.1145/3658664.3659644
  60. D. Cozzolino, G. Poggi, R. Corvi, M. Nießner, and L. Verdoliva, “Raising the Bar of AI-generated Image Detection with CLIP”, Proceedings of the Computer Vision and Pattern Recognition Workshops, pp. 4356-4366, June 2024, Seattle, WA, USA. doi: 10.1109/CVPRW63382.2024.00439
  61. A. Pianese, D. Cozzolino, G. Poggi, and L. Verdoliva, “Training-Free Deepfake Voice Recognition by Leveraging Large-Scale Pre-Trained Models”, Proceedings of the ACM Conference on Information Hiding and Multimedia Security, pp. 289-294, June 2024, Baiona Spain. doi: 10.1145/3658664.3659662
  62. V. Negroni, D. Salvi, P. Bestagini, and S. Tubaro, “Analyzing the Impact of Splicing Artifacts in Partially Fake Speech Signals”, Proceedings of the INTERSPEECH Automatic Speaker Verification Spoofing Countermeasures Workshop, pp. 79-85, August 2024, Kos, Greece. doi: 10.21437/ASVspoof.2024-12
  63. K. Bhagtani, A. K. S. Yadav, P. Bestagini, and E. J. Delp, “SSLCT: A Convolutional Transformer for Synthetic Speech Localization”, Proceedings of the IEEE International Conference on Multimedia Information Processing and Retrieval, pp. 134-140, August 2024, San Jose, CA, USA. doi: 10.1109/MIPR62202.2024.00028
  64. K. Bhagtani, A. K. S. Yadav, P. Bestagini, and E. J. Delp, “DiffSSD: A Diffusion-Based Dataset For Speech Forensics”, arXiv:2409.13049, September 2024. doi: 10.48550/arXiv.2409.13049
  65. J. P. Cardenuto, S. Mandelli, D. Moreira, P. Bestagini, E. J. Delp, and A. Rocha, “Explainable Artifacts for Synthetic Western Blot Source Attribution”, Proceedings of the International Workshop on Information Forensics and Security, September 2024, Rome, Italy. doi: 10.48550/arXiv.2409.18881
  66. D. Cozzolino, G. Poggi, M. Nießner, and L. Verdoliva, “Zero-Shot Detection of AI-Generated Images”, Proceedings of the European Conference on Computer Vision, pp. 54-72, September 2024, Fiera Milano, Italy. doi: 10.1007/978-3-031-72649-1_4
  67. A. K. S. Yadav, K. Bhagtani, P. Bestagini, and E. J. Delp, “Improving Fairness in Synthetic Speech Detectors”, Proceedings of the Asilomar Conference on Signals, Systems, and Computers, October 2024, Pacific Grove, CA, USA.
  68. K. Bhagtani, A. K. S. Yadav, P. Bestagini, and E. J. Delp, “Attribution of Diffusion Based Deepfake Speech Generators”, Proceedings of the International Workshop on Information Forensics and Security, December 2024, Rome, Italy.

Book Chapters

  1. R. Tolosana, C. Rathgeb, R. Vera-Rodriguez, C. Busch, L. Verdoliva et. al., “Future Trends in Digital Face Manipulation and Detection”, in Handbook of Digital Face Manipulation and Detection - From DeepFakes to Morphing Attacks, Series on Advances in Computer Vision and Pattern Recognition, 1st ed., Springer, pp. 463-482, January 2022. doi: 10.1007/978-3-030-87664-7_21
  2. D. Cozzolino and L. Verdoliva, “Multimedia Forensics before the Deep Learning Era”, in Handbook of Digital Face Manipulation and Detection - From DeepFakes to Morphing Attacks, Series on Advances in Computer Vision and Pattern Recognition, 1st ed., Springer, pp. 45-67, January 2022. doi: 10.1007/978-3-030-87664-7_3
  3. D. Gragnaniello, F. Marra, and L.Verdoliva, “Detection of AI generated synthetic face images”, in Handbook of Digital Face Manipulation and Detection - From DeepFakes to Morphing Attacks, Series on Advances in Computer Vision and Pattern Recognition, 1st ed., Springer, pp. 191-212, February 2022. doi: 10.1007/978-3-030-87664-7
  4. M. Barni, W. Li, B. Tondi, and B. Zhang, “Adversarial Examples in Image Forensics”, in Multimedia Forensics, Advances in Computer Vision and Pattern Recognition, Springer Nature, Singapore, pp. 435-466, April 2022. doi: 10.1007/978-981-16-7621-5_16
  5. D. Cozzolino, G. Poggi, and L. Verdoliva, “Data-Driven Digital Integrity Verification”, in Multimedia Forensics, Series on Advances in Computer Vision and Pattern Recognition, 2nd ed., Springer, Singapore, pp. 281-311, April 2022. doi: 10.1007/978-981-16-7621-5_11

Press Releases

  • A Purdue University press release of our work on Deepfake detection
  • A Purdue University press release of our work on the SemaFor program
  • An article on Purdue Exponent featuring the VIPER lab students' comments on Deepfake

This material is based on research sponsored by the Defense Advanced Research Projects Agency (DARPA) and the Air Force Research Laboratory (AFRL) under agreement number FA8750-20-2-1004. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of DARPA and AFRL or the U.S. Government.