😀Overview

Deep learning papers notes sharing, especially for image forgery detection and localization

ccf-rankings now marked with different colors( )
Newly added papers will be organized at the top of every category now.

Datasets Resources
Nice Expression
Research Methods (public information summery)
Paper Resource Links

Basics

图像处理基础知识

Backbone

骨干网络，多为图像分类的网络。

Image Tampering

图像篡改检测定位

Image Editing

2025

2024

2023

* [ ] Image Manipulation Detection Based on Ringed Residual Edge Artifact Enhancement and Multiple Attention Mechanisms [![Static Badge](https://img.shields.io/badge/PRCV_'24-28a745)](https://link.springer.com/chapter/10.1007/978-981-99-8543-2_30) * [ ] Improving CoatNet for Spatial and JPEG Domain Steganalysis (_ICME '23_) **[[Paper](https://ieeexplore.ieee.org/abstract/document/10219598/)]** * [ ] A survey on deep learning-based image forgery detection _(PR '23)_ **[[Paper](https://www.sciencedirect.com/science/article/pii/S0031320323004764)]** * [ ] PL-GNet: Pixel Level Global Network for detection and localization of image forgeries [![paper](https://img.shields.io/badge/IMAGE_'23-28a745)](https://www.sciencedirect.com/science/article/pii/S092359652300111X) [![GitHub](https://img.shields.io/github/stars/znshi/PL-GNet?style=flat)](https://github.com/znshi/PL-GNet) * [ ] Progressive Feedback-Enhanced Transformer for Image Forgery Localization _(arXiv '23)_ **[[Paper](https://arxiv.org/abs/2311.08910)]** **[[Code](https://github.com/multimediaFor/ProFact)]** * [ ] Secondary Labeling A Novel Labeling Strategy for Image Manipulation Detection _(MM '23)_ **[[Paper](https://doi.org/10.1145/3581783.3613839)]** * [ ] GP-Net: Image Manipulation Detection and Localization via Long-Range Modeling and Transformers (_Appl. Sci. (IF: 2.8, not included in CCFs), MDPI, '23_) **\[[Paper](https://www.mdpi.com/2076-3417/13/21/12053)]** * [ ] DS-Net: Dual supervision neural network for image manipulation localization _(IET-IPR '23)_ **[[Paper](https://ietresearch.onlinelibrary.wiley.com/doi/abs/10.1049/ipr2.12885)]** * [ ] Learning to Immunize Images for Tamper Localization and Self Recovery _(TPAMI ‘23)_ **[[Paper](https://arxiv.org/pdf/2210.15902.pdf)]** * [ ] Semantic-agnostic progressive subtractive network for image manipulation detection and localization _(Neurocomputing '23)_ **[[Paper](https://doi.org/10.1016/j.neucom.2023.126263)]** * [ ] Towards Effective Image Manipulation Detection with Proposal Contrastive Learning _(TCSVT '23)_ **[[Paper](https://arxiv.org/pdf/2210.08529.pdf)]** **[[Code](https://github.com/Sandy-Zeng/PCL)]** * [ ] Effective image tampering localization with multi-scale ConvNeXt feature fusion (_JVCIR '23)_ **\[**[**Paper**](https://arxiv.org/abs/2208.13739)**]** **[[Code](https://github.com/multimediaFor/ConvNeXtFF)]** * [ ] Evading Detection Actively: Toward Anti-Forensics against Forgery Localization (_arXiv '23_) **\[**[**Paper**](https://arxiv.org/abs/2310.10036)**]** **\[**[**Code**](https://github.com/tansq/SEAR)**]** * [ ] [ReLoc: A Restoration-Assisted Framework for Robust Image Tampering Localization](image-forgery/2023/reloc.md) (_TIFS '23_) **\[**[**Paper**](https://arxiv.org/abs/2211.03930)**]** **\[**[**Code**](https://github.com/ZhuangPeiyu/ReLoc)**]** * [ ] Image manipulation detection by multiple tampering traces and edge artifact enhancement (_PR '23_) **\[**[**Paper**](https://www.sciencedirect.com/science/article/pii/S0031320322005064)**]** (_EMT-Net_) * [x] [CFL-Net: Image Forgery Localization Using Contrastive Learning](image-forgery/2023/cfl-net.md) (_WACV '23_) **\[**[**Paper**](https://arxiv.org/abs/2210.02182)**]** **\[**[**Code**](https://github.com/niloy193/CFLNet)**]** * [x] [TruFor: Leveraging all-round clues for trustworthy image forgery detection and localization](image-forgery/2023/trufor.md) (_CVPR '23_) **\[**[**Paper**](https://arxiv.org/abs/2212.10957)**]** **\[**[**Project**](https://grip-unina.github.io/TruFor/)**]** **\[**[**Code**](https://github.com/grip-unina/TruFor)**]** * [x] [TBFormer: Two-Branch Transformer for Image Forgery Localization](image-forgery/2023/tbformer.md) (_SPL '23_) **\[**[**Paper**](https://arxiv.org/abs/2302.13004)**]** **\[**[**Code**](https://github.com/free1dom1/tbformer)**]** * [ ] [Detecting and Grounding Multi-Modal Media Manipulation](image-forgery/2023/dgm4.md) (_CVPR '23_) **\[**[**Paper**](https://arxiv.org/abs/2304.02556)**]** **\[**[**Code**](https://github.com/rshaojimmy/MultiModal-DeepFake)**]** **\[**[**Project**](https://rshaojimmy.github.io/Projects/MultiModal-DeepFake)**]** * [x] [Hierarchical Fine-Grained Image Forgery Detection and Localization](image-forgery/2023/hifi\_ifdl.md) (_CVPR '23_) **\[**[**Paper**](https://arxiv.org/abs/2303.17111)**]** **\[**[**Code**](https://github.com/CHELSEA234/HiFi\_IFDL)**]** * [ ] [Edge-aware Regional Message Passing Controller for Image Forgery Localization](image-forgery/2023/ermpc.md) (_CVPR '23_) **\[**[**Paper**](https://openaccess.thecvf.com/content/CVPR2023/papers/Li\_Edge-Aware\_Regional\_Message\_Passing\_Controller\_for\_Image\_Forgery\_Localization\_CVPR\_2023\_paper.pdf)**]** **\[**[**Video**](https://youtu.be/2pDR-hOFcQw)**]** * [ ] AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensics (_CVPRW '23_) **\[**[**Paper**](https://arxiv.org/abs/2304.06870)**]** **\[**[**Dataset**](https://github.com/shanface33/autosplice\_dataset)**]** * [ ] TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localization (_ICCV '23_) **\[**[**Paper**](https://arxiv.org/abs/2308.05264)**]** **\[**[**Code**](https://github.com/vimal-isi-edu/TrainFors)**]** * [ ] Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learning (_ICCV '23_) **\[**[**Paper**](https://openaccess.thecvf.com/content/ICCV2023/html/Zhou\_Pre-Training-Free\_Image\_Manipulation\_Localization\_through\_Non-Mutually\_Exclusive\_Contrastive\_Learning\_ICCV\_2023\_paper.html)**]** **\[**[**Code**](https://github.com/Knightzjz/NCL-IML)**]** * [ ] Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning (_ICCV '23_) **\[**[**Paper**](https://openaccess.thecvf.com/content/ICCV2023/html/Zhai\_Towards\_Generic\_Image\_Manipulation\_Detection\_with\_Weakly-Supervised\_Self-Consistency\_Learning\_ICCV\_2023\_paper.html)**]** **\[**[**Code**](https://github.com/yhZhai/WSCL)**]** **\[**[**ResearchGate**](https://www.researchgate.net/publication/373686108\_Towards\_Generic\_Image\_Manipulation\_Detection\_with\_Weakly-Supervised\_Self-Consistency\_Learning)**]** * [ ] SAFL-Net: Semantic-Agnostic Feature Learning Network with Auxiliary Plugins for Image Manipulation Detection (_ICCV '23_) **\[**[**Paper**](https://openaccess.thecvf.com/content/ICCV2023/html/Sun\_SAFL-Net\_Semantic-Agnostic\_Feature\_Learning\_Network\_with\_Auxiliary\_Plugins\_for\_Image\_ICCV\_2023\_paper.html)**]** * [ ] Uncertainty-guided Learning for Improving Image Manipulation Detection (_ICCV '23_) **\[**[**Paper**](https://openaccess.thecvf.com/content/ICCV2023/html/Ji\_Uncertainty-guided\_Learning\_for\_Improving\_Image\_Manipulation\_Detection\_ICCV\_2023\_paper.html)**]** * [ ] Rethinking Image Forgery Detection via Contrastive Learning and Unsupervised Clustering (_arXiv '23_) **\[**[**Paper**](https://arxiv.org/abs/2308.09307)**]** **\[**[**Code**](https://github.com/HighwayWu/FOCAL)**]** * [ ] Pixel-Inconsistency Modeling for Image Manipulation Localization (_arXiv '23_) **\[**[**Paper**](https://arxiv.org/abs/2310.00234)**]** [![paper](https://img.shields.io/badge/TPAMI_'25-dc3545)](https://ieeexplore.ieee.org/abstract/document/10883001/) *❗Updated* * [ ] Perceptual MAE for Image Manipulation Localization: A High-level Vision Learner Focusing on Low-level Features (_arXiv '23_) **\[**[**Paper**](https://arxiv.org/abs/2310.06525)**]** * [ ] [On the Security of the One-and-a-Half-Class Classifier for SPAM Feature-Based Image Forensics](image-forgery/2023/spam\_analysis.md) (_TIFS '23_) **(Traditional method, Analysis)** **\[**[**Paper**](https://ieeexplore.ieee.org/abstract/document/10098583/)**]**

2022

2021

Multi-modality image manipulation detection (ICME '21) [Paper]
MSTA-Net: Forgery Detection by Generating Manipulation Trace Based on Multi-Scale Self-Texture Attention (TCSVT '21) [Paper]
Image Manipulation Detection by Multi-View Multi-Scale Supervision (ICCV '21) [Paper] [Code]
TransForensics: Image Forgery Localization with Dense Self-Attention (ICCV '21) [Paper]
Self-supervised Domain Adaptation for Forgery Localization of JPEG Compressed Images (ICCV '21) [Paper]
Image Tampering Localization Using a Dense Fully Convolutional Network (TIFS '21) [Paper] [Code] (DenseFCN)
Image Manipulation Localization Using Attentional Cross-Domain CNN Features (TNNLS '21) [Paper]

2020 and before

A Full-Image Full-Resolution End-to-EndTrainable CNN Framework for Image Forgery Detection (IEEE Access '20) **[Paper]
Constrained R-CNN: A general image manipulation detection model [Paper] [Code]
A CNNBased Camera Model Fingerprint (TIFS '20) **[Paper]
An Adaptive Neural Network for Unsupervised Mosaic Consistency Analysis in Image Forensics (CVPR '20) [Paper] [Code]
A dense u-net with cross-layer intersection for detection and localization of image forgery (ICASSP '20) [Paper] [Note_unofficial]
Generate, Segment, and Refine: Towards Generic Manipulation Segmentation (AAAI '20) [Paper] [Code] (GSRNet)
SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization (ECCV '20) [Paper] [Code]
Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeries (TIP '19) [Paper] [Code]
ManTra-Net: Manipulation Tracing Network for Detection and Localization of Image Forgeries With Anomalous Features (CVPR '19) [Paper] [Code]

CNN-synthesized

Some of the above papers also contain methods to detect tampered images generated by GANs or DMs or LLMs related for synthetic images

Image Splicing

图像的拼接篡改检测定位

2024

Image splicing forgery detection: A review
Multi-Scale Cross-Fusion and Edge-Supervision Network for Image Splicing Localization
D-Net: A dual-encoder network for image splicing forgery detection and localization
UGEE-Net: Uncertainty-Guided and Edge-Enhanced Network for Image Splicing Localization (Neural Networks '24) [Paper] [Dataset]
Research on Splicing Image Detection Algorithms Based on Natural Image Statistical Characteristics (arXiv '24) [Paper]
A Visually Attentive Splice Localization Network with Multi-Domain Feature Extractor and Multi-Receptive Field Upsampler (arXiv '24) [Paper]
Feature Aggregation and Region-Aware Learning for Detection of Splicing Forgery (SPL '24) [Paper]
Towards Effective Image Forensics via A Novel Computationally Efficient Framework and A New Image Splice Dataset ( Signal, Image and Video Processing (IF: 2.3, not included in CCFs), '24 ) [Paper]

2023

GreatSplicing: A Semantically Rich Splicing Dataset (arXiv '23) [Paper] [Dataset]
Multi-scale attention context-aware network for detection and localization of image splicing: Efficient and robust identification network (Appl. Intell. 23') [Paper]
A Multi-Stream Fusion Network for Image Splicing Localization (MMM '23) [Paper]
Attacking Image Splicing Detection and Localization Algorithms Using Synthetic Traces (TIFS '23) [Paper] [IEEE Paper]
Biomedical Image Splicing Detection using Uncertainty-Guided Refinement (arXiv '23) [Paper]
A New Method to Detect Splicing Image Forgery Using Convolutional Neural Network (Applied Science (IF: 2.8, not included in CCFs), MDPI, '23) [Paper]
Multi-scale Target-Aware Framework for Constrained Image Splicing Detection and Localization (MM '23) [Paper]

2022

Multi-Task SE-Network for Image Splicing Localization (TCSVT '22) [Paper] [Code]
ET: Edge-Enhanced Transformer for Image Splicing Detection (SPL '22) [Paper]
Image splicing forgery detection by combining synthetic adversarial networks and hybrid dense U-net based on multiple spaces (IJIS '22) [Paper] [Code]
SISL:Self-Supervised Image Signature Learning for Splicing Detection & Localization (CVPRW '22) [Paper]
Deep Metric Color Embeddings for Splicing Localization in Severely Degraded Images (TIFS '22) [Paper]
Coarse-to-fine-grained method for image splicing region detection (PR '22) [Paper]

2021

CAT-Net: Compression Artifact Tracing Network for Detection and Localization of Image Splicing (WACV '21) [Paper] [Code]
Image Splicing Detection, Localization and Attribution via JPEG Primary Quantization Matrix Estimation and Clustering (TIFS '21) [Paper] [Code]
Multiple Image Splicing Dataset (MISD): A Dataset for Multiple Splicing (Data, MDPI '21) [Paper]
Reality Transform Adversarial Generators for Image Splicing Forgery Detection and Localization (ICCV '21) [Paper]
Multi-Task Wavelet Corrected Network for Image Splicing Forgery Detection and Localization (ICME '21) [Paper]
Detection and Localization of Multiple Image Splicing Using MobileNet V1 (IEEE Access '21) [Paper]

2020 and before

Image Harmonization

图像协调化

Video Forgery

Explainable Manipulated Videos Detection Using Multimodal Large Language Models
Real-Time Video Forgery Detection via Vision-WiFi Silhouette Correspondence
Dual-PST: Dual-Branch SpatioTemporal-Planar Network for Video Forgery Detection
AvatarShield: Visual Reinforcement Learning for Human-Centric Video Forgery Detection
SEDN: A Spatiotemporal Encoder-Decoder Network for End-to-End Object Removal Forgery Detection in High-Resolution Videos
BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation
Face Forgery Video Detection via Temporal Forgery Cue Unraveling
Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuning

Face Forgery

人脸篡改，篡改方法以及检测问题

Copy Move

复制移动篡改定位问题

Image Inpainting

Dense Feature Interaction Network for Image Inpainting Localization
Image Inpainting Detection via Dual Guidance of Uncertainty and Precise Boundary Information
COCO-Inpaint: A Benchmark for Image Inpainting Detection and Manipulation Localization
A Large-scale AI-generated Image Inpainting Benchmark
InpDiffusion: Image Inpainting Localization via Conditional Diffusion Models
Wavelet based inpainting detection
Enhanced Wavelet Scattering Network for image inpainting detection

Tamper Text in Detection

图像中的文本篡改检测问题 (parts of)

Low Level Vision

Related resources:

Low-level tasks include super-resolution, denoise, dehze, low-light enhancement, etc. High-level tasks include classification, detection, segmentation, etc. segmentation, and so on. However, the ones I have listed here are probably still mainly related to tampering detection.

Testing the new layout of paper title.
📖Paper, 👨‍💻Code, 📦Dataset, 🔗Other links, 📜News,
*Equal contribution. #Corresponding author.

Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models
(EVP) Explicit Visual Prompting for Low-Level Structure Segmentations (CVPR '23) 📖, 👨‍💻 (including defocus blur, shadow, forgery, camouflaged dection)
Weihuang Liu¹, Xi Shen², Chi-Man Pun^#,1, Xiaodong Cun^#,2
¹University of Macau ²Tencent AI Lab
SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device (ICCV '23) 📖, 👨‍💻
Weiran Gou^∗1,2, Ziyao Yi^∗1,2, Yan Xiang^1,2, Shaoqing Li^1,2, Zibin Liu^1,2, Dehui Kong^1,2, Ke Xu^#1,2
¹State Key Laboratory of Mobile Network and Mobile Multimedia Technology, ²Sanechips Technology, Chengdu, China
Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision (ICLR '24_) 📖, 👨‍💻
Haoning Wu^1*, Zicheng Zhang^2*, Erli Zhang^1*, Chaofeng Chen¹, Liang Liao¹, Annan Wang¹, Chunyi Li², Wenxiu Sun³, Qiong Yan³, Guangtao Zhai², Weisi Lin^1#
¹Nanyang Technological University, ²Shanghai Jiaotong University, ³Sensetime Research

Image Matching

特征匹配，图像匹配问题。

FMRT: Learning Accurate Feature Matching with Reconciliatory Transformer(arXiv '23) [Paper]
LoFTR: Detector-Free Local Matching with Transformers (CVPR '21) [Paper] [Code]
PATS: Patch Area Transportation with Subdivision for Local Feature Matching (CVPR '23) [Paper] [Code] [Project]
Adaptive Spot-Guided Transformer for Consistent Local Feature Matching (CVPR '23) [Paper] [Code] [Project]
ObjectMatch: Robust Registration using Canonical Object Correspondences (CVPR '23) [Paper] [Code] [Project]

Object Detection

目标检测，包括伪装物体目标检测和突出目标检测，COD以及SOD。

Semantic Segmentation

语义分割，将图片中完整语义（具有标签或者类别）的部分分割出来。不仅要进行目标检测检测到图像中的物体，还需要对每个像素分类。

Generative Semantic Segmentation (CVPR '23) [Paper] [Code]
EfficientViT: Lightweight Multi-Scale Attention for On-Device Semantic Segmentation [Paper] [Code]
CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation [Paper] [Code] [Project] [Note_community**]

Anomaly Detection

异常检测，通常用于发现与正常模式或预期模式不符的图像与视频。

Contextual Affinity Distillation for Image Anomaly Detection (WACV '24) [Paper]
PromptAD: Zero-Shot Anomaly Detection Using Text Prompts (WACV '24) [Paper]
Holistic Representation Learning for Multitask Trajectory Anomaly Detection (WACV '24) [Paper] [Code]

Image Steganography

Finding Incompatible Blocks for Reliable JPEG Steganalysis
LiDiNet: A Lightweight Deep Invertible Network for Image-in-Image Steganography

Useful Links

CVPR 2025 Accepted Papers https://cvpr.thecvf.com/Conferences/2025/AcceptedPapers/
ECCV 2024 Accepted papers https://eccv.ecva.net/virtual/2024/papers.html?filter=titles/
IJCAI 2024 Main Track Accepted Papers https://ijcai24.org/main-track-accepted-papers/
ICLR 2024 Papers List https://openreview.net/group?id=ICLR.cc/2024/Conference
WACV 2024 Papers https://openaccess.thecvf.com/WACV2024
MM 2023 Proceedings https://dl.acm.org/doi/proceedings/10.1145/3581783
ICML 2023 https://dblp.org/db/conf/icml/icml2023.html
ICCV 2023 Paper List https://huggingface.co/spaces/ICCV2023/ICCV2023-papers
AAAI 2023 https://dblp.org/db/conf/aaai/aaai2023.html
SIGGRAPH unofficial https://kesen.realtimerendering.com/ eg SIGGRAPH 2023 https://kesen.realtimerendering.com/sig2023.html
TIFS https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=10206
More...

Back to Home

NextDatasets Resources

Last updated 4 days ago

Was this helpful?