A curated list of image registration related books, papers, videos, and toolboxes
Image registration is the process of transforming different sets of data into one coordinate system. Data may be multiple photographs, and from different sensors, times, depths, or viewpoints.
It is used in computer vision, medical imaging, military automatic target recognition, compiling and analyzing images and data from satellites. Registration is necessary in order to be able to compare or integrate the data obtained from different measurements.
[toc]
- Datasets
- Competitions
- Toolbox
- Books
- Tutorials
- Blogs
- Courses Seminars and Videos
- Conferences and Workshops
- Journals
A paper list of image registration.
medi.: medical image | nat.: natural image | rs.: remote sensing | pc.: point cloud
data.: dataset | dep.: deep learning
oth.: other, including correspondence, mapping, matching, alignment...
Statistics: 🔥 code is available & stars >= 100 | ⭐ citation >= 50
Last updated: 2023/03/02
2023/03/02 - add papers according to zhulf0804‘s 3D-PointCloud, update recent papers on CVPR/ECCV 2022
2022/07/27 - update recent papers on ECCV 2022
2022/07/14 - add the corresponding open source code for the 2022 papers
2022/07/12 - update recent papers on AAAI 2022 and add information about competitions
2022/06/19 - update recent TPAMI papers (2017-2021) about image registration according to dblp search engine, update recent MICCAI papers (2019-2021) about image registration according to JunMa11's MICCAI-OpenSourcePapers.
2022/06/18 - update recent papers (2017-2021) on CVPR/ICCV/ECCV/AAAI/NeurIPS/MIA about image registration according to dblp search engine.
2022/06/18 - update papers (2020-2022) about point cloud registration from NUAAXQ's awesome-point-cloud-analysis-2022.
2020/04/20 - update recent papers (2017-2020) about point cloud registration and make some diagram about history of image registration.
[CVPR] Indescribable Multi-modal Spatial Evaluator [Code] [medi.]
[CVPR] Robust Outlier Rejection for 3D Registration with Variational Bayes [Code] [pc.]
[CVPR] 3D Registration with Maximal Cliques [Code] [pc.]
[CVPR] Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registration [Code] [pc.]
[CVPR] Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registration [pc.]
[CVPR] Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweighting [Code] [pc.]
[AAAI] Rethinking Rotation Invariance with Point Cloud Registration [Code] [pc.]
[TPAMI] RoReg: Pairwise Point Cloud Registration with Oriented Descriptors and Local Rotations [Code] [pc.]
[EECV] Bayesian Tracking of Video Graphs Using Joint Kalman Smoothing and Registration.
[EECV] Learning-Based Point Cloud Registration for 6D Object Pose Estimation in the Real World.
[EECV] DiffuseMorph: Unsupervised Deformable Image Registration Using Diffusion Model. [Code]
[EECV] PCR-CG: Point Cloud Registration via Deep Explicit Color and Geometry. [Code]
[EECV] Unsupervised Deep Multi-shape Matching. [Code]
[EECV] ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformer. [Code]
[EECV] CMT: Context-Matching-Guided Transformer for 3D Tracking in Point Clouds. [code]
[EECV] A Comparative Study of Graph Matching Algorithms in Computer Vision.
[EECV] Self-supervised Learning of Visual Graph Matching.
[EECV] 3DG-STFM: 3D Geometric Guided Student-Teacher Feature Matching. [Code]
[EECV] Is Geometry Enough for Matching in Visual Localization?
[EECV] Explaining Deepfake Detection by Analysing Image Matching [Code]
[EECV] Semi-Supervised Keypoint Detector and Descriptor for Retinal Image Matching [Code]
[EECV] DFNet: Enhance Absolute Pose Regression with Direct Feature Matching [Code]
[EECV] Unitail: Detecting, Reading, and Matching in Retail Scene
[EECV] Implicit field supervision for robust non-rigid shape matching [Code]
[EECV] Registration based Few-Shot Anomaly Detection [Code]
[ECCV] Improving RGB-D Point Cloud Registration by Learning Multi-scale Local Linear Transformation [Code]
[ECCV] PointCLM: A Contrastive Learning-based Framework for Multi-instance Point Cloud Registration [Code]
[ECCV] SuperLine3D: Self-supervised Line Segmentation and Description for LiDAR Point Cloud [Code]
[AAAI] Stochastic Planner-Actor-Critic for Unsupervised Deformable Image Registration. [code] [medi.]
[AAAI] DeTarNet: Decoupling Translation and Rotation by Siamese Network for Point Cloud Registration. [code]
[AAAI] Deep Confidence Guided Distance for 3D Partial Shape Registration.
[AAAI] Reliable Inlier Evaluation for Unsupervised Point Cloud Registration. [code]
[AAAI] FINet: Dual Branches Feature Interaction for Partial-to-Partial Point Cloud Registration. [code]
[AAAI] End-to-End Learning the Partial Permutation Matrix for Robust 3D Point Cloud Registration.
[CVPR] Deterministic Point Cloud Registration via Novel Transformation Decomposition.
[CVPR] Aladdin: Joint Atlas Building and Diffeomorphic Registration Learning with Pairwise Alignment. [Code]
[CVPR] Coherent Point Drift Revisited for Non-rigid Shape Matching and Registration. [Code]
[CVPR] A variational Bayesian method for similarity learning in non-rigid image registration. [Code]
[CVPR] Affine Medical Image Registration with Coarse-to-Fine Vision Transformer. [Code]
[CVPR] Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow. [Code]
[CVPR] Global-Aware Registration of Less-Overlap RGB-D Scans. [Code]
[CVPR] Multi-instance Point Cloud Registration by Efficient Correspondence Clustering. [Code]
[CVPR] NODEO: A Neural Ordinary Differential Equation Based Optimization Framework for Deformable Image Registration. [Code]
[CVPR] RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion.
[CVPR] REGTR: End-to-end Point Cloud Correspondences with Transformers. [code] [pc.]
[CVPR] SC2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registration. [code] [pc.]
[CVPR] Geometric Transformer for Fast and Robust Point Cloud Registration. [code] [pc.] 🔥
[CVPR] Lepard: Learning partial point cloud matching in rigid and deformable scenes [Code]
[MIA] Robust joint registration of multiple stains and MRI for multimodal 3D histology reconstruction: Application to the Allen human brain atlas. [medi.] [code]
[MIA] Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance. [medi.]
[MIA] Dual-stream pyramid registration network. [medi.] [Unofficial code]
[MIA] Atlas-ISTN: Joint segmentation, registration and atlas construction with image-and-spatial transformer networks. [medi.]
[NeurIPS] Non-rigid Point Cloud Registration with Neural Deformation Pyramid [Code]
[ICLR] Partial Wasserstein Adversarial Network for Non-rigid Point Set Registration]
[TIP] GraphReg: Dynamical Point Cloud Registration with Geometry-aware Graph Signal Processing [Code]
[TPAMI] Robust Point Cloud Registration Framework Based on Deep Graph Matching [Code]
[TPAMI] RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registration
[SIGGRAPH] ImLoveNet: Misaligned Image-supported Registration Network for Low-overlap Point Cloud Pairs
[ACM MM] You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptors [Code]
[TVCG] WSDesc: Weakly Supervised 3D Local Descriptor Learning for Point Cloud Registration [Code]
[RAL] GraffMatch: Global Matching of 3D Lines and Planes for Wide Baseline LiDAR Registration
[CVPR] PREDATOR: Registration of 3D Point Clouds with Low Overlap. [code-pytorch] [pc.] 🔥
[CVPR] SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration. [code-pytorch] [pc.] 🔥
[CVPR] Robust Point Cloud Registration Framework Based on Deep Graph Matching. [code] [pc.]
[CVPR] PointDSC: Robust Point Cloud Registration using Deep Spatial Consistency. [pc.]
[CVPR] ReAgent: Point Cloud Registration using Imitation and Reinforcement Learning.[pc.]
[CVPR] DeepI2P: Image-to-Point Cloud Registration via Deep Classification. [code] [pc.] 🔥
[CVPR] UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Rendering. [pc.]
[CVPR] PointNetLK Revisited. [code] [pc.]
[CVPR] RPSRNet: End-to-End Trainable Rigid Point Set Registration Network Using Barnes-Hut 2D-Tree Representation
[CVPR] Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration
[CVPR] Recurrent Multi-View Alignment Network for Unsupervised Surface Registration.
[CVPR] Spatiotemporal Registration for Event-Based Visual Odometry.
[CVPR] Learning-Based Image Registration With Meta-Regularization.
[CVPR] Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registration.
[ICCV] HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registration. [code] [pc.]
[ICCV oral] (Just) A Spoonful of Refinements Helps the Registration Error Go Down. [pc.]
[ICCV] A Robust Loss for Point Cloud Registration. [pc.]
[ICCV] Deep Hough Voting for Robust Global Registration. [pc.]
[ICCV] Sampling Network Guided Cross-Entropy Method for Unsupervised Point Cloud Registration.[pc.]
[ICCV] LSG-CPD: Coherent Point Drift with Local Surface Geometry for Point Cloud Registration.[code] [pc.]
[ICCV] OMNet: Learning Overlapping Mask for Partial-to-Partial Point Cloud Registration.[code] [pc.]
[ICCV] DeepPRO: Deep Partial Point Cloud Registration of Objects. [pc.]
[ICCV] Feature Interactive Representation for Point Cloud Registration.[code] [pc.]
[ICCV] Provably Approximated Point Cloud Registration. [pc.]
[ICCV] Distinctiveness oriented Positional Equilibrium for Point Cloud Registration. [pc.]
[ICCV] PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds. [pc.]
[ICCV] Generative Adversarial Registration for Improved Conditional Deformable Templates.
[ICCV] Deep Hough Voting for Robust Global Registration.
[AAAI] Low-Rank Registration Based Manifolds for Convection-Dominated PDEs.
[AAAI] TAILOR: Teaching with Active and Incremental Learning for Object Registration.
[NeurIPS] Accurate Point Cloud Registration with Robust Optimal Transport.
[NeurIPS] Shape Registration in the Time of Transformers.
[NeurIPS] CoFiNet: Reliable Coarse-to-fine Correspondences for Robust PointCloud Registration.
[Robotics and Autonomous Systems] A Benchmark for Point Clouds Registration Algorithms [code] [pc.]
[TPAMI] Supervision by Registration and Triangulation for Landmark Detection.
[TPAMI] Acceleration of Non-Rigid Point Set Registration With Downsampling and Gaussian Process Regression.
[TPAMI] Point Set Registration for 3D Range Scans Using Fuzzy Cluster-Based Metric and Efficient Global Optimization.
[TPAMI] Topology-Aware Non-Rigid Point Cloud Registration.
[MICCAI] A Deep Discontinuity-Preserving Image Registration Network. [medi.]
[MICCAI] A Deep Network for Joint Registration and Parcellation of Cortical Surfaces. [medi.]
[MICCAI] Conditional Deformable Image Registration with Convolutional Neural Network. [code] [medi.]
[MICCAI] Cross-modal Attention for MRI and Ultrasound Volume Registration. [code] [medi.]
[MICCAI] End-to-end Ultrasound Frame to Volume Registration. [code] [medi.]
[MICCAI] Learning Unsupervised Parameter-specific Affine Transformation for Medical Images Registration. [code] [medi.]
[MICCAI] Multi-view analysis of unregistered medical images using cross-view transformers. [code] [medi.]
[MICCAI] Revisiting iterative highly efficient optimisation schemes in medical image registration. [code] [medi.]
[MICCAI] Unsupervised Diffeomorphic Surface Registration and Non-Linear Modelling. [code] [medi.]
[MIA] A hybrid, image-based and biomechanics-based registration approach to markerless intraoperative nodule localization during video-assisted thoracoscopic surgery. [medi.]
[MIA] Real-time multimodal image registration with partial intraoperative point-set data. [medi.]
[MIA] Leveraging unsupervised image registration for discovery of landmark shape descriptor. [medi.]
[MIA] Weakly-supervised learning of multi-modal features for regularised iterative descent in 3D image registration. [medi.]
[MIA] Shape registration with learned deformations for 3D shape reconstruction from sparse and incomplete point clouds. [medi.]
[MIA] Variational multi-task MRI reconstruction: Joint reconstruction, registration and super-resolution. [medi.]
[MIA] A novel approach to 2D/3D registration of X-ray images using Grangeat's relation. [medi.]
[MIA] Biomechanically constrained non-rigid MR-TRUS prostate registration using deep learning based 3D point cloud matching. [medi.]
[MIA] Fracture reduction planning and guidance in orthopaedic trauma surgery via multi-body image registration. [medi.]
[MIA] CNN-based lung CT registration with multiple anatomical constraints. [medi.]
[MIA] End-to-end multimodal image registration via reinforcement learning. [medi.]
[MIA] Difficulty-aware hierarchical convolutional neural networks for deformable registration of brain MR images. [medi.]
[MIA] CycleMorph: Cycle consistent unsupervised deformable image registration. [medi.]
[MIA] Rethinking medical image reconstruction via shape prior, going deeper and faster: Deep joint indirect registration and reconstruction. [medi.]
[MIA] Deformation analysis of surface and bronchial structures in intraoperative pneumothorax using deformable mesh registration. [medi.]
[MIA] Re-Identification and growth detection of pulmonary nodules without image registration using 3D siamese neural networks. [medi.]
[MIA] Image registration: Maximum likelihood, minimum entropy and deep learning. [medi.]
[MIA] ProsRegNet: A deep learning framework for registration of MRI and histopathology images of the prostate. [medi.]
[MIA] 3D Registration of pre-surgical prostate MRI and histopathology images via super-resolution volume reconstruction. [medi.]
[MIA] A deep learning framework for pancreas segmentation with multi-atlas registration and 3D level-set. [medi.]
[MIA] Anatomy-guided multimodal registration by learning segmentation without ground truth: Application to intraprocedural CBCT/MR liver segmentation and registration. [medi.]
[CVPR] Learning multiview 3D point cloud registration. [code] [pc.] 🔥
[CVPR] SampleNet: Differentiable Point Cloud Sampling. [code] [pc.] 🔥
[CVPR] Feature-metric Registration: A Fast Semi-supervised Approach for Robust Point Cloud Registration without Correspondences. [code] [pc.]
[CVPR oral] Deep Global Registration. [pc.]
[CVPR] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation.
[CVPR] Smooth Shells: Multi-Scale Shape Registration With Functional Maps.
[CVPR] Global Optimality for Point Set Registration Using Semidefinite Programming.
[CVPR] Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks.
[CVPR] 3DRegNet: A Deep Neural Network for 3D Point Registration.
[CVPR] DeepFLASH: An Efficient Network for Learning-Based Medical Image Registration.
[CVPR] Quasi-Newton Solver for Robust Non-Rigid Registration.
[NeurIPS] LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registration.
[NeurIPS] CoMIR: Contrastive Multimodal Image Representation for Registration.
[ECCV] Deep Complementary Joint Model for Complex Scene Registration and Few-Shot Segmentation on Medical Images.
[ECCV] Iterative Distance-Aware Similarity Matrix Convolution with Mutual-Supervised Point Elimination for Efficient Point Cloud Registration.
[ECCV] JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-modal Image Alignment of Large-Scale Pathological CT Scans.
[ECCV] A Closest Point Proposal for MCMC-based Probabilistic Surface Registration.
[ECCV] DeepGMR: Learning Latent Gaussian Mixture Models for Registration.
[3DV] Registration Loss Learning for Deep Probabilistic Point Set Registration. [code-pytorch] [pc.]
[TPAMI] Aggregated Wasserstein Distance and State Registration for Hidden Markov Models.
[MICCAI] MvMM-RegNet: A New Image Registration Framework Based on Multivariate Mixture Model and Neural Network Estimation [code] [medi.]
[MICCAI] Highly Accurate and Memory Efficient Unsupervised Learning-Based Discrete CT Registration Using 2.5D Displacement Search [code] [medi.]
[MICCAI] Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registration [code] [medi.]
[MICCAI] Non-Rigid Volume to Surface Registration Using a Data-Driven Biomechanical Model [code] [medi.]
[MIA] Hubless keypoint-based 3D deformable groupwise registration. [medi.]
[MIA] Multi-atlas image registration of clinical data with automated quality assessment using ventricle segmentation. [medi.]
[MIA] Groupwise registration with global-local graph shrinkage in atlas construction. [medi.]
[MIA] SLIR: Synthesis, localization, inpainting, and registration for image-guided thermal ablation of liver tumors. [medi.]
[CVPR] DeepMapping: Unsupervised Map Estimation From Multiple Point Clouds. [code] [pc.] 🔥
[CVPR] PointNetLK: Point Cloud Registration using PointNet. [code-pytorch] [pc.] 🔥
[CVPR] SDRSAC: Semidefinite-Based Randomized Approach for Robust Point Cloud Registration without Correspondences. [matlab] [pc.]
[CVPR] FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterization. [code] [pc.]
[CVPR] PointNetLK: Robust & Efficient Point Cloud Registration using PointNet. [code-pytorch] [pc.] 🔥
[CVPR] 3D Local Features for Direct Pairwise Registration. [pc.]
[CVPR] Multiview 2D/3D Rigid Registration via a Point-Of-Interest Network for Tracking and Triangulation.
[CVPR] Metric Learning for Image Registration.
[CVPR] Networks for Joint Affine and Non-Parametric Image Registration.
[ICCV] DeepVCP: An End-to-End Deep Neural Network for 3D Point Cloud Registration. [pc.]
[ICCV] Accelerated Gravitational Point Set Alignment with Altered Physical Laws. [pc.]
[ICCV] Deep Closest Point: Learning Representations for Point Cloud Registration. [pc.]
[ICCV] Efficient Learning on Point Clouds with Basis Point Sets. [code] [ pc.] 🔥
[ICCV] Robust Variational Bayesian Point Set Registration. [pc.]
[ICCV] Efficient and Robust Registration on the 3D Special Euclidean Group.
[ICCV] Linearly Converging Quasi Branch and Bound Algorithms for Global Rigid Registration.
[ICCV] A Deep Step Pattern Representation for Multimodal Retinal Image Registration.
[ICCV] Recursive Cascaded Networks for Unsupervised Medical Image Registration.
[ICCV] Automatic and Robust Skull Registration Based on Discrete Uniformization.
[NeurIPS] Arbicon-Net: Arbitrary Continuous Geometric Transformation Networks for Image Registration.
[NeurIPS] Recurrent Registration Neural Networks for Deformable Image Registration.
[NeurIPS] PRNet: Self-Supervised Learning for Partial-to-Partial Registration.
[TPAMI] Efficient Registration of High-Resolution Feature Enhanced Point Clouds.
[MICCAI] Closing the Gap between Deep and Conventional Image Registration using Probabilistic Dense Displacement Networks [code] [medi.]
[ICRA] Robust low-overlap 3-D point cloud registration for outlier rejection. [matlab] [pc.]
[ICRA] Robust Generalized Point Set Registration Using Inhomogeneous Hybrid Mixture Models Via Expectation. [pc.]
[ICRA] CELLO-3D: Estimating the Covariance of ICP in the Real World. [pc.]
[CVPR] Density Adaptive Point Set Registration. [code] [pc.]
[CVPR] Inverse Composition Discriminative Optimization for Point Cloud Registration. [pc.]
[CVPR] An Unsupervised Learning Model for Deformable Medical Image Registration.
[CVPR] Supervision-by-Registration: An Unsupervised Approach to Improve the Precision of Facial Landmark Detectors.
[CVPR] CNN Driven Sparse Multi-Level B-Spline Image Registration.
[CVPR] 3D Registration of Curves and Surfaces Using Local Differential Information.
[AAAI] Dilated FCN for Multi-Agent 2D/3D Medical Image Registration.
[ECCV] Learning and Matching Multi-View Descriptors for Registration of Point Clouds. [pc.]
[ECCV] 3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration. [code-tensorflow] [pc.] 🔥
[ECCV] Efficient Global Point Cloud Registration by Matching Rotation Invariant Features Through Translation Search. [pc.]
[ECCV] HGMR: Hierarchical Gaussian Mixtures for Adaptive 3D Registration. [pc.]
[ECCV] Robust Image Stitching with Multiple Registrations.
[TPAMI] Guaranteed Outlier Removal for Point Cloud Registration with Correspondences. [pc.]
[TPAMI] Collocation for Diffeomorphic Deformations in Medical Image Registration. [medi.]
[TPAMI] Hierarchical Sparse Representation for Robust Image Registration.
[TPAMI] Multiresolution Search of the Rigid Motion Space for Intensity-Based Registration.
[3DV] PCN: Point Completion Network. [code-tensorflow] [pc. ] 🔥
[ICRA] Robust Generalized Point Cloud Registration Using Hybrid Mixture Model. [pc.]
[ICRA] A General Framework for Flexible Multi-Cue Photometric Point Cloud Registration. [pc.]
[IROS] Dynamic Scaling Factors of Covariances for Accurate 3D Normal Distributions Transform Registration. [pc.]
[IROS] Robust Generalized Point Cloud Registration with Expectation Maximization Considering Anisotropic Positional Uncertainties. [pc.]
[IROS] PCAOT: A Manhattan Point Cloud Registration Method Towards Large Rotation and Small Overlap. [pc.]
[IEEE Access] Multi-temporal Remote Sensing Image Registration Using Deep Convolutional Features [code] 🔥 [rs.]
[CVPR] 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions. [code] [pc. data. ] 🔥 ⭐
[CVPR] Discriminative Optimization: Theory and Applications to Point Cloud Registration. [pc.]
[CVPR] 3D Point Cloud Registration for Localization using a Deep Neural Network Auto-Encoder. [code] [pc.]
[CVPR] Convex Global 3D Registration with Lagrangian Duality.
[CVPR] Group-Wise Point-Set Registration Based on Rényi's Second Order Entropy.
[CVPR] Fine-to-Coarse Global Registration of RGB-D Scans.
[CVPR] Joint Registration and Representation Learning for Unconstrained Face Identification.
[CVPR] A General Framework for Curve and Surface Comparison and Registration with Oriented Varifolds.
[ICCV] Colored Point Cloud Registration Revisited. [pc.]
[ICCV] Local-to-Global Point Cloud Registration Using a Dictionary of Viewpoint Descriptors.
[ICCV] Joint Layout Estimation and Global Multi-view Registration for Indoor Reconstruction.
[ICCV] Deep Free-Form Deformation Network for Object-Mask Registration.
[ICCV] Point Set Registration with Global-Local Correspondence and Transformation Estimation.
[ICCV] Surface Registration via Foliation.
[AAAI] An Artificial Agent for Robust Image Registration.
[AAAI] Non-Rigid Point Set Registration with Robust Transformation Estimation under Manifold Regularization.
[ICRA] Using 2 point+normal sets for fast registration of point clouds with small overlap. [pc.]
[TPAMI] Image Registration and Change Detection under Rolling Shutter Motion Blur.
[TPAMI] Hyperbolic Harmonic Mapping for Surface Registration.
[TPAMI] Randomly Perturbed B-Splines for Nonrigid Image Registration.
[ECCV] Fast Global Registration Code
[TPAMI] Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration Code
[ICRA] Fast point feature histograms (FPFH) for 3D registration
[RSS] Generalized-ICP
[TPAMI] A method for registration of 3-D shapes
[TPAMI] Least-squares fitting of two 3-D point sets
Many thanks to yzhao062 Anomaly Detection Learning Resources. I followed his style to collect resources
This resources collect:
- Books & Academic Papers
- Datasets
- Open-source and Commercial Libraries/Toolkits
- On-line Courses and Videos
- Key Conferences & Journals
-
A. Sotiras, et.al., “Deformable medical image registration: A survey,” 2013.
-
N. J. Tustison, et.al., “Learning image-based spatial transformations via convolutional neural networks : A review,” 2019.
-
G. Haskins,et.al. “Deep Learning in Medical Image Registration: A Survey,” 2019.
-
N. Tustison, et.al., “Learning image-based spatial transformations via convolutional neural networks: A review,”2019.
- [Eurographics 2022] A Survey of Non-Rigid 3D Registration
- [arXiv 2021] A comprehensive survey on point cloud registration
| Dataset | Number | Modality | Region | Format |
|---|---|---|---|---|
| DIRLAB | 10 | 4D CT | Lung | .img |
| LPBA40 | 40 | 3D MRI | T1 Brain | .img+.hdr .nii |
| IBSR18 | 18 | 3D MRI | T1 Brain | .img+.hdr |
| EMPIRE | 30 | 4D CT | Lung | .mhd+.raw |
| LiTS | 131 | 3D CT | Liver | .nii |
| CT-scans-before-and-after | ||||
| Openi | X-ray | |||
| POPI | 6 | 4D CT | ||
| NLST | CT | Lung | ||
| ADNI | 3D MRI | Brain | ||
| OASIS | 3D MRI | Brain | ||
| ABIDE | 3D MRI | Brain | ||
| ADHD200 | ||||
| CUMC12 | 12 | 3D MRI | Brain | .img+.hdr |
| MGH10 | 10 | 3D MRI | Brain | .img+.hdr |
| FIRE | 134 | 2D fundus | Retina | .jpg |
| MSD | CT | Liver | ||
| BFH | 92 | CT | Liver | |
| SLIVER | 20 | CT | Liver | |
| LSPIG | 17 | CT | Liver | |
| OAI | 20000+ | 3D MRI | Osteoarthritis | |
| CIMA | 108 | 2D | lesions | .png |
Indoor LiDAR-RGBD Scan Dataset
ETH3D SLAM & Stereo Benchmarks
ViViD : Vision for Visibility Dataset
HPatches: The HPatches dataset was used as the basis for the local descriptor evaluation challenge that was presented in the Local Features: State of the Art, Open Problems and Performance Evaluation workshop during ECCV 2016.
The Zurich Urban Micro Aerial Vehicle Dataset
Inria Aerial Image Labeling DataSet
The Stanford 3D Scanning Repository（斯坦福大学的3d扫描存储库）
http://graphics.stanford.edu/data/3Dscanrep/
这应该是做点云数据最初大家用最多的数据集，其中包含最开始做配准的Bunny、Happy Buddha、Dragon等模型。
[Stanford 3D] The Stanford 3D Scanning Repository. [pc.]
Shapenet
ShapeNet是一个丰富标注的大规模点云数据集，其中包含了55中常见的物品类别和513000个三维模型。
The KITTI Vision Benchmark Suite
链接：http://www.cvlibs.net/datasets/kitti/
这个数据集来自德国卡尔斯鲁厄理工学院的一个项目，其中包含了利用KIT的无人车平台采集的大量城市环境的点云数据集（KITTI），这个数据集不仅有雷达、图像、GPS、INS的数据，而且有经过人工标记的分割跟踪结果，可以用来客观的评价大范围三维建模和精细分类的效果和性能。
Robotic 3D Scan Repository
链接：http://kos.informatik.uni-osnabrueck.de/3Dscans/
这个数据集比较适合做SLAM研究，包含了大量的 Riegl 和 Velodyne 雷达数据
佐治亚理工大型几何模型数据集
链接：https://www.cc.gatech.edu/projects/large_models/
PASCAL3D+
链接：http://cvgl.stanford.edu/projects/pascal3d.html
包含了12中刚体分类，每一类超过了3000个实例。并且包含了对应的imageNet中每一类的图像。
其他总结
链接：https://github.com/timzhang642/3D-Machine-Learning
Other
[UWA Dataset] [pc.] (Uploaded by @sukun1045 for their repository shlizee/Predict-Cluster)
[ASL Datasets Repository(ETH)] This site is dedicated to provide datasets for the Robotics community with the aim to facilitate result evaluations and comparisons. [ pc. ]
[3D Match] Keypoint Matching Benchmark, Geometric Registration Benchmark, RGB-D Reconstruction Datasets. [pc. ]
The Visual Localization Benchmark
MICCAI 2022
the AutomatiC Registration Of Breast cAncer Tissue (ACROBAT) challenge
CuRIOUS:2019 | Official solution
1 Register pre-operative MRI to iUS before tumor resection
2 Register iUS after tumor resection to iUS before tumor resection
ANHIR:2019 | Official solution
IEEE International Symposium on Biomedical Imaging (ISBI) 2019
High-resolution (up to 40x magnification) whole-slide images of tissues (lesions, lung-lobes, mammary-glands) were acquired - the original size of our images is up to 100k x 200k pixels. The acquired images are organized in sets of consecutive sections where each slice was stained with a different dye and any two images within a set can be meaningfully registered.
Continuous Registration Challenge
Multi-shell Diffusion MRI Harmonisation Challenge 2018 (MUSHAC)
[C++] [Python] OpenCV: OpenCV (Open Source Computer Vision Library) is an open source computer vision and machine learning software library. OpenCV was built to provide a common infrastructure for computer vision applications and to accelerate the use of machine perception in the commercial products.
[C++] PCL: Point Cloud Library. The Point Cloud Library (PCL) is a standalone, large scale, open project for 2D/3D image and point cloud processing.
[C++] Ceres Solver: Ceres Solver is an open source C++ library for modeling and solving large, complicated optimization problems. It can be used to solve Non-linear Least Squares problems with bounds constraints and general unconstrained optimization problems.
[C++] Open3D: Open3D is an open-source library that supports rapid development of software that deals with 3D data. The Open3D frontend exposes a set of carefully selected data structures and algorithms in both C++ and Python. The backend is highly optimized and is set up for parallelization.
[c++] ITK: Segmentation & Registration Toolkit
An open-source, cross-platform system that provides developers with an extensive suite of software tools for image analysis. Developed through extreme programming methodologies. ITK employs leading-edge algorithms for registering and segmenting multidimensional data.
[c++] [Python] [Java] SimpleITK: a simplified layer built on top of ITK.
[c++] ANTs: Advanced Normalization Tools.
Image registration with variable transformations (elastic, diffeomorphic, diffeomorphisms, unbiased) and similarity metrics (landmarks, cross-correlation, mutual information, etc.). Image segmentation with priors & nonparametric, multivariate models.
[c++] Elastix: open source software, based on the well-known ITK .
The software consists of a collection of algorithms that are commonly used to solve (medical) image registration problems. [manual]
[C++] [Python] [Java] [R] [Ruby] [Lua] [Tcl] [C#] SimpleElastix: a medical image registration library that makes state-of-the-art image registration really easy to do in languages like Python, Java and R.
3D slicer : an open source software platform for medical image informatics, image processing, and three-dimensional visualization. Built over two decades through support from the National Institutes of Health and a worldwide developer community, Slicer brings free, powerful cross-platform processing tools to physicians, researchers, and the general public.
Github repository for deep learning medical image registration:
[Keras] VoxelMorph 🔥
[Keras] FAIM 🔥
[Tensorflow] Weakly-supervised CNN 🔥
[Tensorflow] RegNet3D 🔥
[Tensorflow] Recursive-Cascaded-Networks
[Pytorch] Probabilistic Dense Displacement Network
[Pytorch] Linear and Deformable Image Registration
[Pytorch] Inverse-Consistent Deep Networks
[Pytorch] Non-parametric image registration 🔥
[Pytorch] One Shot Deformable Medical Image Registration
[Pytorch] Image-and-Spatial Transformer Networks
[C++] OTB: Orfeo ToolBox (OTB) is an open-source project for state-of-the-art remote sensing. Built on the shoulders of the open-source geospatial community, it can process high resolution optical, multispectral and radar images at the terabyte scale. A wide variety of applications are available: from ortho-rectification or pansharpening, all the way to classification, SAR processing, and much more!
[C++] [Python] OpenCV: OpenCV (Open Source Computer Vision Library) is an open source computer vision and machine learning software library. OpenCV was built to provide a common infrastructure for computer vision applications and to accelerate the use of machine perception in the commercial products.Being a BSD-licensed product, OpenCV makes it easy for businesses to utilize and modify the code.
[C++] ITK: Insight Toolkit (ITK) an open-source, cross-platform system that provides developers with an extensive suite of software tools for image analysis. Developed through extreme programming methodologies, ITK employs leading-edge algorithms for registering and segmenting multidimensional data.
[Python] Spectral Python (SPy): Spectral Python (SPy) is a pure Python module for processing hyperspectral image data (imaging spectroscopy data). It has functions for reading, displaying, manipulating, and classifying hyperspectral imagery.
Post Processing Tools
[C++] enblend: Enblend blends away the seams in a panoramic image mosaic using a multi-resolution spline. Enfuse merges different exposures of the same scene to produce an image that looks much like a tone-mapped image.
[C++] maxflow: An implementation of the maxflow algorithm which can be used to detect the optimal seamline.
[C++] [Matlab] gco-v3.0: Multi-label optimization library by Olga Veksler and Andrew Delong.
Source Code
Parallax-tolerant image stitching 🔥
简介：是一款开源、可移植和可扩展的三维几何处理系统。主要用于处理和编辑3D三角网格，它提供了一组用于编辑、清理、修复、检查、渲染、纹理化和转换网格的工具。提供了处理由3D数字化工具/设备生成的原始数据以及3D打印功能，功能全面而且丰富。MeshLab支持多数市面上常见的操作系统，包括Windows、Linux及Mac OS X，支持输入/输出的文件格式有：STL 、OBJ 、 VRML2.0、U3D、X3D、COLLADA MeshLab可用于各种学术和研究环境，如微生物学、文化遗产及表面重建等。
g-icp 🔥
Multiple view geometry in computer vision by Richard Hartley and Andrew Zisserman, 2004: Mathematic and geometric basis for 2D-2D and 2D-3D registration. A must-read for people in the field of registration. [E-book](https://github.com/DeepRobot2020/books/blob/master/Multiple View Geometry in Computer Vision (Second Edition).pdf)
Computer Vision: A Modern Approach by David A. Forsyth, Jean Ponce: for upper-division undergraduate- and graduate-level courses in computer vision found in departments of Computer Science, Computer Engineering and Electrical Engineering.
Algebra, Topology, Differential Calculus, and Optimization Theory For Computer Science and Engineering by Jean Gallier and Jocelyn Quaintance. The latest book from upenn about the algebra and optimization theory.
Three-Dimensional Computer vision-A Geometric Viewpoint Classical 3D computer vision textbook.
An invitation to 3D vision a self-contained introduction to the geometry of three-dimensional (3-D) vision.
Zhenhuan Zhou, et.al: A software guide for medical image segmentation and registration algorithm. 医学图像分割与配准(ITK实现分册) Part Ⅱ introduces the most basic network and architecture of medical registration algorithms (Chinese Version).
2-D and 3-D Image Registration for Medical, Remote Sensing, and Industrial Applications by A. Ardeshir Goshtasby
医学图像配准技术与应用 by 吕晓琪
Intensity-based 2D-3D Medical Image Registration by Russakoff, Daniel
Biomedical Image Registration by Fischer, Dawant, Lorenz
Medical Image Registration by Hajnal, Joseph V.
Deep Learning for Medical Image Analysis (part IV)
14 lectures on visual SLAM By Xiang Gao and Tao Zhang and Yi Liu and Qinrui Yan. 视觉SLAM十四讲 视觉配准方向较易懂的入门教材。通俗讲述视觉匹配的物理模型， 数学几何基础，优化过程等。 新手必读。 [github] [Videos]
点云数据配准及曲面细分技术 by 薛耀红, 赵建平, 蒋振刚, 等 书籍内容比较过时，仅适合零基础读者阅读。推荐自行查找相关博客学习。
Image Registration for Remote Sensing
2-D and 3-D Image Registration: For Medical, Remote Sensing, and Industrial Applications by A. A. Goshtasby, 2005.
Introduction to Remote Sensing
Remote Sensing and Image Interpretation
Remote Sensing: Models and Methods for Image Processing
A demo that implement image registration by matching SIFT descriptors and appling RANSAC and affine transformation.
Big thanks to Yipeng Hu organizing the excellent tutorial.
Description:
Medical image registration has been a cornerstone in the research fields of medical image computing and computer assisted intervention, responsible for many clinical applications. Whilst machine learning methods have long been important in developing pairwise algorithms, recently proposed deep-learning-based frameworks directly infer displacement fields without iterative optimization for unseen image pairs, using neural networks trained from large population data. These novel approaches promise to tackle several most challenging aspects previously faced by classical pairwise methods, such as high computational cost, robustness for generalization and lack of inter-modality similarity measures.
Output from several international research groups working in this area include award-winning conference presentations, high-impact journal publications, well-received open-source implementations and industrial-partnered translational projects, generating significant interests to all levels of world-wide researchers. Accessing to the experience and expertise in this inherently multidisciplinary topic can be beneficial to many in our community, especially for the next generation of young scientists, engineers and clinicians who often have only been exposed to a subset of these methodologies and applications.
We organize a tutorial including both theoretical and practical sessions, inviting expert lectures and tutoring coding for real-world examples. Three hands-on sessions guiding participants to understand and implement published algorithms using clinical imaging data. This aims to provide an opportunity for the participants to bridge the gap between expertises in medical image registration and deep learning, as well as to start a forum to discuss know-hows, challenges and future opportunities in this area.
- [MICCAI2019] Autograd Image Registration Laboratory
- [kaggle 2018] X-Ray Patient Scan Registration
SimpleITK, ITK, scipy, OpenCV, Tensorflow and PyTorch all offer tools for registering images, we explore a few here to see how well they work when applied to the fairly tricky problem of registering from the same person at different time and disease points.
- [Sibgrapi 2018] Practical Review on Medical Image Registration: from Rigid to Deep Learning based Approaches [PDF&Slides] 🔥
A tutorial for anyone who wants to learn Medical Image Registration, by Natan Andrade, Fabio Augusto Faria, Fábio Augusto Menocci Cappabianco
- [kaggle 2016] Image registration, the R way, (almost) from scratch
There are some packages in R for image manipulation and after some test I select “imager” , based on the CImg C++, fast and providing several image processing tools.
图像配准会议介绍@ MICCAI2019 / CVPR2019 / ICCV2019 / NeurIPS2019
Image Registration: From SIFT to Deep Learning
16-822: Geometry-based Methods in Vision
[VALSE 2018] Talk: 2017以来的2D to 3D by 吴毅红
CVPR 2021 Image Matching: Local Features and Beyond
WBIR - International Workshop on Biomedical Image Registration
WBIR 2020: Portorož, Slovenia
WBIR 2018: Leiden, Netherlands
WBIR 2016: Las Vegas NV
WBIR 2014: London, UK
CVPR: IEEE International Conference on Computer Vision and Pattern Recognition
ICCV: IEEE International Conference on Computer Vision
ECCV: European Conference on Computer Vision
NeurIPS: Conference on Neural Information Processing Systems
AAAI: Association for the Advancement of Artificial Intelligence
ICML: International Conference on Machine Learning
ICPR: International Conference on Pattern Recognition
IJCNN: International Joint Conference on Neural Networks
ICIP: IEEE International Conference on Image Processing
IJCAI: International Joint Conferences on Artificial Intelligence
ICRA: IEEE International Conference on Robotics and Automation
International Conference on 3D Vision
WACV: Winter Conference on Applications of Computer Vision
MICCAI: International Conference on Medical Image Computing and Computer Assisted Intervention
IPMI: Information Processing in Medical Imaging
ISBI: International Symposium on Biomedical Imaging
点云配准主要应用于工业制造业的逆向工程、古文物修复、医学三维图像构建等领域。研究内容是属于计算机视觉领域的研究范畴。国际上的会议如计算机视觉三大顶会ICCV、CVPR、ECCV等都会有相关技术，除此之外，还有ACCV、BMVC、SSVM等认可度也比较高。
IEEE Transactions on Pattern Analysis and Machine Intelligence
International Journal of Computer Vision
ISPRS Journal of Photogrammetry and Remote Sensing
TMI: IEEE Transactions on Medical Imaging
MIA: Medical Image Analysis
TIP: IEEE Transactions on Image Processing
TBME: IEEE Transactions on Biomedical Engineering
BOE: Biomedical Optics Express
JHBHI: Journal of Biomedical and Health Informatics
ISPRS Journal of Photogrammetry And Remote Sensing
IEEE Transactions on Geoscience And Remote Sensing
International Journal of Applied Earth Observation and Geoinformation
IEEE Geoscience and Remote Sensing Letters
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Photogrammetric engineering and remote sensing
International journal of remote sensing
Journal of Applied Remote Sensing
IEEE旗下的TPAMI，TIP等，还有SIAM Journal Image Sciences，Springer那边有IJCV
We have QQ Group 【配准萌新交流群】（已满3000人）869211738 欢迎加入【配准萌新交流（二群)】 929134506
and Wechat Group 【配准交流群】（已满员） for comunications.
More items will be added to the repository. Please feel free to suggest other key resources by opening an issue report, submitting a pull request, or dropping me an email @ ([email protected]). Enjoy reading!
Many thanks ❤️ to all project contributors:
Many thanks ❤️ to the other awesome list:
- Yochengliu awesome-point-cloud-analysis
- zhulf0804 3D-PointCloud
- NUAAXQ awesome-point-cloud-analysis-2022
- visionxiang awesome-computational-photography
- tzxiang awesome-image-alignment-and-stitching
- hoya012 deep_learning_object_detection
- JunMa11 MICCAI-OpenSourcePapers
- Amusi awesome-object-detection
- youngfish42 Awesome-Federated-Learning-on-Graph-and-Tabular-Data
- yzhao062 Anomaly Detection Learning Resources
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent