A heatmap-based deep learning framework for multi-modal registration of VIS, NIR, and thermal images in dermatological imaging
Costinela Corciu
IntroductionMulti-modal image registration leverages complementary information from diverse imaging sources to achieve precise spatial alignment. However, aligning visible (VIS), near-infrared (NIR), and thermal (TH) modalities remains challenging due to appearance differences and limited annotated datasets.MethodsThis study proposes a ResU-Net-inspired framework combining heatmap prediction and homography estimation to enable joint NIR-TH registration via shared feature representations. A propr