Multimodal Vision Research Laboratory

MVRL

Research Area: Image Localization

Where on Earth was an image taken—and how do we align ground-level views with overhead reference data? Image localization is a long-standing focus of the lab, spanning static outdoor cameras, single-image geolocalization, and cross-view matching between street-level and satellite imagery. Recent work includes goal modality agnostic active geo-localization (GOMAA-Geo), structure-aware direct pose estimation, and localizing limited field-of-view images via cross-view matching (ArcGeo). These methods connect ground photos, panoramas, and maps into a shared geospatial frame for search, monitoring, and embodied exploration.

View All Publications →

All Publications

  1. Wollam A, Ashley K, Shugaev M, Arend O, Semenov IY, Dashtestani H, Ravi S, Jacobs N. 2026. Towards Unconstrained Cross-View Pose Estimation. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    paper bibtex Localization GeoAI
  2. Thumbnail for GOMAA-Geo: GOal Modality Agnostic Active Geo-localization
    Sarkar A, Sastry S, Pirinen A, Zhang C, Jacobs N, Vorobeychik Y. 2024. GOMAA-Geo: GOal Modality Agnostic Active Geo-localization. In: Neural Information Processing Systems (NeurIPS).
    code paper bibtex Reinforcement Learning Vision-Language Localization GeoAI
  3. Shugaev M, Semenov I, Ashley K, Klaczynski M, Cuntoor N, Lee MW, Jacobs N. 2024. ArcGeo: Localizing Limited Field-of-View Images using Cross-view Matching. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    paper bibtex Localization GeoAI
  4. Xiong Z, Qiao F, Zhang Y, Jacobs N. 2023. StereoFlowGAN: Co-training for Stereo and Flow with Unsupervised Domain Adaptation. In: British Machine Vision Conference (BMVC).
    paper bibtex Calibration Localization
  5. Thumbnail for Content-Based Detection of Temporal Metadata Manipulation
    Padilha R, Salem T, Workman S, Andaló FA, Rocha A, Jacobs N. 2022. Content-Based Detection of Temporal Metadata Manipulation. IEEE Transactions on Information Forensics and Security:1316–1327. DOI: 10.1109/TIFS.2022.3159154.
    code website paper doi bibtex Calibration Localization GeoAI
  6. Thumbnail for A Structure-Aware Method for Direct Pose Estimation
    Blanton H, Workman S, Jacobs N. 2022. A Structure-Aware Method for Direct Pose Estimation. In: IEEE Winter Conference on Applications of Computer Vision (WACV). DOI: 10.1109/WACV51458.2022.00028.
    paper doi bibtex Calibration Localization
  7. Blanton H, Greenwell C, Workman S, Jacobs N. 2020. Extending Absolute Pose Regression to Multiple Scenes. In: Joint Workshop on Long-Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM (CVPR Workshop). DOI: 10.1109/CVPRW50498.2020.00027.
    paper doi bibtex Localization Calibration
  8. Thumbnail for Learning a Dynamic Map of Visual Appearance
    Salem T, Workman S, Jacobs N. 2020. Learning a Dynamic Map of Visual Appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01245.
    website paper doi bibtex Localization GeoAI
  9. Thumbnail for Learning Geo-Temporal Image Features
    Zhai M, Salem T, Greenwell C, Workman S, Pless R, Jacobs N. 2018. Learning Geo-Temporal Image Features. In: British Machine Vision Conference (BMVC).
    paper bibtex Localization Representation Learning
  10. Vo N, Jacobs N, Hays J. 2017. Revisiting IM2GPS in the Deep Learning Era. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.286.
    website paper doi bibtex Localization GeoAI Urban
  11. Thumbnail for Predicting Ground-Level Scene Layout from Aerial Imagery
    Zhai M, Bessinger Z, Workman S, Jacobs N. 2017. Predicting Ground-Level Scene Layout from Aerial Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR.2017.440.
    code paper doi bibtex GenAI Localization GeoAI Urban
  12. Thumbnail for Horizon Lines in the Wild
    Workman S, Zhai M, Jacobs N. 2016. Horizon Lines in the Wild. In: British Machine Vision Conference (BMVC).
    code website paper bibtex Localization Calibration
  13. Thumbnail for Camera Geo-Calibration using an MCMC Approach
    Zhai M, Workman S, Jacobs N. 2016. Camera Geo-Calibration using an MCMC Approach. In: IEEE International Conference on Image Processing (ICIP). DOI: 10.1109/ICIP.2016.7532905.
    paper doi bibtex Localization Calibration GeoAI
  14. Baltenberger R, Zhai M, Greenwell C, Workman S, Jacobs N. 2016. A Fast Method for Estimating Transient Scene Properties. In: IEEE Winter Conference on Applications of Computer Vision (WACV). 1–8. DOI: 10.1109/WACV.2016.7477713.
    code website paper doi bibtex Localization
  15. Whitney JAG, Fessler JT, Kratzer ZCN, Jacobs NB, Whitney AM, others. 2016. Method and System for Estimating Error in Predicted Distance Using RSSI Signature. US Patent 2016/0003932.
    bibtex Localization
  16. Thumbnail for Wide-Area Image Geolocalization with Aerial Reference Imagery
    Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
    code website paper doi bibtex Localization Urban
  17. Thumbnail for Face2GPS: Estimating Geographic Location from Facial Features
    Islam MT, Workman S, Jacobs N. 2015. Face2GPS: Estimating Geographic Location from Facial Features. In: IEEE International Conference on Image Processing (ICIP). DOI: 10.1109/ICIP.2015.7351072.
    website paper doi bibtex Localization Urban
  18. Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
    paper doi bibtex Localization Calibration GeoAI Representation Learning
  19. Whitney A, Fessler J, Parker J, Jacobs N. 2014. Received Signal Strength Indication Signature for Passive UHF Tags. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM). 1183–1187. DOI: 10.1109/AIM.2014.6878242.
    doi bibtex Localization
  20. Jacobs N, Miskell K, Pless R. 2011. Webcam Geo-localization using Aggregate Light Levels. In: IEEE Workshop on Applications of Computer Vision (WACV). 132–138. DOI: 10.1109/WACV.2011.5711494.
    website paper doi bibtex Localization Calibration
  21. Jacobs N, Roman N, Pless R. 2008. Toward Fully Automatic Geo-Location and Geo-Orientation of Static Outdoor Cameras. In: IEEE Workshop on Applications of Computer Vision (WACV). 1–6. DOI: 10.1109/WACV.2008.4544040.
    paper doi bibtex Localization Calibration
  22. Thumbnail for Geolocating Static Cameras
    Jacobs N, Satkin S, Roman N, Speyer R, Pless R. 2007. Geolocating Static Cameras. In: IEEE International Conference on Computer Vision (ICCV). 1–6. DOI: 10.1109/ICCV.2007.4408995.
    website paper doi bibtex Localization Calibration