Multimodal Vision Research Laboratory

MVRL

research area: image localization

The goal of image localization is to estimate the geographic location (or scene-relative location) of an image (or video). We worked on this problem for over 15 years, from a variety of perspectives. Our early work focused on localizing static outdoor cameras using temporal variations as a cue. More recent work has focused on the use of deep neural networks for single image localization, with a significant focus on exploiting overhead imagery for ground-level image localization.

See below for a list of our publications in this area. You can see an unfiltered list of our publications or lists filtered for the following research areas: astronomical imagery and data; camera calibration; LiDAR Processing; image localization; medical and biological imaging; image motion; remote sensing and mapping; social media; video surveillance and object tracking; timelapse imaging; transportation; and outdoor webcam imagery.

publications

  1. PDF Padilha R, Salem T, Workman S, Andaló FA, Rocha A, Jacobs N. 2022. Content-Based Detection of Temporal Metadata Manipulation. IEEE Transactions on Information Forensics and Security:1316–1327. DOI: 10.1109/TIFS.2022.3159154.
    bibtex | website
  2. PDF Blanton H, Workman S, Jacobs N. 2022. A Structure-Aware Method for Direct Pose Estimation. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex
  3. PDF Blanton H, Greenwell C, Workman S, Jacobs N. 2020. Extending Absolute Pose Regression to Multiple Scenes. In: Joint Workshop on Long-Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM (CVPR Workshop).
    bibtex
  4. PDF Salem T, Workman S, Jacobs N. 2020. Learning a Dynamic Map of Visual Appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01245.
    bibtex | website
  5. PDF Zhai M, Salem T, Greenwell C, Workman S, Pless R, Jacobs N. 2018. Learning Geo-Temporal Image Features. In: British Machine Vision Conference (BMVC).
    bibtex
  6. PDF Vo N, Jacobs N, Hays J. 2017. Revisiting IM2GPS in the Deep Learning Era. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.286.
    bibtex | website
  7. PDF Zhai M, Bessinger Z, Workman S, Jacobs N. 2017. Predicting Ground-Level Scene Layout from Aerial Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR.2017.440.
    bibtex | code
  8. PDF Zhai M, Workman S, Jacobs N. 2016. Camera Geo-Calibration using an MCMC Approach. In: IEEE International Conference on Image Processing (ICIP). DOI: 10.1109/ICIP.2016.7532905.
    bibtex
  9. PDF Workman S, Zhai M, Jacobs N. 2016. Horizon Lines in the Wild. In: British Machine Vision Conference (BMVC).
    bibtex | website | code
  10. PDF Baltenberger R, Zhai M, Greenwell C, Workman S, Jacobs N. 2016. A Fast Method for Estimating Transient Scene Properties. In: IEEE Winter Conference on Applications of Computer Vision (WACV). 1–8. DOI: 10.1109/WACV.2016.7477713.
    bibtex | website | code
  11. PDF Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
    bibtex | website | code
  12. PDF Islam MT, Workman S, Jacobs N. 2015. Face2GPS: Estimating Geographic Location from Facial Features. In: IEEE International Conference on Image Processing (ICIP). DOI: 10.1109/ICIP.2015.7351072.
    bibtex | website
  13. PDF Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Looking from above: When Earth observation meets vision (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
    bibtex
  14. PDF Jacobs N, Miskell K, Pless R. 2011. Webcam Geo-localization using Aggregate Light Levels. In: IEEE Workshop on Applications of Computer Vision (WACV). 132–138. DOI: 10.1109/WACV.2011.5711494.
    bibtex | website
  15. PDF Jacobs N, Roman N, Pless R. 2008. Toward Fully Automatic Geo-Location and Geo-Orientation of Static Outdoor Cameras. In: IEEE Workshop on Applications of Computer Vision (WACV). 1–6. DOI: 10.1109/WACV.2008.4544040.
    bibtex
  16. PDF Jacobs N, Satkin S, Roman N, Speyer R, Pless R. 2007. Geolocating Static Cameras. In: IEEE International Conference on Computer Vision (ICCV). 1–6. DOI: 10.1109/ICCV.2007.4408995.
    bibtex | website