• Role: PI
• Funding Source: IARPA
• Duration: 2012 – 2016

Overview

This project addresses the problem of automatically estimating the geographic location of an image or video. I am leading the University of Kentucky component of a larger project that aims to build a complete system for this task. Our research focus is on using geometric and temporal constraints to improve accuracy and reduce computational costs and finding relationships between ground-level views and satellite imagery.

Additional Resources

• Project page for crossview geolocalization
• Project page for horizon line estimation

Related Publication(s)

1. Zhai M, Workman S, Jacobs N. 2016. Camera Geo-Calibration using an MCMC Approach. In: IEEE International Conference on Image Processing (ICIP). DOI: 10.1109/ICIP.2016.7532905.
   bibtex | paper | doi

   close  

   @inproceedings{zhai2016mcmc,
     author = {Zhai, Menghua and Workman, Scott and Jacobs, Nathan},
     booktitle = {IEEE International Conference on Image Processing (ICIP)},
     title = {Camera Geo-Calibration using an {MCMC} Approach},
     year = {2016},
     annotation = {waldo,localization,calibration},
     note = {Acceptance rate: 45\%},
     doi = {10.1109/ICIP.2016.7532905},
     pdf = {https://drive.google.com/file/d/1GpvUQqynP_vawe-obWaQfbRyU75vVmrH/view?usp=sharing}
   }
   

2. Workman S, Zhai M, Jacobs N. 2016. Horizon Lines in the Wild. In: British Machine Vision Conference (BMVC).
   bibtex | paper | website | code

   close  

   @inproceedings{workman2016hlw,
     annotation = {hlw,dataset_hlw,spotlight,waldo,nvidia,localization,calibration},
     author = {Workman, Scott and Zhai, Menghua and Jacobs, Nathan},
     booktitle = {British Machine Vision Conference (BMVC)},
     note = {Acceptance rate: 39.4\%},
     code = {https://github.com/scottworkman/deephorizon},
     pdf = {https://arxiv.org/pdf/1604.02129},
     project = {/datasets/hlw/},
     thumbnail = {/thumbnails/hlw.jpg},
     title = {Horizon Lines in the Wild},
     year = {2016}
   }
   

3. Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
   bibtex | paper | website | doi | code

   close  

   @inproceedings{workman2015localize,
     annotation = {spotlight,ugrad,dataset_cvusa,waldo,nvidia,remote_sensing,social_media,localization},
     author = {Workman, Scott and Souvenir, Richard and Jacobs, Nathan},
     booktitle = {IEEE International Conference on Computer Vision (ICCV)},
     code = {https://github.com/scottworkman/deeplyfound},
     pages = {1--9},
     pdf = {http://www.cv-foundation.org/openaccess/content_iccv_2015/papers/Workman_Wide-Area_Image_Geolocalization_ICCV_2015_paper.pdf},
     project = {http://cs.uky.edu/%7escott/research/deeplyfound/},
     thumbnail = {/thumbnails/crossview.jpg},
     title = {Wide-Area Image Geolocalization with Aerial Reference Imagery},
     doi = {10.1109/ICCV.2015.451},
     note = {Acceptance rate: 30.3\%},
     year = {2015}
   }
   

4. Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
   bibtex | paper | doi

   close  

   @inproceedings{workman2015geocnn,
     annotation = {waldo,localization,calibration,cvusa,social_media,remote_sensing},
     author = {Workman, Scott and Jacobs, Nathan},
     booktitle = {IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION)},
     note = {Acceptance rate: 30\%},
     pages = {1--9},
     pdf = {http://www.cv-foundation.org/openaccess/content_cvpr_workshops_2015/W13/papers/Workman_On_the_Location_2015_CVPR_paper.pdf},
     title = {On the Location Dependence of Convolutional Neural Network Features},
     doi = {10.1109/CVPRW.2015.7301385},
     year = {2015}
   }
   

5. Workman S, Mihail RP, Jacobs N. 2014. A Pot of Gold: Rainbows as a Calibration Cue. In: European Conference on Computer Vision (ECCV). 820–835. DOI: 10.1007/978-3-319-10602-1_53.
   bibtex | paper | website | doi

   close  

   @inproceedings{workman2014rainbow,
     annotation = {spotlight,conference,contextualeyes,waldo,calibration},
     author = {Workman, Scott and Mihail, Radu Paul and Jacobs, Nathan},
     booktitle = {European Conference on Computer Vision (ECCV)},
     doi = {10.1007/978-3-319-10602-1_53},
     note = {Acceptance rate: 25\%},
     pages = {820--835},
     project = {http://cs.uky.edu/%7escott/research/rainbows/},
     pdf = {https://drive.google.com/open?id=1-CFEKS9ASAQF_DuHbV8RbNlZIfs7ccO0},
     thumbnail = {/thumbnails/rainbow.jpg},
     title = {{A Pot of Gold}: Rainbows as a Calibration Cue},
     year = {2014}
   }
   

Acknowledgements

The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon. Disclaimer: The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of IARPA, AFRL, or the U.S. Government.