Multimodal Vision Research Laboratory

MVRL

research area: remote sensing and mapping

See below for a list of our publications in this area. You can see an unfiltered list of our publications or lists filtered for the following research areas: astronomical imagery and data; camera calibration; LiDAR Processing; image localization; medical and biological imaging; image motion; remote sensing and mapping; social media; video surveillance and object tracking; timelapse imaging; transportation; and outdoor webcam imagery.

publications

  1. PDF Khanal S, Sastry S, Dhakal A, Jacobs N. 2023. Learning Tri-modal Embeddings for Zero-Shot Soundscape Mapping. In: British Machine Vision Conference (BMVC).
    bibtex
  2. PDF Dhakal A, Ahmad A, Khanal S, Sastry S, Jacobs N. 2023. Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Images.
    bibtex
  3. PDF Sarkar A, Lanier M, Alfeld S, Feng J, Garnett R, Jacobs N, Vorobeychik Y. 2023. A Visual Active Search Framework for Geospatial Exploration. arXiv preprint 2211.15788 [cs.CV].
    bibtex | website
  4. Sastry S, Jacobs N, Belgiu M, Maretto RV. 2023. Task Agnostic Cost Prediction Module for Semantic Labeling in Active Learning. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  5. Brodie B, Sastry S, Birge J, Pless R, Jacobs N. 2023. A Cost-sensitive Approach to Dimensionality Reduction for Multispectral Imagery. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  6. Sastry S, Dhakal A, Brodie B, Khanal S, Jacobs N. 2023. Explorations in Self-supervised Learning for Change Detection. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  7. PDF Archbold C, Brodie B, Ogholbake AA, Jacobs N. 2023. Fine-grained Property Value Assessment Using Probabilistic Disaggregation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  8. Zhang Y, Rafique MU, Christie G, Jacobs N. 2023. CrossAdapt: Cross-scene Adaptation for Multi-domain Depth Estimation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  9. Zhang Y, Rafique MU, Jacobs N. 2023. CrossSeg: Cross-scene Few-shot Aerial Segmentation Using Probabilistic Prototypes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  10. PDF Zhu XX, Wang Y, Kochupillai M, Werner M, Haberle M, Hoffmann EJ, Taubenbock H, Tuia D, Levering A, Jacobs N, Kruspe A, Abdulahhad K. 2022. Geo-Information Harvesting from Social Media Data. IEEE Geoscience and Remote Sensing Magazine.
    bibtex
  11. PDF Shen S, Donkelaar A van, Martin RV, Jacobs N, Wang C. 2022. Improving representation of the AOD to PM_2.5 relationship with a convolutional neural network. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex
  12. a thumbnail for Revisiting Near/Remote Sensing with Geospatial Attention
    PDF Workman S, Rafique MU, Blanton H, Jacobs N. 2022. Revisiting Near/Remote Sensing with Geospatial Attention. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR52688.2022.00182.
    bibtex
  13. a thumbnail for Content-Based Detection of Temporal Metadata Manipulation
    PDF Padilha R, Salem T, Workman S, Andaló FA, Rocha A, Jacobs N. 2022. Content-Based Detection of Temporal Metadata Manipulation. IEEE Transactions on Information Forensics and Security:1316–1327. DOI: 10.1109/TIFS.2022.3159154.
    bibtex | website
  14. PDF Rafique MU, Zhu J, Jacobs N. 2021. Automatic Segmentation of Sinkholes Using a Convolutional Neural Network. Earth and Space Science:19. DOI: 10.1002/essoar.10509794.1.
    bibtex
  15. PDF Jones D, Jacobs N. 2021. Intensity Harmonization for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9553605.
    bibtex
  16. PDF Brodie B, Khanal S, Rafique MU, Greenwell C, Jacobs N. 2021. Hierarchical Probabilistic Embeddings for Multi-View Image Classification. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9554405.
    bibtex
  17. PDF Tuia D, Roscher R, Wegner JD, Jacobs N, Zhu XX, Camps-Valls G. 2021. Towards a Collective Agenda on AI for Earth Science Data Analysis. IEEE Geoscience and Remote Sensing Magazine 9:88–104. DOI: 10.1109/MGRS.2020.3043504.
    bibtex
  18. Chen M, Hadzic A, Song W, Jacobs N. 2021. Applications of Deep Machine Learning to Highway Safety and Usage Assessment. In: Transportation Research Board Workshop (Sponsored by AED50).
    bibtex
  19. Zhu J, Nolte A, Jacobs N, Ye M. 2020. Machine Learning in Identifying Karst Sinkholes from LiDAR-Derived Topographic Depressions in the Bluegrass Region of Kentucky. Journal of Hydrology. DOI: 10.1016/j.jhydrol.2020.125049.
    bibtex
  20. PDF Blanton H, Grate S, Jacobs N. 2020. Surface Modeling for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323522.
    bibtex
  21. PDF Hadzic A, Christie G, Freeman J, Dismer A, Bullard S, Greiner A, Jacobs N, Mukherjee R. 2020. Estimating Displaced Populations from Overhead. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9324617.
    bibtex
  22. PDF Workman S, Rafique MU, Blanton H, Greenwell C, Jacobs N. 2020. Single Image Cloud Detection via Multi-Image Fusion. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323759.
    bibtex
  23. PDF Hadzic A, Blanton H, Song W, Chen M, Workman S, Jacobs N. 2020. RasterNet: Modeling Free-Flow Speed using LiDAR and Overhead Imagery. In: EARTHVISION: Large Scale Computer Vision for Remote Sensing Imagery. DOI: 10.1109/CVPRW50498.2020.00112.
    bibtex | website
  24. a thumbnail for Learning a Dynamic Map of Visual Appearance
    PDF Salem T, Workman S, Jacobs N. 2020. Learning a Dynamic Map of Visual Appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01245.
    bibtex | website
  25. a thumbnail for Dynamic Traffic Modeling from Overhead Imagery
    PDF Workman S, Jacobs N. 2020. Dynamic Traffic Modeling from Overhead Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01233.
    bibtex | website
  26. a thumbnail for Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest
    PDF Maretto RV, Fonseca LMG, Jacobs NB, Körting TS, Bendini HN, Parente LL. 2020. Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest. IEEE Geoscience and Remote Sensing Letters 18:771–775. DOI: 10.1109/LGRS.2020.2986407.
    bibtex
  27. PDF Greenwell C, Workman S, Jacobs N. 2019. Implicit Land Use Mapping Using Social Media Imagery. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR47015.2019.9174570.
    bibtex
  28. a thumbnail for Deep Learning for Conifer/Deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees
    PDF Hamraz H, Jacobs NB, Contreras MA, Clark CH. 2019. Deep Learning for Conifer/Deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees. ISPRS Journal of Photogrammetry and Remote Sensing 158:219–230. DOI: 10.1016/j.isprsjprs.2019.10.011.
    bibtex
  29. Zhu J, Nolte AM, Jacobs N, Ye M. 2019. Incorporating Machine Learning with LiDAR for Delineating Sinkholes. In: Kentucky Water Resources Annual Symposium.
    bibtex
  30. PDF Salem T, Greenwell C, Blanton H, Jacobs N. 2019. Learning to Map Nearly Anything. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900646.
    bibtex
  31. a thumbnail for Remote Estimation of Free-Flow Speeds
    PDF Song W, Salem T, Blanton H, Jacobs N. 2019. Remote Estimation of Free-Flow Speeds. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900286.
    bibtex
  32. PDF Rafique MU, Jacobs N. 2019. Weakly Supervised Building Segmentation from Aerial Images. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8898812.
    bibtex
  33. PDF Rafique MU, Blanton H, Jacobs N. 2019. Weakly Supervised Fusion of Multiple Overhead Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW.2019.00189.
    bibtex
  34. a thumbnail for A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery
    PDF Jacobs N, Kraft A, Rafique MU, Sharma RD. 2018. A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery. In: ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL). DOI: 10.1145/3274895.3274934.
    bibtex | code
  35. PDF Greenwell C, Workman S, Jacobs N. 2018. What Goes Where: Predicting Object Distributions from Above. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8519251.
    bibtex | website
  36. a thumbnail for A Multimodal Approach to Mapping Soundscapes
    PDF Salem T, Zhai M, Workman S, Jacobs N. 2018. A Multimodal Approach to Mapping Soundscapes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8517977.
    bibtex | website
  37. a thumbnail for A Unified Model for Near and Remote Sensing
    PDF Workman S, Zhai M, Crandall D, Jacobs N. 2017. A Unified Model for Near and Remote Sensing. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.293.
    bibtex | website
  38. a thumbnail for Understanding and Mapping Natural Beauty
    PDF Workman S, Souvenir R, Jacobs N. 2017. Understanding and Mapping Natural Beauty. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.596.
    bibtex | website
  39. a thumbnail for Predicting Ground-Level Scene Layout from Aerial Imagery
    PDF Zhai M, Bessinger Z, Workman S, Jacobs N. 2017. Predicting Ground-Level Scene Layout from Aerial Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR.2017.440.
    bibtex | code
  40. PDF Jacobs N, Workman S, Zhai M. 2016. Crossview Convolutional Networks. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR.2016.8010593.
    bibtex
  41. a thumbnail for Cloudmaps from Static Ground-View Video
    PDF Jacobs N, Workman S, Souvenir R. 2016. Cloudmaps from Static Ground-View Video. Image and Vision Computing (IVC) 52:154–166. DOI: 10.1016/j.imavis.2016.05.013.
    bibtex | website
  42. a thumbnail for Wide-Area Image Geolocalization with Aerial Reference Imagery
    PDF Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
    bibtex | website | code
  43. a thumbnail for Building Dynamic Cloud Maps from the Ground Up
    PDF Murdock C, Jacobs N, Pless R. 2015. Building Dynamic Cloud Maps from the Ground Up. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.85.
    bibtex
  44. PDF Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Looking from above: When Earth observation meets vision (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
    bibtex
  45. Baltenberger R, Knochelman J, Workman S, Islam MT, Jacobs N, Griffioen J. 2013. Constructing a High-Resolution Mosaic of Kentucky Lake. In: Kentucky GIS Conference.
    bibtex
  46. PDF Murdock C, Jacobs N, Pless R. 2013. Webcam2Satellite: Estimating Cloud Maps from Webcam Imagery. In: IEEE Workshop on Applications of Computer Vision (WACV). 214–221. DOI: 10.1109/WACV.2013.6475021.
    bibtex
  47. Workman S, Knochelmann J, Jacobs N, White DS, Hauer R. 2012. Registration and Visualization of Scientific Aerial Imagery at Kentucky Lake. In: Kentucky EPSCoR Conference.
    bibtex
  48. Welty E, Pfeffer T, O’Neel S, Jacobs N. 2012. Calving Dynamics of the Columbia Glacier, AK (2000-2011 Update). In: Workshop on the Dynamics and Mass Budget of Arctic Glaciers.
    bibtex
  49. PDF Jacobs N. 2010. Discovering, Localizing, Calibrating, and Using Thousands of Outdoor Webcams. Computer Science and Engineering, Washington University in St. Louis, MO, USA.
    bibtex