Multimodal Vision Research Laboratory

MVRL

research area: remote sensing and mapping

See below for a list of our publications in this area. You can see an unfiltered list of our publications or lists filtered for the following research areas: agriculture; astronomical imagery and data; camera calibration; biodiversity and conservation; generative modeling; LiDAR Processing; image localization; medical and biological imaging; image motion; remote sensing and mapping; social media; video surveillance and object tracking; timelapse imaging; transportation; and outdoor webcam imagery.

publications

  1. Dhakal A, Sastry S, Khanal S, Ahmad A, Xing E, Jacobs N. 2025. RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
    bibtex | paper | linkedin | code
  2. a thumbnail for Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentation
    Kerner H, Chaudhari S, Ghosh A, Robinson C, Ahmad A, Choi E, Jacobs N, Holmes C, Mohr M, Dodhia R, Ferres JML, Marcus J. 2025. Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentation. In: Association for the Advancement of Artificial Intelligence (AAAI).
    bibtex | paper | website
  3. Sarkar A, DiChristofano A, Das S, Fowler P, Jacobs N, Vorobeychik Y. 2025. Active Geospatial Search for Efficient Tenant Eviction Outreach. In: Association for the Advancement of Artificial Intelligence (AAAI).
    bibtex | paper | code
  4. a thumbnail for TaxaBind: A Unified Embedding Space for Ecological Applications
    Sastry S, Khanal S, Dhakal A, Ahmad A, Jacobs N. 2025. TaxaBind: A Unified Embedding Space for Ecological Applications. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | website | linkedin | code
  5. Kerner HR, Chaudhari S, Robinson C, Ghosh A, Ahmad A, Choi E, Jacobs N, Holmes C, Mohr M, Marcus J. 2024. Fields of The World (FTW!): A New Machine Learning Dataset for Agricultural Field Boundary Segmentation on Four Continents. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex
  6. a thumbnail for GOMAA-Geo: GOal Modality Agnostic Active Geo-localization
    Sarkar A, Sastry S, Pirinen A, Zhang C, Jacobs N, Vorobeychik Y. 2024. GOMAA-Geo: GOal Modality Agnostic Active Geo-localization. In: Neural Information Processing Systems (NeurIPS).
    bibtex | paper | linkedin | code
  7. Ahmad A, Dhakal A, Sastry S, Khanal S, Xing E, Jacobs N. 2024. Improved Canopy Vertical Structural Diversity Mapping Across Varied Topographies Using Deep Learning Techniques. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex
  8. Sastry S, Ahmad A, Dhakal A, Khanal S, Xing E, Jacobs N. 2024. ClimSatDiff: Synthesizing the Earth’s Surface Conditioned on Climatic Variables using Diffusion Models. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex
  9. Shen S, Donkelaar A van, Jacobs N, Li C, Martin RV. 2024. Enhancing Estimation of Fine Particulate Matter Species Concentrations over North America by Including Geophysical a priori Information in Deep Learning. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex
  10. Sastry S, Xing X, Dhakal A, Khanal S, Ahmad A, Jacobs N. 2024. LD-SDM: Language-Driven Hierarchical Species Distribution Modeling. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex
  11. a thumbnail for PSM: Learning Probabilistic Embeddings for Multi-scale Zero-shot Soundscape Mapping
    Khanal S, Xing E, Sastry S, Dhakal A, Xiong Z, Ahmad A, Jacobs N. 2024. PSM: Learning Probabilistic Embeddings for Multi-scale Zero-shot Soundscape Mapping. In: ACM Multimedia. DOI: 10.1145/3664647.3681620.
    bibtex | paper | doi | linkedin
  12. Xiong Z, Xing X, Workman S, Khanal S, Jacobs N. 2024. Mixed-View Panorama Synthesis using Geospatially Guided Diffusion.
    bibtex | paper
  13. Dhakal A, Khanal S, Sastry S, Ahmad A, Jacobs N. 2024. GeoBind: Binding text, image, and audio through satellite images. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex | paper
  14. Jain P, Marcos D, Ienco D, Interdonato R, Dhakal A, Jacobs N, Berchoux T. 2024. Aligning Geo-Tagged CLIP Representations and Satellite Imagery for Few-Shot Land Use Classification. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  15. Dhakal A, Ahmad A, Khanal S, Sastry S, Kerner H, Jacobs N. 2024. Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION).
    bibtex | paper | linkedin
  16. Sastry S, Khanal S, Dhakal A, Jacobs N. 2024. GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION).
    bibtex | paper
  17. Sarkar A, DiChristofano A, Das S, Fowler P, Jacobs N, Vorobeychik Y. 2024. Geospatial Active Search for Preventing Evictions. In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS).
    bibtex
  18. Shen S, Li C, Donkelaar A van, Jacobs N, Wang C, Martin RV. 2024. Enhancing Global Estimation of Fine Particulate Matter Concentrations by Including Geophysical a Priori Information in Deep Learning. ACS ES&T Air. DOI: 10.1021/acsestair.3c00054.
    bibtex | paper | doi | linkedin
  19. a thumbnail for BirdSat: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping
    Sastry S, Khanal S, Dhakal A, Huang D, Jacobs N. 2024. BirdSat: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | press release | linkedin | code
  20. a thumbnail for WATCH: Wide-Area Terrestrial Change Hypercube
    Greenwell C, Leotta M, Crall J, Jacobs N, Purri M, Dana K, Hadzic A, Workman S. 2024. WATCH: Wide-Area Terrestrial Change Hypercube. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | code
  21. Sarkar A, Lanier M, Alfeld S, Feng J, Garnett R, Jacobs N, Vorobeychik Y. 2024. A Visual Active Search Framework for Geospatial Exploration. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | press release | code
  22. Levering A, Marcos D, Jacobs N, Tuia D. 2024. Prompt-guided and multimodal landscape scenicness assessments with vision-language models. PLOS ONE.
    bibtex
  23. Sastry S, Xing X, Dhakal A, Khanal S, Ahmad A, Jacobs N. 2023. LD-SDM: Language-Driven Hierarchical Species Distribution Modeling.
    bibtex | paper
  24. a thumbnail for A Partially-Supervised Reinforcement Learning Framework for Visual Active Search
    Sarkar A, Jacobs N, Vorobeychik Y. 2023. A Partially-Supervised Reinforcement Learning Framework for Visual Active Search. In: Neural Information Processing Systems (NeurIPS).
    bibtex | paper | press release | code
  25. Khanal S, Sastry S, Dhakal A, Jacobs N. 2023. Learning Tri-modal Embeddings for Zero-Shot Soundscape Mapping. In: British Machine Vision Conference (BMVC).
    bibtex | paper | press release | linkedin | code
  26. Liang G, Zulu J, Xing X, Jacobs N. 2023. Unveiling Roadway Hazards: Enhancing Fatal Crash Risk Estimation through Multi-Scale Satellite Imagery and Self-Supervised Cross-Matching. Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS). DOI: 10.1109/JSTARS.2023.3331438.
    bibtex | paper | doi
  27. Zhang Y, Rafique MU, Christie G, Jacobs N. 2023. CrossAdapt: Cross-scene Adaptation for Multi-domain Depth Estimation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  28. Zhang Y, Rafique MU, Jacobs N. 2023. CrossSeg: Cross-scene Few-shot Aerial Segmentation Using Probabilistic Prototypes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  29. Archbold C, Brodie B, Ogholbake AA, Jacobs N. 2023. Fine-grained Property Value Assessment Using Probabilistic Disaggregation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex | paper
  30. Sastry S, Jacobs N, Belgiu M, Maretto RV. 2023. Task Agnostic Cost Prediction Module for Semantic Labeling in Active Learning. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  31. Brodie B, Sastry S, Birge J, Pless R, Jacobs N. 2023. A Cost-sensitive Approach to Dimensionality Reduction for Multispectral Imagery. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  32. Sastry S, Dhakal A, Brodie B, Khanal S, Jacobs N. 2023. Explorations in Self-supervised Learning for Change Detection. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  33. Zhu XX, Wang Y, Kochupillai M, Werner M, Haberle M, Hoffmann EJ, Taubenbock H, Tuia D, Levering A, Jacobs N, Kruspe A, Abdulahhad K. 2022. Geoinformation Harvesting From Social Media Data: A community remote sensing approach. IEEE Geoscience and Remote Sensing Magazine 10:150–180. DOI: 10.1109/MGRS.2022.3219584.
    bibtex | paper | doi
  34. Shen S, Donkelaar A van, Martin RV, Jacobs N, Wang C. 2022. Improving representation of the AOD to PM_2.5 relationship with a convolutional neural network. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex | paper
  35. a thumbnail for Revisiting Near/Remote Sensing with Geospatial Attention
    Workman S, Rafique MU, Blanton H, Jacobs N. 2022. Revisiting Near/Remote Sensing with Geospatial Attention. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR52688.2022.00182.
    bibtex | paper | doi | tweet
  36. a thumbnail for Content-Based Detection of Temporal Metadata Manipulation
    Padilha R, Salem T, Workman S, Andaló FA, Rocha A, Jacobs N. 2022. Content-Based Detection of Temporal Metadata Manipulation. IEEE Transactions on Information Forensics and Security:1316–1327. DOI: 10.1109/TIFS.2022.3159154.
    bibtex | paper | website | doi | tweet | code
  37. Rafique MU, Zhu J, Jacobs N. 2021. Automatic Segmentation of Sinkholes Using a Convolutional Neural Network. Earth and Space Science:19. DOI: 10.1002/essoar.10509794.1.
    bibtex | paper | doi
  38. Jones D, Jacobs N. 2021. Intensity Harmonization for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9553605.
    bibtex | paper | doi
  39. Brodie B, Khanal S, Rafique MU, Greenwell C, Jacobs N. 2021. Hierarchical Probabilistic Embeddings for Multi-View Image Classification. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9554405.
    bibtex | paper | doi
  40. Tuia D, Roscher R, Wegner JD, Jacobs N, Zhu XX, Camps-Valls G. 2021. Towards a Collective Agenda on AI for Earth Science Data Analysis. IEEE Geoscience and Remote Sensing Magazine 9:88–104. DOI: 10.1109/MGRS.2020.3043504.
    bibtex | paper | doi
  41. Chen M, Hadzic A, Song W, Jacobs N. 2021. Applications of Deep Machine Learning to Highway Safety and Usage Assessment. In: Transportation Research Board Workshop (Sponsored by AED50).
    bibtex
  42. Hadzic A, Christie G, Freeman J, Dismer A, Bullard S, Greiner A, Jacobs N, Mukherjee R. 2020. Estimating Displaced Populations from Overhead. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9324617.
    bibtex | paper | doi | tweet
  43. Zhu J, Nolte A, Jacobs N, Ye M. 2020. Machine Learning in Identifying Karst Sinkholes from LiDAR-Derived Topographic Depressions in the Bluegrass Region of Kentucky. Journal of Hydrology. DOI: 10.1016/j.jhydrol.2020.125049.
    bibtex | doi
  44. a thumbnail for Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest
    Maretto RV, Fonseca LMG, Jacobs NB, Körting TS, Bendini HN, Parente LL. 2020. Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest. IEEE Geoscience and Remote Sensing Letters 18:771–775. DOI: 10.1109/LGRS.2020.2986407.
    bibtex | paper | doi
  45. Workman S, Rafique MU, Blanton H, Greenwell C, Jacobs N. 2020. Single Image Cloud Detection via Multi-Image Fusion. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323759.
    bibtex | paper | doi | tweet
  46. Hadzic A, Blanton H, Song W, Chen M, Workman S, Jacobs N. 2020. RasterNet: Modeling Free-Flow Speed using LiDAR and Overhead Imagery. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW50498.2020.00112.
    bibtex | paper | website | doi | tweet
  47. a thumbnail for Learning a Dynamic Map of Visual Appearance
    Salem T, Workman S, Jacobs N. 2020. Learning a Dynamic Map of Visual Appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01245.
    bibtex | paper | website | doi | tweet
  48. a thumbnail for Dynamic Traffic Modeling from Overhead Imagery
    Workman S, Jacobs N. 2020. Dynamic Traffic Modeling from Overhead Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01233.
    bibtex | paper | website | doi | tweet
  49. Blanton H, Grate S, Jacobs N. 2020. Surface Modeling for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323522.
    bibtex | paper | doi | tweet
  50. a thumbnail for Deep Learning for Conifer/Deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees
    Hamraz H, Jacobs NB, Contreras MA, Clark CH. 2019. Deep Learning for Conifer/Deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees. ISPRS Journal of Photogrammetry and Remote Sensing 158:219–230. DOI: 10.1016/j.isprsjprs.2019.10.011.
    bibtex | paper | doi
  51. Rafique MU, Jacobs N. 2019. Weakly Supervised Building Segmentation from Aerial Images. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8898812.
    bibtex | paper | doi
  52. Greenwell C, Workman S, Jacobs N. 2019. Implicit Land Use Mapping Using Social Media Imagery. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR47015.2019.9174570.
    bibtex | paper | doi
  53. Zhu J, Nolte AM, Jacobs N, Ye M. 2019. Incorporating Machine Learning with LiDAR for Delineating Sinkholes. In: Kentucky Water Resources Annual Symposium.
    bibtex
  54. Salem T, Greenwell C, Blanton H, Jacobs N. 2019. Learning to Map Nearly Anything. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900646.
    bibtex | paper | doi
  55. a thumbnail for Remote Estimation of Free-Flow Speeds
    Song W, Salem T, Blanton H, Jacobs N. 2019. Remote Estimation of Free-Flow Speeds. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900286.
    bibtex | paper | doi | tweet
  56. Rafique MU, Blanton H, Jacobs N. 2019. Weakly Supervised Fusion of Multiple Overhead Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW.2019.00189.
    bibtex | paper | doi | tweet
  57. Greenwell C, Workman S, Jacobs N. 2018. What Goes Where: Predicting Object Distributions from Above. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8519251.
    bibtex | paper | website | doi
  58. a thumbnail for A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery
    Jacobs N, Kraft A, Rafique MU, Sharma RD. 2018. A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery. In: ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL). DOI: 10.1145/3274895.3274934.
    bibtex | paper | doi | tweet | code
  59. a thumbnail for A Multimodal Approach to Mapping Soundscapes
    Salem T, Zhai M, Workman S, Jacobs N. 2018. A Multimodal Approach to Mapping Soundscapes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8517977.
    bibtex | paper | website | doi
  60. a thumbnail for Understanding and Mapping Natural Beauty
    Workman S, Souvenir R, Jacobs N. 2017. Understanding and Mapping Natural Beauty. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.596.
    bibtex | paper | website | doi
  61. a thumbnail for A Unified Model for Near and Remote Sensing
    Workman S, Zhai M, Crandall D, Jacobs N. 2017. A Unified Model for Near and Remote Sensing. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.293.
    bibtex | paper | website | doi
  62. a thumbnail for Predicting Ground-Level Scene Layout from Aerial Imagery
    Zhai M, Bessinger Z, Workman S, Jacobs N. 2017. Predicting Ground-Level Scene Layout from Aerial Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR.2017.440.
    bibtex | paper | doi | tweet | code
  63. a thumbnail for Cloudmaps from Static Ground-View Video
    Jacobs N, Workman S, Souvenir R. 2016. Cloudmaps from Static Ground-View Video. Image and Vision Computing (IVC) 52:154–166. DOI: 10.1016/j.imavis.2016.05.013.
    bibtex | paper | website | doi
  64. Jacobs N, Workman S, Zhai M. 2016. Crossview Convolutional Networks. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR.2016.8010593.
    bibtex | paper | doi
  65. a thumbnail for Wide-Area Image Geolocalization with Aerial Reference Imagery
    Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
    bibtex | paper | website | doi | code
  66. a thumbnail for Building Dynamic Cloud Maps from the Ground Up
    Murdock C, Jacobs N, Pless R. 2015. Building Dynamic Cloud Maps from the Ground Up. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.85.
    bibtex | paper | doi
  67. Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
    bibtex | paper | doi
  68. Baltenberger R, Knochelman J, Workman S, Islam MT, Jacobs N, Griffioen J. 2013. Constructing a High-Resolution Mosaic of Kentucky Lake. In: Kentucky GIS Conference.
    bibtex
  69. Murdock C, Jacobs N, Pless R. 2013. Webcam2Satellite: Estimating Cloud Maps from Webcam Imagery. In: IEEE Workshop on Applications of Computer Vision (WACV). 214–221. DOI: 10.1109/WACV.2013.6475021.
    bibtex | paper | doi
  70. Workman S, Knochelmann J, Jacobs N, White DS, Hauer R. 2012. Registration and Visualization of Scientific Aerial Imagery at Kentucky Lake. In: Kentucky EPSCoR Conference.
    bibtex
  71. Welty E, Pfeffer T, O’Neel S, Jacobs N. 2012. Calving Dynamics of the Columbia Glacier, AK (2000-2011 Update). In: Workshop on the Dynamics and Mass Budget of Arctic Glaciers.
    bibtex
  72. Jacobs N. 2010. Discovering, Localizing, Calibrating, and Using Thousands of Outdoor Webcams. Computer Science and Engineering, Washington University in St. Louis, MO, USA.
    bibtex | paper