Multimodal Vision Research Laboratory

MVRL

research area: remote sensing and mapping

See below for a list of our publications in this area. You can see an unfiltered list of our publications or lists filtered for the following research areas: astronomical imagery and data; camera calibration; LiDAR Processing; image localization; medical and biological imaging; image motion; remote sensing and mapping; social media; video surveillance and object tracking; timelapse imaging; transportation; and outdoor webcam imagery.

publications

  1. a thumbnail for TaxaBind: A Unified Embedding Space for Ecological Applications
    Sastry S, Khanal S, Dhakal A, Ahmad A, Jacobs N. 2025. TaxaBind: A Unified Embedding Space for Ecological Applications. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | website | code
  2. a thumbnail for GOMAA-Geo: GOal Modality Agnostic Active Geo-localization
    Sarkar A, Sastry S, Pirinen A, Zhang C, Jacobs N, Vorobeychik Y. 2024. GOMAA-Geo: GOal Modality Agnostic Active Geo-localization. In: Neural Information Processing Systems (NeurIPS).
    bibtex | paper | linkedin | code
  3. a thumbnail for PSM: Learning Probabilistic Embeddings for Multi-scale Zero-shot Soundscape Mapping
    Khanal S, Xing E, Sastry S, Dhakal A, Xiong Z, Ahmad A, Jacobs N. 2024. PSM: Learning Probabilistic Embeddings for Multi-scale Zero-shot Soundscape Mapping. In: ACM Multimedia. DOI: 10.1145/3664647.3681620.
    bibtex | paper | doi | linkedin
  4. Xiong Z, Xing X, Workman S, Khanal S, Jacobs N. 2024. Mixed-View Panorama Synthesis using Geospatially Guided Diffusion.
    bibtex | paper
  5. Dhakal A, Khanal S, Sastry S, Ahmad A, Jacobs N. 2024. GeoBind: Binding text, image, and audio through satellite images. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex | paper
  6. Jain P, Marcos D, Ienco D, Interdonato R, Dhakal A, Jacobs N, Berchoux T. 2024. Aligning Geo-Tagged CLIP Representations and Satellite Imagery for Few-Shot Land Use Classification. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  7. Dhakal A, Ahmad A, Khanal S, Sastry S, Kerner H, Jacobs N. 2024. Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION).
    bibtex | paper | linkedin
  8. Sastry S, Khanal S, Dhakal A, Jacobs N. 2024. GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION).
    bibtex | paper
  9. Sarkar A, DiChristofano A, Das S, Fowler P, Jacobs N, Vorobeychik Y. 2024. Geospatial Active Search for Preventing Evictions. In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS).
    bibtex
  10. Shen S, Li C, Donkelaar A van, Jacobs N, Wang C, Martin RV. 2024. Enhancing Global Estimation of Fine Particulate Matter Concentrations by Including Geophysical a Priori Information in Deep Learning. ACS ES&T Air. DOI: 10.1021/acsestair.3c00054.
    bibtex | paper | doi | linkedin
  11. a thumbnail for BirdSat: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping
    Sastry S, Khanal S, Dhakal A, Huang D, Jacobs N. 2024. BirdSat: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | press release | linkedin | code
  12. a thumbnail for WATCH: Wide-Area Terrestrial Change Hypercube
    Greenwell C, Leotta M, Crall J, Jacobs N, Purri M, Dana K, Hadzic A, Workman S. 2024. WATCH: Wide-Area Terrestrial Change Hypercube. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | code
  13. Sarkar A, Lanier M, Alfeld S, Feng J, Garnett R, Jacobs N, Vorobeychik Y. 2024. A Visual Active Search Framework for Geospatial Exploration. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | press release | code
  14. Levering A, Marcos D, Jacobs N, Tuia D. 2024. Prompt-guided and multimodal landscape scenicness assessments with vision-language models. PLOS ONE.
    bibtex
  15. a thumbnail for A Partially-Supervised Reinforcement Learning Framework for Visual Active Search
    Sarkar A, Jacobs N, Vorobeychik Y. 2023. A Partially-Supervised Reinforcement Learning Framework for Visual Active Search. In: Neural Information Processing Systems (NeurIPS).
    bibtex | paper | press release | code
  16. Khanal S, Sastry S, Dhakal A, Jacobs N. 2023. Learning Tri-modal Embeddings for Zero-Shot Soundscape Mapping. In: British Machine Vision Conference (BMVC).
    bibtex | paper | press release | linkedin | code
  17. Liang G, Zulu J, Xing X, Jacobs N. 2023. Unveiling Roadway Hazards: Enhancing Fatal Crash Risk Estimation through Multi-Scale Satellite Imagery and Self-Supervised Cross-Matching. Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS). DOI: 10.1109/JSTARS.2023.3331438.
    bibtex | paper | doi
  18. Brodie B, Sastry S, Birge J, Pless R, Jacobs N. 2023. A Cost-sensitive Approach to Dimensionality Reduction for Multispectral Imagery. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  19. Sastry S, Jacobs N, Belgiu M, Maretto RV. 2023. Task Agnostic Cost Prediction Module for Semantic Labeling in Active Learning. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  20. Sastry S, Dhakal A, Brodie B, Khanal S, Jacobs N. 2023. Explorations in Self-supervised Learning for Change Detection. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  21. Archbold C, Brodie B, Ogholbake AA, Jacobs N. 2023. Fine-grained Property Value Assessment Using Probabilistic Disaggregation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex | paper
  22. Zhang Y, Rafique MU, Christie G, Jacobs N. 2023. CrossAdapt: Cross-scene Adaptation for Multi-domain Depth Estimation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  23. Zhang Y, Rafique MU, Jacobs N. 2023. CrossSeg: Cross-scene Few-shot Aerial Segmentation Using Probabilistic Prototypes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  24. Shen S, Donkelaar A van, Martin RV, Jacobs N, Wang C. 2022. Improving representation of the AOD to PM_2.5 relationship with a convolutional neural network. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex | paper
  25. Zhu XX, Wang Y, Kochupillai M, Werner M, Haberle M, Hoffmann EJ, Taubenbock H, Tuia D, Levering A, Jacobs N, Kruspe A, Abdulahhad K. 2022. Geoinformation Harvesting From Social Media Data: A community remote sensing approach. IEEE Geoscience and Remote Sensing Magazine 10:150–180. DOI: 10.1109/MGRS.2022.3219584.
    bibtex | paper | doi
  26. a thumbnail for Revisiting Near/Remote Sensing with Geospatial Attention
    Workman S, Rafique MU, Blanton H, Jacobs N. 2022. Revisiting Near/Remote Sensing with Geospatial Attention. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR52688.2022.00182.
    bibtex | paper | doi | tweet
  27. a thumbnail for Content-Based Detection of Temporal Metadata Manipulation
    Padilha R, Salem T, Workman S, Andaló FA, Rocha A, Jacobs N. 2022. Content-Based Detection of Temporal Metadata Manipulation. IEEE Transactions on Information Forensics and Security:1316–1327. DOI: 10.1109/TIFS.2022.3159154.
    bibtex | paper | website | doi | tweet | code
  28. Rafique MU, Zhu J, Jacobs N. 2021. Automatic Segmentation of Sinkholes Using a Convolutional Neural Network. Earth and Space Science:19. DOI: 10.1002/essoar.10509794.1.
    bibtex | paper | doi
  29. Jones D, Jacobs N. 2021. Intensity Harmonization for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9553605.
    bibtex | paper | doi
  30. Brodie B, Khanal S, Rafique MU, Greenwell C, Jacobs N. 2021. Hierarchical Probabilistic Embeddings for Multi-View Image Classification. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9554405.
    bibtex | paper | doi
  31. Tuia D, Roscher R, Wegner JD, Jacobs N, Zhu XX, Camps-Valls G. 2021. Towards a Collective Agenda on AI for Earth Science Data Analysis. IEEE Geoscience and Remote Sensing Magazine 9:88–104. DOI: 10.1109/MGRS.2020.3043504.
    bibtex | paper | doi
  32. Chen M, Hadzic A, Song W, Jacobs N. 2021. Applications of Deep Machine Learning to Highway Safety and Usage Assessment. In: Transportation Research Board Workshop (Sponsored by AED50).
    bibtex
  33. Hadzic A, Christie G, Freeman J, Dismer A, Bullard S, Greiner A, Jacobs N, Mukherjee R. 2020. Estimating Displaced Populations from Overhead. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9324617.
    bibtex | paper | doi | tweet
  34. Zhu J, Nolte A, Jacobs N, Ye M. 2020. Machine Learning in Identifying Karst Sinkholes from LiDAR-Derived Topographic Depressions in the Bluegrass Region of Kentucky. Journal of Hydrology. DOI: 10.1016/j.jhydrol.2020.125049.
    bibtex | doi
  35. a thumbnail for Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest
    Maretto RV, Fonseca LMG, Jacobs NB, Körting TS, Bendini HN, Parente LL. 2020. Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest. IEEE Geoscience and Remote Sensing Letters 18:771–775. DOI: 10.1109/LGRS.2020.2986407.
    bibtex | paper | doi
  36. Workman S, Rafique MU, Blanton H, Greenwell C, Jacobs N. 2020. Single Image Cloud Detection via Multi-Image Fusion. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323759.
    bibtex | paper | doi | tweet
  37. Hadzic A, Blanton H, Song W, Chen M, Workman S, Jacobs N. 2020. RasterNet: Modeling Free-Flow Speed using LiDAR and Overhead Imagery. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW50498.2020.00112.
    bibtex | paper | website | doi | tweet
  38. a thumbnail for Learning a Dynamic Map of Visual Appearance
    Salem T, Workman S, Jacobs N. 2020. Learning a Dynamic Map of Visual Appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01245.
    bibtex | paper | website | doi | tweet
  39. a thumbnail for Dynamic Traffic Modeling from Overhead Imagery
    Workman S, Jacobs N. 2020. Dynamic Traffic Modeling from Overhead Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01233.
    bibtex | paper | website | doi | tweet
  40. Blanton H, Grate S, Jacobs N. 2020. Surface Modeling for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323522.
    bibtex | paper | doi | tweet
  41. a thumbnail for Deep Learning for Conifer/Deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees
    Hamraz H, Jacobs NB, Contreras MA, Clark CH. 2019. Deep Learning for Conifer/Deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees. ISPRS Journal of Photogrammetry and Remote Sensing 158:219–230. DOI: 10.1016/j.isprsjprs.2019.10.011.
    bibtex | paper | doi
  42. Greenwell C, Workman S, Jacobs N. 2019. Implicit Land Use Mapping Using Social Media Imagery. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR47015.2019.9174570.
    bibtex | paper | doi
  43. Zhu J, Nolte AM, Jacobs N, Ye M. 2019. Incorporating Machine Learning with LiDAR for Delineating Sinkholes. In: Kentucky Water Resources Annual Symposium.
    bibtex
  44. Salem T, Greenwell C, Blanton H, Jacobs N. 2019. Learning to Map Nearly Anything. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900646.
    bibtex | paper | doi
  45. a thumbnail for Remote Estimation of Free-Flow Speeds
    Song W, Salem T, Blanton H, Jacobs N. 2019. Remote Estimation of Free-Flow Speeds. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900286.
    bibtex | paper | doi | tweet
  46. Rafique MU, Jacobs N. 2019. Weakly Supervised Building Segmentation from Aerial Images. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8898812.
    bibtex | paper | doi
  47. Rafique MU, Blanton H, Jacobs N. 2019. Weakly Supervised Fusion of Multiple Overhead Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW.2019.00189.
    bibtex | paper | doi | tweet
  48. a thumbnail for A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery
    Jacobs N, Kraft A, Rafique MU, Sharma RD. 2018. A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery. In: ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL). DOI: 10.1145/3274895.3274934.
    bibtex | paper | doi | tweet | code
  49. Greenwell C, Workman S, Jacobs N. 2018. What Goes Where: Predicting Object Distributions from Above. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8519251.
    bibtex | paper | website | doi
  50. a thumbnail for A Multimodal Approach to Mapping Soundscapes
    Salem T, Zhai M, Workman S, Jacobs N. 2018. A Multimodal Approach to Mapping Soundscapes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8517977.
    bibtex | paper | website | doi
  51. a thumbnail for Understanding and Mapping Natural Beauty
    Workman S, Souvenir R, Jacobs N. 2017. Understanding and Mapping Natural Beauty. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.596.
    bibtex | paper | website | doi
  52. a thumbnail for A Unified Model for Near and Remote Sensing
    Workman S, Zhai M, Crandall D, Jacobs N. 2017. A Unified Model for Near and Remote Sensing. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.293.
    bibtex | paper | website | doi
  53. a thumbnail for Predicting Ground-Level Scene Layout from Aerial Imagery
    Zhai M, Bessinger Z, Workman S, Jacobs N. 2017. Predicting Ground-Level Scene Layout from Aerial Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR.2017.440.
    bibtex | paper | doi | tweet | code
  54. a thumbnail for Cloudmaps from Static Ground-View Video
    Jacobs N, Workman S, Souvenir R. 2016. Cloudmaps from Static Ground-View Video. Image and Vision Computing (IVC) 52:154–166. DOI: 10.1016/j.imavis.2016.05.013.
    bibtex | paper | website | doi
  55. Jacobs N, Workman S, Zhai M. 2016. Crossview Convolutional Networks. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR.2016.8010593.
    bibtex | paper | doi
  56. a thumbnail for Building Dynamic Cloud Maps from the Ground Up
    Murdock C, Jacobs N, Pless R. 2015. Building Dynamic Cloud Maps from the Ground Up. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.85.
    bibtex | paper | doi
  57. a thumbnail for Wide-Area Image Geolocalization with Aerial Reference Imagery
    Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
    bibtex | paper | website | doi | code
  58. Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
    bibtex | paper | doi
  59. Baltenberger R, Knochelman J, Workman S, Islam MT, Jacobs N, Griffioen J. 2013. Constructing a High-Resolution Mosaic of Kentucky Lake. In: Kentucky GIS Conference.
    bibtex
  60. Murdock C, Jacobs N, Pless R. 2013. Webcam2Satellite: Estimating Cloud Maps from Webcam Imagery. In: IEEE Workshop on Applications of Computer Vision (WACV). 214–221. DOI: 10.1109/WACV.2013.6475021.
    bibtex | paper | doi
  61. Workman S, Knochelmann J, Jacobs N, White DS, Hauer R. 2012. Registration and Visualization of Scientific Aerial Imagery at Kentucky Lake. In: Kentucky EPSCoR Conference.
    bibtex
  62. Welty E, Pfeffer T, O’Neel S, Jacobs N. 2012. Calving Dynamics of the Columbia Glacier, AK (2000-2011 Update). In: Workshop on the Dynamics and Mass Budget of Arctic Glaciers.
    bibtex
  63. Jacobs N. 2010. Discovering, Localizing, Calibrating, and Using Thousands of Outdoor Webcams. Computer Science and Engineering, Washington University in St. Louis, MO, USA.
    bibtex | paper