Multimodal Vision Research Laboratory

MVRL

research area: remote sensing and mapping

See below for a list of our publications in this area. You can see an unfiltered list of our publications or lists filtered for the following research areas: astronomical imagery and data; camera calibration; LiDAR Processing; image localization; medical and biological imaging; image motion; remote sensing and mapping; social media; video surveillance and object tracking; timelapse imaging; transportation; and outdoor webcam imagery.

publications

  1. a thumbnail for GOMAA-Geo: GOal Modality Agnostic Active Geo-localization
    Sarkar A, Sastry S, Pirinen A, Zhang C, Jacobs N, Vorobeychik Y. 2024. GOMAA-Geo: GOal Modality Agnostic Active Geo-localization. In: Neural Information Processing Systems (NeurIPS).
    bibtex | paper | code
  2. a thumbnail for PSM: Learning Probabilistic Embeddings for Multi-scale Zero-shot Soundscape Mapping
    Khanal S, Xing E, Sastry S, Dhakal A, Xiong Z, Ahmad A, Jacobs N. 2024. PSM: Learning Probabilistic Embeddings for Multi-scale Zero-shot Soundscape Mapping. In: ACM Multimedia.
    bibtex | paper
  3. Jain P, Marcos D, Ienco D, Interdonato R, Dhakal A, Jacobs N, Berchoux T. 2024. Aligning Geo-Tagged CLIP Representations and Satellite Imagery for Few-Shot Land Use Classification. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  4. Xiong Z, Xing X, Workman S, Khanal S, Jacobs N. 2024. Mixed-View Panorama Synthesis using Geospatially Guided Diffusion.
    bibtex | paper
  5. Dhakal A, Khanal S, Sastry S, Ahmad A, Jacobs N. 2024. GeoBind: Binding text, image, and audio through satellite images. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex | paper
  6. Sastry S, Khanal S, Dhakal A, Jacobs N. 2024. GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION).
    bibtex | paper
  7. Dhakal A, Ahmad A, Khanal S, Sastry S, Kerner H, Jacobs N. 2024. Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION).
    bibtex | paper
  8. Sarkar A, DiChristofano A, Das S, Fowler P, Jacobs N, Vorobeychik Y. 2024. Geospatial Active Search for Preventing Evictions. In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS).
    bibtex
  9. Shen S, Li C, Donkelaar A van, Jacobs N, Wang C, Martin RV. 2024. Enhancing Global Estimation of Fine Particulate Matter Concentrations by Including Geophysical a Priori Information in Deep Learning. ACS ES&T Air. DOI: 10.1021/acsestair.3c00054.
    bibtex | paper | doi
  10. a thumbnail for BirdSat: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping
    Sastry S, Khanal S, Dhakal A, Huang D, Jacobs N. 2024. BirdSat: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | press release | linkedin | code
  11. Sarkar A, Lanier M, Alfeld S, Feng J, Garnett R, Jacobs N, Vorobeychik Y. 2024. A Visual Active Search Framework for Geospatial Exploration. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | press release | code
  12. a thumbnail for WATCH: Wide-Area Terrestrial Change Hypercube
    Greenwell C, Leotta M, Crall J, Jacobs N, Purri M, Dana K, Hadzic A, Workman S. 2024. WATCH: Wide-Area Terrestrial Change Hypercube. In: IEEE Winter Conference on Applications of Computer Vision (WACV).
    bibtex | paper | code
  13. Levering A, Marcos D, Jacobs N, Tuia D. 2024. Prompt-guided and multimodal landscape scenicness assessments with vision-language models. PLOS ONE.
    bibtex
  14. a thumbnail for A Partially-Supervised Reinforcement Learning Framework for Visual Active Search
    Sarkar A, Jacobs N, Vorobeychik Y. 2023. A Partially-Supervised Reinforcement Learning Framework for Visual Active Search. In: Neural Information Processing Systems (NeurIPS).
    bibtex | paper | press release | code
  15. Liang G, Zulu J, Xing X, Jacobs N. 2023. Unveiling Roadway Hazards: Enhancing Fatal Crash Risk Estimation through Multi-Scale Satellite Imagery and Self-Supervised Cross-Matching. Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS). DOI: 10.1109/JSTARS.2023.3331438.
    bibtex | paper | doi
  16. Khanal S, Sastry S, Dhakal A, Jacobs N. 2023. Learning Tri-modal Embeddings for Zero-Shot Soundscape Mapping. In: British Machine Vision Conference (BMVC).
    bibtex | paper | press release | linkedin | code
  17. Brodie B, Sastry S, Birge J, Pless R, Jacobs N. 2023. A Cost-sensitive Approach to Dimensionality Reduction for Multispectral Imagery. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  18. Sastry S, Jacobs N, Belgiu M, Maretto RV. 2023. Task Agnostic Cost Prediction Module for Semantic Labeling in Active Learning. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  19. Sastry S, Dhakal A, Brodie B, Khanal S, Jacobs N. 2023. Explorations in Self-supervised Learning for Change Detection. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  20. Archbold C, Brodie B, Ogholbake AA, Jacobs N. 2023. Fine-grained Property Value Assessment Using Probabilistic Disaggregation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex | paper
  21. Zhang Y, Rafique MU, Christie G, Jacobs N. 2023. CrossAdapt: Cross-scene Adaptation for Multi-domain Depth Estimation. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  22. Zhang Y, Rafique MU, Jacobs N. 2023. CrossSeg: Cross-scene Few-shot Aerial Segmentation Using Probabilistic Prototypes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS).
    bibtex
  23. Shen S, Donkelaar A van, Martin RV, Jacobs N, Wang C. 2022. Improving representation of the AOD to PM_2.5 relationship with a convolutional neural network. In: American Geophysical Union (AGU) Fall Meeting Abstracts.
    bibtex | paper
  24. Zhu XX, Wang Y, Kochupillai M, Werner M, Haberle M, Hoffmann EJ, Taubenbock H, Tuia D, Levering A, Jacobs N, Kruspe A, Abdulahhad K. 2022. Geoinformation Harvesting From Social Media Data: A community remote sensing approach. IEEE Geoscience and Remote Sensing Magazine 10:150–180. DOI: 10.1109/MGRS.2022.3219584.
    bibtex | paper | doi
  25. a thumbnail for Revisiting Near/Remote Sensing with Geospatial Attention
    Workman S, Rafique MU, Blanton H, Jacobs N. 2022. Revisiting Near/Remote Sensing with Geospatial Attention. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR52688.2022.00182.
    bibtex | paper | doi | tweet
  26. a thumbnail for Content-Based Detection of Temporal Metadata Manipulation
    Padilha R, Salem T, Workman S, Andaló FA, Rocha A, Jacobs N. 2022. Content-Based Detection of Temporal Metadata Manipulation. IEEE Transactions on Information Forensics and Security:1316–1327. DOI: 10.1109/TIFS.2022.3159154.
    bibtex | paper | website | doi | tweet | code
  27. Rafique MU, Zhu J, Jacobs N. 2021. Automatic Segmentation of Sinkholes Using a Convolutional Neural Network. Earth and Space Science:19. DOI: 10.1002/essoar.10509794.1.
    bibtex | paper | doi
  28. Jones D, Jacobs N. 2021. Intensity Harmonization for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9553605.
    bibtex | paper | doi
  29. Brodie B, Khanal S, Rafique MU, Greenwell C, Jacobs N. 2021. Hierarchical Probabilistic Embeddings for Multi-View Image Classification. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS47720.2021.9554405.
    bibtex | paper | doi
  30. Tuia D, Roscher R, Wegner JD, Jacobs N, Zhu XX, Camps-Valls G. 2021. Towards a Collective Agenda on AI for Earth Science Data Analysis. IEEE Geoscience and Remote Sensing Magazine 9:88–104. DOI: 10.1109/MGRS.2020.3043504.
    bibtex | paper | doi
  31. Chen M, Hadzic A, Song W, Jacobs N. 2021. Applications of Deep Machine Learning to Highway Safety and Usage Assessment. In: Transportation Research Board Workshop (Sponsored by AED50).
    bibtex
  32. Zhu J, Nolte A, Jacobs N, Ye M. 2020. Machine Learning in Identifying Karst Sinkholes from LiDAR-Derived Topographic Depressions in the Bluegrass Region of Kentucky. Journal of Hydrology. DOI: 10.1016/j.jhydrol.2020.125049.
    bibtex | doi
  33. Hadzic A, Christie G, Freeman J, Dismer A, Bullard S, Greiner A, Jacobs N, Mukherjee R. 2020. Estimating Displaced Populations from Overhead. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9324617.
    bibtex | paper | doi | tweet
  34. a thumbnail for Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest
    Maretto RV, Fonseca LMG, Jacobs NB, Körting TS, Bendini HN, Parente LL. 2020. Spatio-Temporal Deep Learning Approach to Map Deforestation in Amazon Rainforest. IEEE Geoscience and Remote Sensing Letters 18:771–775. DOI: 10.1109/LGRS.2020.2986407.
    bibtex | paper | doi
  35. Hadzic A, Blanton H, Song W, Chen M, Workman S, Jacobs N. 2020. RasterNet: Modeling Free-Flow Speed using LiDAR and Overhead Imagery. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW50498.2020.00112.
    bibtex | paper | website | doi | tweet
  36. a thumbnail for Learning a Dynamic Map of Visual Appearance
    Salem T, Workman S, Jacobs N. 2020. Learning a Dynamic Map of Visual Appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01245.
    bibtex | paper | website | doi | tweet
  37. a thumbnail for Dynamic Traffic Modeling from Overhead Imagery
    Workman S, Jacobs N. 2020. Dynamic Traffic Modeling from Overhead Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01233.
    bibtex | paper | website | doi | tweet
  38. Workman S, Rafique MU, Blanton H, Greenwell C, Jacobs N. 2020. Single Image Cloud Detection via Multi-Image Fusion. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323759.
    bibtex | paper | doi | tweet
  39. Blanton H, Grate S, Jacobs N. 2020. Surface Modeling for Airborne LiDAR. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS39084.2020.9323522.
    bibtex | paper | doi | tweet
  40. a thumbnail for Deep Learning for Conifer/Deciduous Classification of
    Airborne LiDAR 3D Point Clouds Representing Individual Trees
    Hamraz H, Jacobs NB, Contreras MA, Clark CH. 2019. Deep Learning for Conifer/Deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees. ISPRS Journal of Photogrammetry and Remote Sensing 158:219–230. DOI: 10.1016/j.isprsjprs.2019.10.011.
    bibtex | paper | doi
  41. Rafique MU, Blanton H, Jacobs N. 2019. Weakly Supervised Fusion of Multiple Overhead Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW.2019.00189.
    bibtex | paper | doi | tweet
  42. Greenwell C, Workman S, Jacobs N. 2019. Implicit Land Use Mapping Using Social Media Imagery. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR47015.2019.9174570.
    bibtex | paper | doi
  43. Zhu J, Nolte AM, Jacobs N, Ye M. 2019. Incorporating Machine Learning with LiDAR for Delineating Sinkholes. In: Kentucky Water Resources Annual Symposium.
    bibtex
  44. Salem T, Greenwell C, Blanton H, Jacobs N. 2019. Learning to Map Nearly Anything. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900646.
    bibtex | paper | doi
  45. a thumbnail for Remote Estimation of Free-Flow Speeds
    Song W, Salem T, Blanton H, Jacobs N. 2019. Remote Estimation of Free-Flow Speeds. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900286.
    bibtex | paper | doi | tweet
  46. Rafique MU, Jacobs N. 2019. Weakly Supervised Building Segmentation from Aerial Images. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8898812.
    bibtex | paper | doi
  47. Greenwell C, Workman S, Jacobs N. 2018. What Goes Where: Predicting Object Distributions from Above. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8519251.
    bibtex | paper | website | doi
  48. a thumbnail for A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery
    Jacobs N, Kraft A, Rafique MU, Sharma RD. 2018. A Weakly Supervised Approach for Estimating Spatial Density Functions from High-Resolution Satellite Imagery. In: ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL). DOI: 10.1145/3274895.3274934.
    bibtex | paper | doi | tweet | code
  49. a thumbnail for A Multimodal Approach to Mapping Soundscapes
    Salem T, Zhai M, Workman S, Jacobs N. 2018. A Multimodal Approach to Mapping Soundscapes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8517977.
    bibtex | paper | website | doi
  50. a thumbnail for Understanding and Mapping Natural Beauty
    Workman S, Souvenir R, Jacobs N. 2017. Understanding and Mapping Natural Beauty. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.596.
    bibtex | paper | website | doi
  51. a thumbnail for A Unified Model for Near and Remote Sensing
    Workman S, Zhai M, Crandall D, Jacobs N. 2017. A Unified Model for Near and Remote Sensing. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.293.
    bibtex | paper | website | doi
  52. a thumbnail for Predicting Ground-Level Scene Layout from Aerial Imagery
    Zhai M, Bessinger Z, Workman S, Jacobs N. 2017. Predicting Ground-Level Scene Layout from Aerial Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR.2017.440.
    bibtex | paper | doi | tweet | code
  53. a thumbnail for Cloudmaps from Static Ground-View Video
    Jacobs N, Workman S, Souvenir R. 2016. Cloudmaps from Static Ground-View Video. Image and Vision Computing (IVC) 52:154–166. DOI: 10.1016/j.imavis.2016.05.013.
    bibtex | paper | website | doi
  54. Jacobs N, Workman S, Zhai M. 2016. Crossview Convolutional Networks. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR.2016.8010593.
    bibtex | paper | doi
  55. a thumbnail for Building Dynamic Cloud Maps from the Ground Up
    Murdock C, Jacobs N, Pless R. 2015. Building Dynamic Cloud Maps from the Ground Up. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.85.
    bibtex | paper | doi
  56. a thumbnail for Wide-Area Image Geolocalization with Aerial Reference Imagery
    Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
    bibtex | paper | website | doi | code
  57. Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
    bibtex | paper | doi
  58. Baltenberger R, Knochelman J, Workman S, Islam MT, Jacobs N, Griffioen J. 2013. Constructing a High-Resolution Mosaic of Kentucky Lake. In: Kentucky GIS Conference.
    bibtex
  59. Murdock C, Jacobs N, Pless R. 2013. Webcam2Satellite: Estimating Cloud Maps from Webcam Imagery. In: IEEE Workshop on Applications of Computer Vision (WACV). 214–221. DOI: 10.1109/WACV.2013.6475021.
    bibtex | paper | doi
  60. Workman S, Knochelmann J, Jacobs N, White DS, Hauer R. 2012. Registration and Visualization of Scientific Aerial Imagery at Kentucky Lake. In: Kentucky EPSCoR Conference.
    bibtex
  61. Welty E, Pfeffer T, O’Neel S, Jacobs N. 2012. Calving Dynamics of the Columbia Glacier, AK (2000-2011 Update). In: Workshop on the Dynamics and Mass Budget of Arctic Glaciers.
    bibtex
  62. Jacobs N. 2010. Discovering, Localizing, Calibrating, and Using Thousands of Outdoor Webcams. Computer Science and Engineering, Washington University in St. Louis, MO, USA.
    bibtex | paper