Multimodal Vision Research Laboratory

MVRL

research area: social media

See below for a list of our publications in this area. You can see an unfiltered list of our publications or lists filtered for the following research areas: astronomical imagery and data; camera calibration; LiDAR Processing; image localization; medical and biological imaging; image motion; remote sensing and mapping; social media; video surveillance and object tracking; timelapse imaging; transportation; and outdoor webcam imagery.

publications

  1. Dhakal A, Ahmad A, Khanal S, Sastry S, Kerner H, Jacobs N. 2024. Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Images. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION).
    bibtex | paper | linkedin
  2. Khanal S, Sastry S, Dhakal A, Jacobs N. 2023. Learning Tri-modal Embeddings for Zero-Shot Soundscape Mapping. In: British Machine Vision Conference (BMVC).
    bibtex | paper | press release | linkedin | code
  3. Zhu XX, Wang Y, Kochupillai M, Werner M, Haberle M, Hoffmann EJ, Taubenbock H, Tuia D, Levering A, Jacobs N, Kruspe A, Abdulahhad K. 2022. Geoinformation Harvesting From Social Media Data: A community remote sensing approach. IEEE Geoscience and Remote Sensing Magazine 10:150–180. DOI: 10.1109/MGRS.2022.3219584.
    bibtex | paper | doi
  4. a thumbnail for Revisiting Near/Remote Sensing with Geospatial Attention
    Workman S, Rafique MU, Blanton H, Jacobs N. 2022. Revisiting Near/Remote Sensing with Geospatial Attention. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR52688.2022.00182.
    bibtex | paper | doi | tweet
  5. a thumbnail for Content-Based Detection of Temporal Metadata Manipulation
    Padilha R, Salem T, Workman S, Andaló FA, Rocha A, Jacobs N. 2022. Content-Based Detection of Temporal Metadata Manipulation. IEEE Transactions on Information Forensics and Security:1316–1327. DOI: 10.1109/TIFS.2022.3159154.
    bibtex | paper | website | doi | tweet | code
  6. Tuia D, Roscher R, Wegner JD, Jacobs N, Zhu XX, Camps-Valls G. 2021. Towards a Collective Agenda on AI for Earth Science Data Analysis. IEEE Geoscience and Remote Sensing Magazine 9:88–104. DOI: 10.1109/MGRS.2020.3043504.
    bibtex | paper | doi
  7. a thumbnail for Learning a Dynamic Map of Visual Appearance
    Salem T, Workman S, Jacobs N. 2020. Learning a Dynamic Map of Visual Appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01245.
    bibtex | paper | website | doi | tweet
  8. Greenwell C, Workman S, Jacobs N. 2019. Implicit Land Use Mapping Using Social Media Imagery. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR47015.2019.9174570.
    bibtex | paper | doi
  9. Salem T, Greenwell C, Blanton H, Jacobs N. 2019. Learning to Map Nearly Anything. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900646.
    bibtex | paper | doi
  10. Bessinger Z, Jacobs N. 2019. A Generative Model of Worldwide Facial Appearance. In: IEEE Winter Conference on Applications of Computer Vision (WACV). DOI: 10.1109/WACV.2019.00172.
    bibtex | paper | website | doi
  11. a thumbnail for Learning Geo-Temporal Image Features
    Zhai M, Salem T, Greenwell C, Workman S, Pless R, Jacobs N. 2018. Learning Geo-Temporal Image Features. In: British Machine Vision Conference (BMVC).
    bibtex | paper
  12. Greenwell C, Workman S, Jacobs N. 2018. What Goes Where: Predicting Object Distributions from Above. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8519251.
    bibtex | paper | website | doi
  13. a thumbnail for A Multimodal Approach to Mapping Soundscapes
    Salem T, Zhai M, Workman S, Jacobs N. 2018. A Multimodal Approach to Mapping Soundscapes. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2018.8517977.
    bibtex | paper | website | doi
  14. a thumbnail for A Unified Model for Near and Remote Sensing
    Workman S, Zhai M, Crandall D, Jacobs N. 2017. A Unified Model for Near and Remote Sensing. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.293.
    bibtex | paper | website | doi
  15. Vo N, Jacobs N, Hays J. 2017. Revisiting IM2GPS in the Deep Learning Era. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.286.
    bibtex | paper | website | doi
  16. a thumbnail for Understanding and Mapping Natural Beauty
    Workman S, Souvenir R, Jacobs N. 2017. Understanding and Mapping Natural Beauty. In: IEEE International Conference on Computer Vision (ICCV). DOI: 10.1109/ICCV.2017.596.
    bibtex | paper | website | doi
  17. Salem T, Workman S, Zhai M, Jacobs N. 2016. Analyzing Human Appearance as a Cue for Dating Images. In: IEEE Winter Conference on Applications of Computer Vision (WACV). 1–8. DOI: 10.1109/WACV.2016.7477678.
    bibtex | paper | website | doi
  18. Jacobs N, Workman S, Zhai M. 2016. Crossview Convolutional Networks. In: IEEE Applied Imagery and Pattern Recognition (AIPR). DOI: 10.1109/AIPR.2016.8010593.
    bibtex | paper | doi
  19. Bessinger Z, Stauffer C, Jacobs N. 2016. Who Goes There? Approaches to Mapping Facial Appearance Diversity. In: ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL). DOI: 10.1145/2996913.2996997.
    bibtex | paper | doi
  20. a thumbnail for Large-Scale Geo-Facial Image Analysis
    Islam MT, Greenwell C, Souvenir R, Jacobs N. 2015. Large-Scale Geo-Facial Image Analysis. EURASIP Journal on Image and Video Processing (JIVP) 2015:1–14. DOI: 10.1186/s13640-015-0070-9.
    bibtex | paper | website | doi
  21. Workman S, Greenwell C, Zhai M, Baltenberger R, Jacobs N. 2015. DeepFocal: A Method for Direct Focal Length Estimation. In: IEEE International Conference on Image Processing (ICIP). DOI: 10.1109/ICIP.2015.7351024.
    bibtex | paper | website | doi
  22. a thumbnail for Wide-Area Image Geolocalization with Aerial Reference Imagery
    Workman S, Souvenir R, Jacobs N. 2015. Wide-Area Image Geolocalization with Aerial Reference Imagery. In: IEEE International Conference on Computer Vision (ICCV). 1–9. DOI: 10.1109/ICCV.2015.451.
    bibtex | paper | website | doi | code
  23. Islam MT, Workman S, Jacobs N. 2015. Face2GPS: Estimating Geographic Location from Facial Features. In: IEEE International Conference on Image Processing (ICIP). DOI: 10.1109/ICIP.2015.7351072.
    bibtex | paper | website | doi
  24. Workman S, Jacobs N. 2015. On the Location Dependence of Convolutional Neural Network Features. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). 1–9. DOI: 10.1109/CVPRW.2015.7301385.
    bibtex | paper | doi
  25. Greenwell C, Spurlock S, Souvenir R, Jacobs N. 2014. GeoFaceExplorer: Exploring the Geo-Dependence of Facial Attributes. In: ACM SIGSPATIAL International Workshop on Crowdsourced and Volunteered Geographic Information (GEOCROWD). 32–37. DOI: 10.1145/2676440.2676443.
    bibtex | paper | website | doi
  26. Islam MT, Workman S, Wu H, Souvenir R, Jacobs N. 2014. Exploring the Geo-Dependence of Human Face Appearance. In: IEEE Winter Conference on Applications of Computer Vision (WACV). 1042–1049. DOI: 10.1109/WACV.2014.6835989.
    bibtex | paper | doi
  27. Milliman T, Hufkins K, Lavine I, Jacobs N, Pless R, Richardson A, Frolking S. 2011. The PhenoCam Website: Adventures in “Crowd-Sourcing” Data Collection, Distribution and Analysis. In: American Geophysical Union Annual Meeting.
    bibtex
  28. Jacobs N. 2010. Discovering, Localizing, Calibrating, and Using Thousands of Outdoor Webcams. Computer Science and Engineering, Washington University in St. Louis, MO, USA.
    bibtex | paper
  29. a thumbnail for The Global Network of Outdoor Webcams: Properties and Applications
    Jacobs N, Burgin W, Fridrich N, Abrams A, Miskell K, Braswell BH, Richardson AD, Pless R. 2009. The Global Network of Outdoor Webcams: Properties and Applications. In: ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL). 111–120. DOI: 10.1145/1653771.1653789.
    bibtex | paper | doi