Multimodal Vision Research Laboratory

MVRL

Research Area: Transportation

Our transportation research applies computer vision and machine learning to improve roadway safety, traffic modeling, and transportation infrastructure assessment. Recent work includes beta distribution learning for reliable roadway crash risk assessment, omnidirectional depth estimation via stereo matching from multi-cylindrical panoramas (MCPDepth), and multi-scale satellite imagery for fatal crash risk estimation. We also develop methods for dynamic traffic modeling from overhead imagery, remote estimation of free-flow speeds, and fully automated roadway safety assessment (FARSA) using LiDAR and overhead imagery. Our research addresses critical challenges in transportation safety and infrastructure monitoring.

Publications

  1. Xiong Z, Ye X, Yaman B, Cheng S, Lu Y, Luo J, Jacobs N, Ren L. 2026. UniDrive-WM: Unified Understanding, Planning and Generation World Model For Autonomous Driving.
  2. Thumbnail for MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas
    Qiao F, Xiong Z, Zhu X, Ma Y, He Q, Jacobs N. 2024. MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas.
  3. Liang G, Zulu J, Xing X, Jacobs N. 2023. Unveiling Roadway Hazards: Enhancing Fatal Crash Risk Estimation through Multi-Scale Satellite Imagery and Self-Supervised Cross-Matching. Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS). DOI: 10.1109/JSTARS.2023.3331438.
  4. Chen M, Hadzic A, Song W, Jacobs N. 2021. Applications of Deep Machine Learning to Highway Safety and Usage Assessment. In: Transportation Research Board Workshop (Sponsored by AED50).
  5. Hadzic A, Blanton H, Song W, Chen M, Workman S, Jacobs N. 2020. RasterNet: Modeling Free-Flow Speed using LiDAR and Overhead Imagery. In: IEEE/ISPRS Workshop: Large Scale Computer Vision for Remote Sensing (EARTHVISION). DOI: 10.1109/CVPRW50498.2020.00112.
  6. Thumbnail for Dynamic Traffic Modeling from Overhead Imagery
    Workman S, Jacobs N. 2020. Dynamic Traffic Modeling from Overhead Imagery. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.1109/CVPR42600.2020.01233.
  7. Thumbnail for Remote Estimation of Free-Flow Speeds
    Song W, Salem T, Blanton H, Jacobs N. 2019. Remote Estimation of Free-Flow Speeds. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). DOI: 10.1109/IGARSS.2019.8900286.
  8. Thumbnail for Learning to Look around Objects for Top-View Representations of Outdoor Scenes
    Schulter S, Zhai M, Jacobs N, Chandraker M. 2018. Learning to Look around Objects for Top-View Representations of Outdoor Scenes. In: European Conference on Computer Vision (ECCV). DOI: 10.1007/978-3-030-01267-0_48.
  9. Thumbnail for FARSA: Fully Automated Roadway Safety Assessment
    Song W, Workman S, Hadzic A, Souleyrette R, Green E, Chen M, Zhang X, Jacobs N. 2018. FARSA: Fully Automated Roadway Safety Assessment. In: IEEE Winter Conference on Applications of Computer Vision (WACV). DOI: 10.1109/WACV.2018.00063.