高级搜索

基于Vit-Bi-LSTM的监控相机夜间强降雨监测方法

Nighttime heavy rainfall detection using surveillance cameras based on ViT-Bi-LSTM

  • 摘要: 城市监控相机具有数量多、密度大、传输快的观测优势,为降雨的高时空分辨率观测提供了新的契机。然而,现有监控测雨研究聚焦于对白天降雨的监测,缺少对夜间强降雨的有效测量方法。本文从监控视角出发,分析了夜间降雨视频的时空特征,提出了一种融合Vision Transformer(ViT)和双向长短时记忆网络(Bi-LSTM)的深度学习模型Vit-Bi-LSTM,用于夜间降雨强度等级的自动识别。基于2022年至2025年期间收集的41场夜间降雨视频,构建了一个最大雨强达80 mm·h−1的夜间降雨视频数据集,涵盖4500个视频片段,总时长达37.5 h。实验结果表明,基于降雨视频时空特征的联合建模可有效改善降雨识别精度,且采用两层Bi-LSTM结构的Vit-Bi-LSTM模型在自建数据集上取得了85.6%最优精度表现。此外,Vit-Bi-LSTM对夜间强降雨的实地观测中取得了76.7%降雨等级识别精度,证明了其在真实环境中的有效性。虽然Vit-Bi-LSTM对小于20 mm·h−1降雨取得了80.7%~90.6%的识别精度,但随着降雨强度的提升,特别是降雨强度大于40 mm·h−1时,精度下降至68.8%~75.0%,未来仍需进一步提升。

     

    Abstract: Urban surveillance cameras, with their large number, high density, and fast transmission capabilities, offer new opportunities for high spatiotemporal resolution rainfall monitoring. However, existing research has mainly focused on daytime rainfall monitoring, with nighttime heavy rainfall monitoring remaining relatively weak. In this study, we analyze the spatiotemporal features of nighttime rainfall videos and propose a deep learning model, Vit-Bi-LSTM, which combines Vision Transformer (ViT) and Bidirectional Long Short-Term Memory (Bi-LSTM) networks, for automatic classification of nighttime heavy rainfall levels. A nighttime rainfall video dataset with a maximum rainfall intensity of 80 mm·h−1 was constructed from 4,500 clips totaling 37.5 hours, which included 41 nighttime rainfall videos collected between 2022 and 2025. Experimental results show that the joint modeling of spatiotemporal features significantly improves the accuracy of rainfall level classification, with the two-layer Bi-LSTM structure achieving an accuracy of 85.6% on the self-constructed dataset. Additionally, the model achieved an accuracy of 76.7% in field observations of two nighttime heavy rainfall events, demonstrating its effectiveness in real-world environments. Although the model showed high accuracy (80.7%–90.6%) for rainfall intensities below 20 mm·h−1, the accuracy decreased to 68.8%–75.0% for rainfall intensities above 40 mm·h−1, which still needs further improvement.

     

/

返回文章
返回