一种结合小波变换的高效轻量级城市遥感图像分割网络

    An Efficient Lightweight Remote Sensing Image Segmentation Network Incorporating Wavelet Transforms

    • 为兼顾高分辨率遥感图像语义分割中精度与效率,文章提出一种轻量级网络EMWMamba(Efficient Multiscale Wavelet-Fused Mamba)。该网络采用 U 型结构设计,融合了轻量级 Transformer 和 Mamba 架构的优势:编码器采用 ResT 主干,利用低参数量多头自注意力快速提取多尺度特征;解码器引入特征重构小波 Mamba 模块,在获取空间信息的同时补充频域加权,实现频-空互补,并设计小波特征融合上采样模块提高信息复原精度。为进一步增强学习特征的判别能力,网络附加引入了一个双向跨层级特征聚合辅助分支,在训练过程中提供补充监督,优化特征表示。在 Vaihingen 和 Potsdam 两个公开遥感数据集上开展实验验证,相较最优对比模型,EMWMamba 仅以 1320 万个参数,使 Vaihingen 数据集的平均交并比(mIoU)与平均 F1 分数(mF1)分别提升 2.80与1.61百分点;使Potsdam 数据集的 mIoU与 mF1分别 提升了1.68与 1.09百分点 ,实现了精度与计算复杂度的最优平衡。

       

      Abstract: To balance accuracy and efficiency in high-resolution remote sensing image semantic segmentation, this paper proposes a lightweight network named EMWMamba (Efficient Multiscale Wavelet-Fused Mamba). The network adopts a U-shaped architecture, combining the advantages of lightweight Transformer and Mamba frameworks. The encoder uses a ResT backbone to efficiently extract multi-scale features using low-parameter multi-head self-attention. The decoder introduces a feature-reconstruction wavelet Mamba module, which supplements frequency-domain weighting while acquiring spatial information, achieving frequency-spatial complementarity. Additionally, a wavelet feature fusion upsampling module is designed to improve the accuracy of information reconstruction. To further enhance the discriminative ability of learned features, the network incorporates a bidirectional cross-level feature aggregation auxiliary branch, which provides supplementary supervision during training to optimize feature representation. Experimental verification was carried out on two public remote sensing datasets, Vaihingen and Potsdam. Compared with the optimal comparison model, EMWMamba, with only 13.2 million parameters, achieves a 2.80 percentage point improvement in mean Intersection over Union (mIoU) and a 1.61 percentage point improvement in mean F1 score (mF1) on the Vaihingen dataset; On the Potsdam dataset, the mIoU and mF1 are improved by 1.68 and 1.09 percentage points respectively, realizing the optimal balance between accuracy and computational complexity.

       

    /

    返回文章
    返回