草庐IT

【计算机视觉】Swin-Transformer 网络结构解析

【计算机视觉】Swin-Transformer网络结构解析文章目录【计算机视觉】Swin-Transformer网络结构解析1.介绍2.整体框架3.模型详解3.1PatchMerging3.2WindowsMulti-headSelf-Attention(W-MSA)3.2.1MSA(Multi-headSelf-Attention)计算量3.2.2W-MSA(WindowsMulti-headSelf-Attention)计算量3.3ShiftedWindowsMulti-HeadSelf-Attention(SW-MSA)3.4RelativePositionBias4.模型结构参数参考1

【计算机视觉】Swin-Transformer 网络结构解析

【计算机视觉】Swin-Transformer网络结构解析文章目录【计算机视觉】Swin-Transformer网络结构解析1.介绍2.整体框架3.模型详解3.1PatchMerging3.2WindowsMulti-headSelf-Attention(W-MSA)3.2.1MSA(Multi-headSelf-Attention)计算量3.2.2W-MSA(WindowsMulti-headSelf-Attention)计算量3.3ShiftedWindowsMulti-HeadSelf-Attention(SW-MSA)3.4RelativePositionBias4.模型结构参数参考1