kh%dZddlmZddlmZmZddlmZddlm Z ddl m Z m Z ddl mZGd d ejZd&d Zd'd Ze ed ed ed ed dded dddded dddded ded ddZe d&defdZe d&defdZe d&defdZe d&defd Ze d&defd!Ze d&defd"Ze d&defd#Ze d&defd$Zy%)(a ResNeSt Models Paper: `ResNeSt: Split-Attention Networks` - https://arxiv.org/abs/2004.08955 Adapted from original PyTorch impl w/ weights at https://github.com/zhanghang1989/ResNeSt by Hang Zhang Modified for torchscript compat, and consistency with timm by Ross Wightman )nnIMAGENET_DEFAULT_MEANIMAGENET_DEFAULT_STD) SplitAttn)build_model_with_cfg)register_modelgenerate_default_cfgs)ResNetc~eZdZdZdZdddddddddddej ejddddffd ZdZ d Z xZ S) ResNestBottleneckzResNet Bottleneck rN@Fc tt| | dk(sJ|J|J|Jt||dz z|z}| xs| } |r |dkDs| r|}d}nd}||_t j ||dd|_|||_|d|_ |dkDr| rt jd|d nd|_ |jdk\rft||d|| | |||| |_ t j|_t j|_t j|_n_t j ||d|| | |d |_ |||_||nt j|_|d|_|dkDr| st jd|d nd|_t j ||d zdd|_||d z|_|d|_||_y) NrgP@rF) kernel_sizebiasT)inplace)padding)rstriderdilationgroupsradix norm_layer drop_layer)rrrrrrr)superr__init__intrrConv2dconv1bn1act1 AvgPool2d avd_firstrconv2Identitybn2 drop_blockact2avd_lastconv3bn3act3 downsample)selfinplanesplanesrr/r cardinality base_widthavdr%is_first reduce_firstrfirst_dilation act_layerr attn_layeraa_layerr) drop_path group_width avd_stride __class__s O/var/www/teggl/fontify/venv/lib/python3.12/site-packages/timm/models/resnest.pyrzResNestBottleneck.__init__s, /1q   !!!   &J$456D '38 FQJ(JFJ YYx!%P k*d+ CMPQ>V_aQ?ei ::?"P^' 5U_lvxDJ{{}DH kkmDO DIP^' %IDJ"+.DH.8.Djl"++-DO!$/DIBLq.Yb Q A>hl YY{FQJAER fQh'd+ $ct|jdd4tjj |jj yy)Nweight)getattrr-rinitzeros_rC)r0s r@zero_init_lastz ResNestBottleneck.zero_init_lastWs2 488Xt , 8 GGNN488?? + 9rAc|}|j|}|j|}|j|}|j|j|}|j |}|j |}|j |}|j|}|j|j|}|j|}|j|}|j|j|}||z }|j|}|SN) r!r"r#r%r&r(r)r*r+r,r-r/r.)r0xshortcutouts r@forwardzResNestBottleneck.forward[sjjmhhsmiin >> %..%Cjjohhsmooc"iin == $--$Cjjohhsm ?? &q)H xiin rA) __name__ __module__ __qualname____doc__ expansionrReLU BatchNorm2drrGrM __classcell__)r?s@r@rrs\I gg~~)=%~,rArc &tt||fi|SrI)r r )variant pretrainedkwargss r@_create_resnestrZxs"     rAc 0|dddddttddd |S) Ni)rr\)r]g?bilinearzconv1.0fc) url num_classes input_size pool_sizecrop_pct interpolationmeanstd first_conv classifierr)r`rYs r@_cfgrjs0=vJ%.Bt     rAztimm/) hf_hub_id)rrl)rm)rkrbrc)r@rn) rogJ +?bicubic)rkrbrcrdre)rrq) rrgV-?)rkre)zresnest14d.gluon_in1kzresnest26d.gluon_in1kzresnest50d.in1kzresnest101e.in1kzresnest200e.in1kzresnest269e.in1kzresnest50d_4s2x40d.in1kzresnest50d_1s4x24d.in1kreturnc zttgddddddtddd  }td d |it|fi|S) z5 ResNeSt-14d model. Weights ported from GluonCV. )rrrrdeep TrrFrr5r%blocklayers stem_type stem_widthavg_downr4r3 block_argsrX) resnest14ddictrrZrXrY model_kwargss r@rrK R$2STaTU;=L  _J _$|B^W]B^ __rAc zttgddddddtddd  }td d |it|fi|S) z5 ResNeSt-26d model. Weights ported from GluonCV. )rwrwrwrwrurvTrrrwFrxryrX) resnest26drrs r@rrrrAc zttgddddddtddd  }td d |it|fi|S) z ResNeSt-50d model. Matches paper ResNeSt-50 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'd' for deep stem, stem_width 32, avg in downsample. rrrrurvTrrrwFrxryrX) resnest50drrs r@rrsK  R$2STaTU;=L  _J _$|B^W]B^ __rAc zttgddddddtddd }td d |it|fi|S) z ResNeSt-101e model. Matches paper ResNeSt-101 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )rrrrurTrrwFrxryrX) resnest101errs r@rrsK  R$2STaTU;=L  `Z `4 C_X^C_ ``rAc zttgddddddtddd }td d |it|fi|S) z ResNeSt-200e model. Matches paper ResNeSt-200 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )r$rrurTrrwFrxryrX) resnest200errs r@rrK R$2STaTU;=L  `Z `4 C_X^C_ ``rAc zttgddddddtddd }td d |it|fi|S) z ResNeSt-269e model. Matches paper ResNeSt-269 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )r0rmrurTrrwFrxryrX) resnest269errs r@rrrrAc zttgddddddtddd }td d |it|fi|S) z]ResNeSt-50 4s2x40d from https://github.com/zhanghang1989/ResNeSt/blob/master/ablation.md rrurvT(rwrrxryrX)resnest50d_4s2x40drrs r@rrK R$2STaTT:rsA!*<c cL%!G4!G4g. F4 HuT]_ HuT]_ $ ! $ !!& ,`f```f```f``avaaavaaavaahfhhhfhhrA