kh]< |dZddlmZddlmZmZmZmZddlZddl m Z ddl m Z m Z ddlmZmZmZmZmZmZddlmZdd lmZdd lmZdd lmZmZd gZGd de j>Z Gdde j>Z!Gdde j>Z"Gdde j>Z#Gdd e j>Z$d#dZ%d$dZ&ee&dde&de&de&de&dde&dddZ'ed#de$fdZ(ed#de$fdZ)ed#de$fd Z*ed#de$fd!Z+ed#de$fd"Z,y)%aPytorch impl of Aligned Xception 41, 65, 71 This is a correct, from scratch impl of Aligned Xception (Deeplab) models compatible with TF weights at https://github.com/tensorflow/models/blob/master/research/deeplab/g3doc/model_zoo.md Hacked together by / Copyright 2020 Ross Wightman )partial)ListDictTypeOptionalNIMAGENET_INCEPTION_MEANIMAGENET_INCEPTION_STD)ClassifierHead ConvNormActDropPathPadType create_conv2dget_norm_act_layer) to_3tuple)build_model_with_cfg)checkpoint_seq)register_modelgenerate_default_cfgsXceptionAlignedceZdZddddejej fdededededed ed eejd eejffd Z d Z xZ S)SeparableConv2drin_chsout_chs kernel_sizestridedilationpadding act_layer norm_layerc jtt| ||_||_t ||||||d|_|||_| |dntj|_ t ||d|_ |||_ ||d|_ ytj|_ y)NTrr!r depthwiseinplacerr)superr__init__rr rconv_dwbn_dwnnIdentityact_dwconv_pwbn_pwact_pw) selfrrrrr r!r"r# __class__s X/var/www/teggl/fontify/venv/lib/python3.12/site-packages/timm/models/xception_aligned.pyr+zSeparableConv2d.__init__s ot-/&  % FKh$@  ' 1:1Fi-BKKM %VW!D ( 1:1Fi- BKKM c|j|}|j|}|j|}|j|}|j |}|j |}|SN)r,r-r0r1r2r3r4xs r6forwardzSeparableConv2d.forward4sU LLO JJqM KKN LLO JJqM KKNr7) __name__ __module__ __qualname__r.ReLU BatchNorm2dintrrModuler+r< __classcell__r5s@r6rrs !!)+*,..ZZZ Z  Z  ZZBIIZRYYZ6r7rceZdZddddejej dfdedededed ed ed eejd eejd e ffd Z dZ xZ S)PreSeparableConv2drrrTrrrrr r!r"r# first_actc tt| t||} ||_||_| r | |dnt j|_t||||||d|_ t||d|_ y)Nr"Tr'r%rr)) r*rGr+rrr r.r/normrr,r1) r4rrrrr r!r"r#rHnorm_act_layerr5s r6r+zPreSeparableConv2d.__init__?su  $02+J)L&  r?r.r@rArBrrrCboolr+r<rDrEs@r6rGrG>s !!)+*,.."EEE E  E  EEBIIERYYEE4r7rGceZdZdddddejddfdededed ed ed ed ed eejde eejde ejffd Z dZ xZ S)XceptionModulerrTFNrrrr pad_typestart_with_reluno_skipr"r# drop_pathc Ltt| t|}||_|d|_||_|s?|j |jk7s|dk7r!t||j d|| d|_nd|_|rdn|} tj|_ tdD]r} |r,|jjd| dz|| dkD|jjd | dzt||| d| d k(r|nd||| | || }t| |_y) NrF)rr# apply_actractrr'conv)rr r!r"r#)r*rPr+r in_channels out_channelsrSr shortcutr. Sequentialstackrange add_modulerrT)r4rrrr rQrRrSr"r#rTseparable_act_layerir5s r6r+zXceptionModule.__init__as, nd,.G$!#BK D--1A1AAVq['))1V ^ceDM!DM&5d9]]_ q A %%AE7mYq1u5MN JJ ! !DQ./ AQfAPXbj-*3F GQZF  #r7c|}|j|}|j|j|}|js"|j|j|}||z}|Sr9)r_r]rSrTr4r;skips r6r<zXceptionModule.forwardsY JJqM == $==&D||~~)NN1%DAr7r=r>r?r.r@rBrrNrrCrr+r<rDrEs@r6rPrP`s  "$(!)+48-1"#"#"# "#  "#  "#""#"#BII"#!bii1"#  *"#H r7rPceZdZddddejddfdedededed ed ed eejd e eejd e ejffd Z dZ xZ S)PreXceptionModulerrFNrrrr rQrSr"r#rTc @tt| t|}||_|d|_||_|s=|j |jk7s|dk7rt||j d||_ntj|_t|||d|_ tj|_tdD]H} |jj!d| dzt#||| d| d k(r|nd||||| d kD || }J| |_y) NrVr)rrJTr'rrYrZr)rr r!r"r#rH)r*rir+rr[r\rSrr]r.r/rrKr^r_r`rarGrT) r4rrrr rQrSr"r#rTrcr5s r6r+zPreXceptionModule.__init__s /1G$!#BK D--1A1AAVq[)&$2C2CQvVDMKKMDMG&zYGX\] ]]_ q A JJ ! !DQ.2D !"avQ! #%a% 3 QZF #r7c|j|}|}|j|}|js1|j|j|}||j |z}|Sr9)rKr_rSrTr]res r6r<zPreXceptionModule.forwardsX IIaL JJqM||~~)NN1%DMM$''Ar7rgrEs@r6riris  "!)+48-1&#&#&# &#  &#  &#&#BII&#!bii1&#  *&#Pr7riceZdZdZddddej ej dddf deed e d e d e d e d e ejde ejde de deffd Zej"j$ddZej"j$ddZej"j$dejfdZdd e deefdZdZdde fdZdZxZS)rzModified Aligned Xception r Favg block_cfg num_classesin_chans output_stridepreactr"r# drop_ratedrop_path_rate global_poolc tt| |dvsJ||_||_d|_t ||} tjt|dfddd| |rtdddd n tddd d| g|_ d } d} g|_ tj|_ |rtnt}t!|}d }t#|D]\}}| |z|d z z }|d kDr t%|nd|d <| |d <|dd kDr\|rd|dnd|d}|xjt t'|dd| |gz c_ | |dz}||kDr| |dz} d |d<n|} |jj)t+||di|| |jdj,|_|d z }|xjt |j.| dt+t!|jd z zgz c_ |r |dntj0|_|j.|_t7|j.|| ||_y)N)rnF)r"r#rnrrZ)rr@rrrorTr rzblocks.z .stack.conv2z .stack.act3r)num_chs reductionmodulerVTr') in_featuresrr pool_typerv)rnr|)r*rr+rrrvgrad_checkpointingdictr.r^r rstem feature_infoblocksrirPlen enumerater rrastrr\ num_featuresr/rXhead_hidden_sizer head)r4rqrrrsrtrur"r#rvrwrx layer_args curr_dilation curr_stride module_fnnet_num_blocks net_block_idxrcb block_dprname next_strider5s r6r+zXceptionAligned.__init__sm ot-/ +++&""'I*E MM " L!A L L>DM"ba :  FAa F: F$     mmo )/%^ Y i( DAq&6.1:LMI4=NXi0AkN)AjM{Q4:<0'!K@X!!d9Qy\3J23NZenr&s%tt!)AhK7 .!Qx[0M"#AhK"-K KK " "3q69+Gq+GJ+G H $ B < r?__doc__r.r@rArrrBrNrrCfloatrr+rrignorerrrrrrrr<rDrEs@r6rrs= $!# )+*,..!$&$; Dz; ;  ;  ;  ; BII; RYY; ; "; ; z YY   YY)) YY >RJ  Xz XT*=WPV=W XXr7c 0tdddtdddtdddgtdddgdztdd dtd d dd }t|d ttjdd}t dd|it|fi|S)z- Modified Aligned Xception-65 w/ Pre-Act r|rrZrrrrr{rrrT)rrrrSrrrrr) xception65prrs r6rrs BA. CQ/ CQ/  sC 2 3b 8  C!21=  D"4QM IDWR^^QU`b5ceJ  Xz XT*=WPV=W XXr7r)r)-r functoolsrtypingrrrrrtorch.nnr. timm.datar r timm.layersr r r rrrtimm.layers.helpersr_builderr _manipulater _registryrr__all__rCrrGrPrirrr default_cfgsrrrrrrr7r6rs-- Eii)*'<  #bii#LD.RYY.b1 1hcbiicL% 111 !& *XoXX$XoXX$XoXX(YYY$YYYr7