kh.<dZddlmZddlmZddlZddlmZddlm Z m Z m Z m Z ddl mZddlmZmZd gZGd d ej&ZGd d ej&ZGddej&ZGddej&ZGddej&ZGddeZGddeZGdd ej&Zd'dZeddddddd d d!d"d#d$ iZed'd%efd&Zy)(z pnasnet5large implementation grabbed from Cadene's pretrained models Additional credit to https://github.com/creafz https://github.com/Cadene/pretrained-models.pytorch/blob/master/pretrainedmodels/models/pnasnet.py ) OrderedDict)partialN) ConvNormAct create_conv2d create_pool2dcreate_classifier)build_model_with_cfg)register_modelgenerate_default_cfgs PNASNet5Largec&eZdZdfd ZdZxZS)SeparableConv2dc~tt| t|||||||_t||d||_y)N) kernel_sizestridepaddinggroupsr rr)superr__init__rdepthwise_conv2dpointwise_conv2dself in_channels out_channelsrrr __class__s O/var/www/teggl/fontify/venv/lib/python3.12/site-packages/timm/models/pnasnet.pyrzSeparableConv2d.__init__sE ot-/ - +7;!@!. 1g!GcJ|j|}|j|}|SN)rrrxs rforwardzSeparableConv2d.forwards'  ! !! $  ! !! $r __name__ __module__ __qualname__rr% __classcell__rs@rrrsGr rc&eZdZdfd ZdZxZS)BranchSeparablesc^tt| |r|n|}tj|_t ||||||_tj|d|_ tj|_ t |||d||_ tj|d|_ y)NrrMbP?epsr ) rr/rnnReLUact_1r separable_1 BatchNorm2dbn_sep_1act_2 separable_2bn_sep_2) rrrrr stem_cellrmiddle_channelsrs rrzBranchSeparables.__init__'s .0*3,WWY * +fgWEB WWY * \;q'S|? r c|j|}|j|}|j|}|j|}|j |}|j |}|Sr")r7r8r:r;r<r=r#s rr%zBranchSeparables.forward3s] JJqM   Q  MM!  JJqM   Q  MM! r )r Fr'r(r-s@rr/r/%s @r r/c&eZdZdfd ZdZxZS) ActConvBnctt| tj|_t ||||||_tj|d|_ y)Nrrrr2r3) rrBrr5r6actrconvr9bnrs rrzActConvBn.__init__?sH i')779! ;vW^` ..59r cl|j|}|j|}|j|}|Sr")rErFrGr#s rr%zActConvBn.forwardFs. HHQK IIaL GGAJr )r r'r(r-s@rrBrB=s :r rBc&eZdZdfd ZdZxZS)FactorizedReductionc tt| tj|_tj tdtjdddfdt||dzd|fg|_ tj tdtjd fdtjdddfdt||dzd|fg|_ tj|d |_y) Navgpoolr F)rcount_include_padrFrpad)r rPr r2r3)rrJrr5r6rE Sequentialr AvgPool2drpath_1 ZeroPad2dpath_2r9 final_path_bn)rrrrrs rrzFactorizedReduction.__init__Os !413779mmK  QqEJ K ]; 0AqZab c1 %   mmK BLL0 1  QqEJ K ]; 0AqZab c1 %    ^^LeDr c|j|}|j|}|j|}|jt j ||gd}|SNr )rErSrUrVtorchcat)rr$x_path1x_path2outs rr%zFactorizedReduction.forward]sN HHQK++a.++a.  GW+=q!AB r r&r(r-s@rrJrJMs Er rJceZdZdZy)CellBasec|j|}|j|}||z}|j|}|j|}||z}|j |} |j |} | | z} |j | } |j|} | | z}|j|}|j|j|}n|}||z}tj||| ||gd}|SrX) comb_iter_0_leftcomb_iter_0_rightcomb_iter_1_leftcomb_iter_1_rightcomb_iter_2_leftcomb_iter_2_rightcomb_iter_3_leftcomb_iter_3_rightcomb_iter_4_leftcomb_iter_4_rightrYrZ)rx_leftx_rightx_comb_iter_0_leftx_comb_iter_0_right x_comb_iter_0x_comb_iter_1_leftx_comb_iter_1_right x_comb_iter_1x_comb_iter_2_leftx_comb_iter_2_right x_comb_iter_2x_comb_iter_3_leftx_comb_iter_3_right x_comb_iter_3x_comb_iter_4_leftx_comb_iter_4_right x_comb_iter_4x_outs r cell_forwardzCellBase.cell_forwardgs!226:"44V<*-@@ !227;"44W=*-@@ !227;"44W=*-@@ !22=A"44W=*-@@ !226:  ! ! -"&"8"8"A ") *-@@  =- Wdeghi r N)r)r*r+r}r rr_r_esr r_c&eZdZdfd ZdZxZS) CellStem0c tt| t||d||_t ||ddd||_tjtdtdd d| fd t||d|fd tj|d fg|_ t ||dd||_tdd d| |_t ||dd||_t ||d d||_t ||d ||_tdd d| |_t ||d dd||_t||dd||_y)Nr rrMT)rrr>rmax_poolmaxr1rFrGr2r3rD)rrrrBconv_1x1r/rar5rQrrrr9rbrcrdrerfrgrhrirj)r in_chs_left out_chs_left in_chs_right out_chs_rightpad_typers rrzCellStem0.__init__sW i')!, 1V^_ 0 1Q$X`!b!#{ ua8L M ]; !U]^ _ 2>>,E: ;< 0 "  !1 =a8!U!.ua8!T 0 =a8!U!1 =a8"U!1 =a!K!.ua8!T 0 -QqDZb!d!* =a8"Ur cL|j|}|j||}|Sr")rr}rrkrlr|s rr%zCellStem0.forwards'--'!!&'2 r r&r(r-s@rrrsU<r rc,eZdZ dfd ZdZxZS)Cellcntt| |rdnd}||_|rt ||||_nt ||d||_t ||d||_t||d|||_ tdd|| |_ t||d |||_ tdd|| |_ t||d|||_t||d|||_t||d |_tdd|| |_t||d|||_|rt ||d|||_yd|_y) NrMr )rrrrDrrr1r)r)rrrmatch_prev_layer_dimensionsrJ conv_prev_1x1rBrr/rarrbrcrdrerfrgrhrirj) rrrrrr is_reductionmatch_prev_layer_dimsrrs rrz Cell.__init__s\ dD"$ # ,A( !4[,X`!aD !*; RS]e!fD !, 1V^_ 0 ,Afh!X!.uaPX!Y 0 =aPX!Z!.uaPX!Y 0 =aPX!Z!1 =aPX"Z!1 [\ ]!.uaPX!Y 0 ,Afh!X %.}!FT\&^D "&*D "r cn|j|}|j|}|j||}|Sr")rrr}rs rr%z Cell.forwards7##F+--(!!&'2 r )r'FFr(r-s@rrrs"'1*fr rceZdZ d fd Zej j ddZej j ddZej j de jfdZ dde de fdZd Zdd efd Zd ZxZS)r c Ltt| ||_dx|_|_|dk(sJt |ddddttjdd d |_ tdd dd | |_ tdddd|dd|_tdddd|d|_tdddd| |_tdddd| |_tdddd| |_tdddd|d|_tdddd|d|_tdddd| |_tdddd| |_tdddd|d|_tdddd|d|_tdddd| |_tdddd| |_tj6|_t;dddt;dddt;dddt;dd d!t;ddd"g|_t?|j|j||#\|_ |_!|_"y)$Ni `rrMrr2g?)r4momentumF)rrr norm_layer apply_act6)rrrrrliT)rrrrrrri)rrrrrri8i)rrrrrripi`conv_0)num_chs reductionmodulezcell_stem_1.conv_1x1.actzcell_4.conv_1x1.actzcell_8.conv_1x1.actrE) pool_type drop_rate)#rr r num_classes num_featureshead_hidden_sizerrr5r9rr cell_stem_0r cell_stem_1cell_0cell_1cell_2cell_3cell_4cell_5cell_6cell_7cell_8cell_9cell_10cell_11r6rEdict feature_infor global_pool head_drop last_linear)rrin_chans output_striderrrrs rrzPNASNet5Large.__init__sy mT+-&488D1"""! ba1r~~53GSXZ %"BYac 3c\d"&T;#Cs]e"&( #DPS^fh 3TQT_gi 3TQT_gi 3TQT_g 3TQT_g"&( 3TQT_gi 3TQT_gi 3TQT_g 3TQT_g"&( 3TQT_gi 3TQT_gi 779 q : 2L M 3H I 4I J E :  >O   t//;R[>]:$.$*:r ctddS)Nz^conv_0|cell_stem_[01]z ^cell_(\d+))stemblocks)r)rcoarses r group_matcherzPNASNet5Large.group_matcher)s2>JJr c|rJdy)Nz$gradient checkpointing not supportedr~)renables rset_grad_checkpointingz$PNASNet5Large.set_grad_checkpointing-sAAAz6r returnc|jSr")r)rs rget_classifierzPNASNet5Large.get_classifier1sr rrcp||_t|j|j|\|_|_y)N)r)rrrrr)rrrs rreset_classifierzPNASNet5Large.reset_classifier5s3&->   t//;.H*$*r c@|j|}|j|}|j||}|j||}|j ||}|j ||}|j ||}|j||} |j|| } |j| | } |j| | } |j| | } |j| | }|j| |}|j||}|j|}|Sr")rrrrrrrrrrrrrrrrE)rr$x_conv_0x_stem_0x_stem_1x_cell_0x_cell_1x_cell_2x_cell_3x_cell_4x_cell_5x_cell_6x_cell_7x_cell_8x_cell_9 x_cell_10 x_cell_11s rforward_featureszPNASNet5Large.forward_features:s;;q>##H-##Hh7;;x2;;x2;;x2;;x2;;x2;;x2;;x2;;x2;;x2;;x2LL84 LL95 HHY r pre_logitscp|j|}|j|}|r|S|j|Sr")rrr)rr$rs r forward_headzPNASNet5Large.forward_headMs8   Q  NN1 q7D$4$4Q$77r cJ|j|}|j|}|Sr")rrr#s rr%zPNASNet5Large.forwardRs'  ! !! $   a r )rrgavgr'F)T)r)r)r*r+rrYjitignorerrr5Modulerintstrrrboolrr%r,r-s@rr r sA]F YYKK YYBB YY    HCHcH &8$8 r c @tt||fdtddi|S)N feature_cfghookT) feature_cls no_rewrite)r r r)variant pretrainedkwargss r_create_pnasnetrXs3  V=     r zpnasnet5large.tf_in1kztimm/)rKr) rgx&?bicubic)?rrrz conv_0.convr) hf_hub_id input_size pool_sizecrop_pct interpolationmeanstdr first_conv classifierrc 6tdddi|}td|fi|S)zPNASNet-5 model architecture from the `"Progressive Neural Architecture Search" `_ paper. rsame pnasnet5larger~)rr)rr model_kwargss rrrrs( 2262L ?J G, GGr r)__doc__ collectionsr functoolsrrYtorch.nnr5 timm.layersrrrr_builderr _registryr r __all__rrr/rBrJr_rrr r default_cfgsrr~r rrs$ TT*<   bii  ryy0   "))0ryy<##L989xpBIIpf%#"##  &  HHHr