kh" d dl Z d dlZd dlZd dlmZ d dlmZ d dlmZm Z m
Z
m Z m Z m
Z
mZ d dlZddlmZ ddlmZmZmZ dd d
d Zd Z G d
de Zddeeef de e de
e eef e e f fdZdeeef dededdfdZddeeef de e ddfdZ ddeeef de e deddfdZ d deeef de e de e e deddf
dZ y) N)contextmanager)Path)AnyDictIteratorListOptionalTupleUnion ) ImageFolder)check_integrityextract_archiveverify_str_arg)zILSVRC2012_img_train.tar 1d675b47d978889d74fa0da5fadfb00e)zILSVRC2012_img_val.tar 29b22e2961454d5413ddabcf34fc5622)z ILSVRC2012_devkit_t12.tar.gz fa75699e90414af021442c21a62c3abf)trainvaldevkitzmeta.binc j e Zd ZdZd deeef dededdf fd
Zd dZ e
defd Z defd
Z xZ
S )
ImageNeta< `ImageNet `_ 2012 Classification Dataset.
.. note::
Before using this class, it is required to download ImageNet 2012 dataset from
`here `_ and
place the files ``ILSVRC2012_devkit_t12.tar.gz`` and ``ILSVRC2012_img_train.tar``
or ``ILSVRC2012_img_val.tar`` based on ``split`` in the root directory.
Args:
root (str or ``pathlib.Path``): Root directory of the ImageNet Dataset.
split (string, optional): The dataset split, supports ``train``, or ``val``.
transform (callable, optional): A function/transform that takes in a PIL image or torch.Tensor, depends on the given loader,
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
loader (callable, optional): A function to load an image given its path.
By default, it uses PIL as its image loader, but users could also pass in
``torchvision.io.decode_image`` for decoding image data into tensors directly.
Attributes:
classes (list): List of the class name tuples.
class_to_idx (dict): Dict with items (class_name, class_index).
wnids (list): List of the WordNet IDs.
wnid_to_idx (dict): Dict with items (wordnet_id, class_index).
imgs (list): List of (image path, class_index) tuples
targets (list): The class_index value for each image in the dataset
rootsplitkwargsreturnNc t j j | x}| _ t |dd | _ | j
t | j d }t | $ | j fi | || _ | j | _ | j | _ | j D cg c] }|| c}| _ t | j D ci c] \ }}|D ] }|| c}}}| _
y c c}w c c}}}w )Nr )r r r )ospath
expanduserr r r parse_archivesload_meta_filesuper__init__ split_folderclasseswnids class_to_idx wnid_to_idx enumerate)
selfr r r wnid_to_classeswnididxclsscls __class__s
Y/var/www/teggl/fontify/venv/lib/python3.12/site-packages/torchvision/datasets/imagenet.pyr$ zImageNet.__init__3 s 77--d33ty#E74DE
(3A6
**5f5 \\
,,:>**E$-E 7@ 7N _ _)#tZ^ _SVS#X _S _ F _s 3 C? Dc t t j j | j t
st
| j t j j | j sK| j dk( rt | j y | j dk( rt | j y y y )Nr r ) r r r joinr META_FILEparse_devkit_archiveisdirr% r parse_train_archiveparse_val_archiver+ s r2 r! zImageNet.parse_archivesB sy rww||DIIy AB +ww}}T . ./zzW$#DII.u$!$)), % 0 c j t j j | j | j S N)r r r4 r r r: s r2 r% zImageNet.split_folderL s ww||DIItzz22r; c : dj di | j S )NzSplit: {split} )format__dict__r: s r2
extra_reprzImageNet.extra_reprP s & &&7 77r; )r )r N)__name__
__module__ __qualname____doc__r strr r r$ r! propertyr% rB
__classcell__)r1 s @r2 r r sd 8
`U39 -
`c
`s
`W[
` - 3c 3 38C 8r; r r filer c |t }t j j | | }t | rt j |d S d}t |j || )NT) weights_onlyzThe meta file {} is not present in the root directory or is corrupted. This file is automatically created by the ImageNet dataset.) r5 r r r4 r torchload RuntimeErrorr@ )r rJ msgs r2 r" r" T s\ |
77<<d #Dt zz$T22
J 3::dD122r; md5c t t j j | | | s d}t |j || y )Nz{The archive {} is not present in the root directory or is corrupted. You need to download it externally and place it in {}.)r r r r4 rO r@ )r rJ rQ rP s r2 _verify_archiverS c sC 277<<d3S 9
E 3::dD122 :r; c
ddl m dt dt t t
t f t t t t df f f ffd }dt dt t
fd}t dt t fd }t d }||d }|d
}t | || | 5 }t t j j | | | t j j |d } || \ } }
|| } | D cg c] } | | }
} t j |
|
ft j j | t" ddd yc c} w # 1 sw Y yxY w) aI Parse the devkit archive of the ImageNet2012 classification dataset and save
the meta information in a binary file.
Args:
root (str or ``pathlib.Path``): Root directory containing the devkit archive
file (str, optional): Name of devkit archive. Defaults to
'ILSVRC2012_devkit_t12.tar.gz'
r N devkit_rootr .c t j j | dd }
j |d d }t t | d }t
| D cg c] \ }}|dk( s || }}}t t | d d \ }}}|D cg c] } t | j d }} t || D
ci c] \ }}
||
} }}
t || D
ci c] \ }
} |
|
} }
} | | fS c c}}w c c} w c c}
}w c c} }
w )
Ndatazmeta.matT)
squeeze_mesynsets r z, ) r r r4 loadmatlistzipr* tupler )rU metafilemeta
nums_childrenr. num_childrenidcsr' r& r/ r- idx_to_wnidr, sios r2 parse_meta_matz,parse_devkit_archive..parse_meta_matw s 77<< VZ@{{8{5i@ S$Z(+
3<]3Ka /c<|_`O`S aa #CJ / 3 eW7>?t5D)*??25dE2BCYS$sDyC C8;E78KL*$4:LLO++ b?CLs
C4)C4!C:
C?
Dc t j j | dd }t | 5 }|j }d d d D cg c]
}t | c}S # 1 sw Y "xY wc c}w )NrW z&ILSVRC2012_validation_ground_truth.txt)r r r4 open readlinesint)rU rJ txtfhval_idcsval_idxs r2 parse_val_groundtruth_txtz7parse_devkit_archive..parse_val_groundtruth_txt sZ ww||K1YZ
$Z )5 (H ),45G 55 ) )5s A
A+ A(c 3 K t j } | t j | y # t j | w xY wwr= )tempfilemkdtempshutilrmtree)tmp_dirs r2 get_tmp_dirz)parse_devkit_archive..get_tmp_dir s6 ""$ #M MM' "FMM' "s A 2 A A A r r ILSVRC2012_devkit_t12)scipy.ioiorG r
r rk r r r ARCHIVE_METArS r r r r4 rM saver5 )r rJ rg ro rv archive_metarQ ru rU re r, rm r. val_wnidsrf s @r2 r6 r6 l sS ,C ,E$sCx.$sERUWZRZOG[B\2\,] ,6s 6tCy 6 ## # # )L |A
q/CD$$ P' T40':ggll7,CD '5k'B$ _,[919:#[%: :
OY/ dI1NOP P ;
P Ps $A"E Ez$parse_val_archive.. s TeBGGLL51Ts *-)rz r" rS r r r4 r sortedr setmkdirr^ rs movebasename)
r rJ r' r~ r| rQ imagesr- img_filer s
@r2 r9 r9 s &L |A
q/C } t$Q'D$$ww||D&)HBGGLLt,h7
Trzz(?ST
TFE
/
h-./ eV, Xh Hbggll8T277;K;KH;U VWXr; r= )Nr )NNr ) r rs rq
contextlibr pathlibr typingr r r r r r
r rM r~ r
utilsr r r rz r5 r rG r" rS r6 r8 r9 r? r; r2 r sq
% D D D C C N IR
;8{ ;8| 3sDy) 3# 3%PTUXZ]U]P^`deh`iPiJj 3 3%T * 3# 3C 3D 33PuS$Y / 3Px} 3PPT 3PlUeCI . Uhsm UTW Ufj U6 jo!X
T
!X"*3-!X?GS ?R!Xcf!X !Xr;