-:j )|dZddlZddlmZddlZddlmZddlmZddl m Z ddl m Z m Z ddlmZmZd d lmZmZmZmZmZd d lmZgd Z d$d edeeedzej8dfdededeeedzej:dfdeeedzej:dfdeedzej:dfdeedzej:dfdeeej:dfdeeej:dfded eeej:d!fd"dfd#Z y)%anContains command to download files from the Hub with the CLI. Usage: hf download --help # Download file hf download gpt2 config.json # Download entire repo hf download fffiloni/zeroscope --repo-type=space --revision=refs/pr/78 # Download repo with filters hf download gpt2 --include="*.safetensors" # Download with token hf download Wauplin/private-model --token=hf_*** # Download quietly (no progress bar, no warnings, only the returned path) hf download gpt2 config.json --quiet # Download to local dir hf download gpt2 --local-dir=./models/gpt2 # Download a subfolder hf download HuggingFaceM4/FineVision art/ --repo-type=dataset # Download using an hf:// URI (repo type, revision and file path are read from the URI) hf download hf://datasets/HuggingFaceM4/FineVision@refs/pr/1/data/train.parquet N) Annotated) constants)snapshot_download)CLIError)DryRunFileInfohf_hub_download) _format_size parse_hf_uri) RepoIdArgRepoTypeRepoTypeOptionalOpt RevisionOptTokenOpt)out)z,hf download meta-llama/Llama-3.2-1B-InstructzGhf download meta-llama/Llama-3.2-1B-Instruct config.json tokenizer.jsonzXhf download meta-llama/Llama-3.2-1B-Instruct --include "*.safetensors" --exclude "*.bin"zGhf download meta-llama/Llama-3.2-1B-Instruct --local-dir ./models/llamaz=hf download HuggingFaceM4/FineVision art/ --repo-type datasetz6hf download hf://datasets/HuggingFaceH4/ultrachat_200krepo_id filenamesz>Files to download (e.g. `config.json`, `data/metadata.jsonl`).)help repo_typerevisionincludez;Glob patterns to include from files to download. eg: *.jsonexcludez0Glob patterns to exclude from files to download. cache_dirzDirectory where to save files. local_dirzIf set, the downloaded file will be placed under this directory. Check out https://huggingface.co/docs/huggingface_hub/guides/download#download-files-to-a-local-folder for more details.force_downloadzFIf True, the files will be downloaded even if they are already cached.dry_runzAIf True, perform a dry run without actually downloading the file.token max_workerszEMaximum number of workers to use for downloading files. Default is 8.returnc    tdjtjr|tddtddt } | j r td| j } | rjdr| dz } | j| j| jc| r6rtd| d d | gn|xstjjd ttzt tzf   f d }d ttzt tzd dfd}||y)zDownload files from the Hub.NzCannot use both `--local-dir` and `--cache-dir` at the same time. Use `--cache-dir` (or set the HF_HOME environment variable) for shared caching, or `--local-dir` for a one-off download to a specific directory.z3'--repo-type' cannot be used with an 'hf://' URI ('z').z2'--revision' cannot be used with an 'hf://' URI ('zBBuckets are not supported by `hf download`. Use `hf sync` instead./z.Cannot combine a file path in the hf:// URI ('z') with positional filenames .rcF  ng}|Dcgc]}|jds|}}|Dcgc]}|jdd}}|Dcgc]}|jdr|}}t|dkDrP &t dkDrtd|dd|dd &t dkDrtd|dd|ddt|dkDrJ #t dkDrt j d  #t dkDrt j d t|d k(r&t|dk(rt |d  d  St|dk(rt|dk(r } }n||z}d}t||  d  Scc}wcc}wcc}w)Nr!z/**rz$Cannot combine subfolder argument ('z,') with `--include`. Please use `--include "z *"` instead.z,') with `--exclude`. Please use `--include "z*"` with `--exclude` instead.z>Ignoring `--include` since filenames have been explicitly set.z>Ignoring `--exclude` since filenames have been explicitly set.r zhuggingface-cli) rrrfilenamerrrr library_namer) rrrallow_patternsignore_patternsrrrrr%rr)endswithrstriplenrwarningswarnrr)filenames_listf subfolderssubfolder_patternsregular_filenamesr&r'rrrrrrrrr repo_type_strrrs ^/var/www/html/tokenscope/api/venv/lib/python3.12/site-packages/huggingface_hub/cli/download.py run_downloadzdownload..run_downloads&/&;"0CA1::c?aC C=GH#s3HH(6N1ajjoQNN ! "Q &"s7|a'7::a=/J..8m_LJ"s7|a'7::a=/J..8m_z2download.._print_result..s*N11;;*Nsr"c|jSr:)r$)xs r3z1download.._print_result..s QZZ)key-)filesize) isinstancestrrr5r will_downloadtextr*r sumsortedr$r;table)r5r=rIinfoitemss r3 _print_resultzdownload.._print_results fc " JJ|& 1  fn -XF$*>qaoo> > &s='9&:;F }%&s*N *N'NOPPQ S v+?@   8<8J8J T^^4PS    %?  sDD27D)r startswithr HF_PROTOCOLr is_bucket path_in_repor(idtyperr modelvaluerHrlist)rrrrrrrrrrrrurirTr4rPr2s`` ````````` @r3downloadr[Estn!6 O  )//0  PQXPYY\]^ ^  OPWyX[\] ]7# ==_` `'' G,,S1 C L+.66388S\\( D\NRopyozz{|&I"4hnn;; D #.n1EED D D LcN2T.5IId.,.!rB) NNNNNNNFFN)!__doc__r+typingrtyperhuggingface_hubr"huggingface_hub._snapshot_downloadrhuggingface_hub.errorsrhuggingface_hub.file_downloadrrhuggingface_hub.utilsr r _cli_utilsr r rrr_outputrDOWNLOAD_EXAMPLESrYrHArgumentOptionboolintr[rBr3rms< %@+I<WW" %)   iy" y" S DQ  y"#y"y" S D N  y"  S D C  !y", d  1  -y"8 d  M  9y"D  Y  Ey"P  T  Qy"\ ]y"^  X  _y"j ky"rB