-:j( dZddlZddlZddlmZddlmZmZddlZddl m Z ddl m Z ddl mZmZmZmZmZdd lmZmZdd lmZgd Zed Zd!d edzfdZd edzdededzddfdZdededzdedzddfdZde deddfdZde dededzddfdZde dededdfdZ dededefdZ!de dedede"ddf dZ#de dedee$zdeddf d Z%y)"aShared ``cp`` command to copy files between local paths, repositories and buckets. This single command backs three identical CLI entry points: ``hf cp`` (top-level), ``hf repos cp`` and ``hf buckets cp``. It supports any source/destination combination of local file, repo/bucket ``hf://`` URI, and ``-`` (stdin/stdout), with two exceptions: - bucket-to-repo copies are not supported (server limitation), and - local-to-local copies (use a regular ``cp`` for that). N)replace) AnnotatedLiteral)HfApi)CLIError)HfUriSoftTemporaryDirectorydisable_progress_bars is_hf_uri parse_hf_uri)TokenOpt get_hf_api)out) z(hf cp hf://username/my-model/config.jsonz6hf cp hf://username/my-model/config.json ./config.jsonz8hf cp hf://datasets/username/my-dataset/data.csv ./data/z3hf cp hf://buckets/username/my-bucket/config.json -zBhf cp ./model.safetensors hf://username/my-model/model.safetensorsz9hf cp ./config.json hf://buckets/username/my-bucket/logs/z3hf cp - hf://buckets/username/my-bucket/config.jsonz;hf cp hf://username/source-model/ hf://username/dest-model/z]hf cp hf://datasets/username/my-dataset/processed/ hf://buckets/username/my-bucket/processed/zihf cp hf://buckets/username/my-bucket/logs/ hf://buckets/username/archive-bucket/ # copies contents only)reposbucketscontextc  d dtttjdfdttdztjdfdtddffd }|S) zBuild the ``cp`` command function for a given alias. The three entry points (`hf cp`, `hf repos cp`, `hf buckets cp`) share the exact same logic; 'context' only adds a guardrail on the remote endpoint type (see `_enforce_context`). Nsrcz?Source: local file, hf:// URI (repo or bucket), or - for stdin.)helpdstzEDestination: local path, hf:// URI (repo or bucket), or - for stdout.tokenreturnc:t||t|||y)aCopy files between local paths, repositories, and buckets. Handles uploads (local/stdin -> repo/bucket), downloads (repo/bucket -> local/stdout) and remote-to-remote copies (repo/bucket -> repo/bucket). Bucket-to-repo and local-to-local copies are not supported. For directories, use `hf upload`/`hf download` (repos) or `hf buckets sync` (buckets). Remote-to-remote copies only work within the same storage region (https://huggingface.co/docs/hub/storage-regions). N)_enforce_context_run_cp)rrrrs Y/var/www/html/tokenscope/api/venv/lib/python3.12/site-packages/huggingface_hub/cli/_cp.pycpzmake_cp..cpBs& #s+S% )NN)rstrtyperArgumentr)rrs` rmake_cpr#;sw !   NN a b d !  $J NN g h j !! !, Irrrrc|y| t|r|n|}t|sy|dk(r t|jr td|dk(r!t|js tdyy)aGuardrail for the `hf repos cp` / `hf buckets cp` aliases. These aliases are exact duplicates of `hf cp`, so a bare `hf repos cp` could otherwise touch a bucket (and vice versa). We validate the type of the remote side: the destination for uploads and remote-to-remote copies, or the source when downloading to a local path / stdout. The top-level `hf cp` (i.e. 'context' is None) accepts any combination. NrzW`hf repos cp` only works with repositories. Use `hf cp` or `hf buckets cp` for buckets.rzW`hf buckets cp` only works with buckets. Use `hf cp` or `hf repos cp` for repositories.)r r is_bucketr)rrrremotes rrrs_3ScF V 'l62<<pqq)L$8$B$Bpqq%Crrct|}|dk(}|dk(}t|}|duxr t|}|r1|r/|J|j||tjd||y|s.|s,|t j dt j d|r|r t||yt|||y|Jt||||y)N)r-Copiedrrz?Missing destination. Provide a repo or bucket hf:// URI as DST.zVOne of SRC or DST must be a repo (hf://username/...) or bucket (hf://buckets/...) URI.) src_is_stdin) rr copy_filesrresultr! BadParameter_download_file_to_stdout_download_file_to_local_upload_file_to_remote)rrrapir+ dst_is_stdout src_is_hf dst_is_hfs rrros 5 !C#:L3JM#I42IcNIY sC  8#. Y ;$$%fg g  d    $S# . S#. ??3S|Drr2ct|}t||}t5t5}tj j ||}t|||t|d5}|jdx}r=tjjj||jdx}r=dddddddddy#1swYxYw#1swYxYw#1swYyxYw)NrbiH)r _source_filenamer r ospathjoin_download_singleopenreadsysstdoutbufferwrite)r2rurifilenametmp_dirtmp_pathfchunks rr/r/s s CS)H  3 # % 3ww||GX6H S#x 0h% 3 vvj11e1JJ%%++E2 !vvj11e1 3 333 3 3 3 333s; C):C'AC8CC)C CC& "C))C2ct|}t||}||}nrtjj |s0|j tj s|j dr!tjj||}n|}tjj|}|rtj|dt|||tjd||y)N/T)exist_ok Downloadedr*) r r8r9r:isdirendswithsepr;dirnamemakedirsr<rr-)r2rrrCrD local_path parent_dirs rr0r0s s CS)H { s s||BFF3s||C7HWW\\#x0  ,J J.S#z*JJ|*5rrCrRc|jr,|j|j|j|fgdytj j |xsd}td|5}|j|j|j|j|j|}t j||dddy#1swYyxYw)zDownload a single file (repo or bucket) to ``local_path``. Used by `_download_file_to_local` and `_download_file_to_stdout`. T)raise_on_missing_files.z.tmp)prefixdir)repo_id repo_typerDrevision local_dirN) r%download_bucket_filesid path_in_repor9r:rPr hf_hub_downloadtyper[r)r2rCrRrSrEdownloaded_paths rr<r<s  }} !!#&&C,<,_upload_singlerr-to_urir9r:rMisfilebasenamer)r2rrr+rCdatarW remote_paths rr1r1sR s C   r !S\\#%6$$%hi iyy$$&sCs'7'78 :7 = ww}}S  k   77>>#   #:3%!@AA   F |gg&&s+ c slRWW%5%5c%::  3S+.JJzs+(N(U(U(WXrsourceroc|jr!|j|j||fgy|j|||j|j|j y)z4Upload a single file or bytes (to a repo or bucket).)add)path_or_fileobjr_rYrZr[N)r%batch_bucket_filesr^ upload_filerar[)r2rCrpros rrjrjsT }} svvV[,A+BC "$FFhh\\  r)N)&__doc__r9r? dataclassesrtypingrrr!huggingface_hubrhuggingface_hub.errorsrhuggingface_hub.utilsrr r r r _cli_utilsrr_outputr CP_EXAMPLES CpContextr#r rrr/r0r<r8boolr1bytesrjrrrs % !+oo, $ & ' Y%@ri$.rSrsTzrdr(!E!E3:!EcDj!ET!EH 3% 3c 3d 366S6sTz6d6&4%4e444./%/c/c/YYCYcYDYUYY<    E  3;  S  UY  r