o ˷eP@sdZddlZddlmZddlZddlmZddlmZddl m Z ddl m Z ddl mZdd lmZdd lmZd Z d Z d Z dZdZdZddZddZddZGdddeZddZd/ddZddZd d!Z d"d#Z!d$d%Z"d0d&d'Z#d0d(d)Z$d*d+Z% , d1d-d.Z&dS)2zVHelper functions for Cloud Storage utility classes. These are *not* part of the API. N)md5)urlsplit)uuid4)resumable_media)environment_vars)_DEFAULT_TIMEOUT) DEFAULT_RETRY))DEFAULT_RETRY_IF_METAGENERATION_SPECIFIEDSTORAGE_EMULATOR_HOSTzhttps://storage.googleapis.comzstorage.googleapis.com)) if_etag_matchzIf-Match)if_etag_not_matchz If-None-Match))if_generation_matchifGenerationMatch)if_generation_not_matchifGenerationNotMatch)if_metageneration_matchifMetagenerationMatch)if_metageneration_not_matchifMetagenerationNotMatch)if_source_generation_matchifSourceGenerationMatch)if_source_generation_not_matchifSourceGenerationNotMatch)if_source_metageneration_matchifSourceMetagenerationMatch)"if_source_metageneration_not_matchifSourceMetagenerationNotMatchz`num_retries` has been deprecated and will be removed in a future release. Use the `retry` argument with a Retry or ConditionalRetryPolicy object, or None, instead.cCstjttSN)osenvirongetSTORAGE_EMULATOR_ENV_VAR_DEFAULT_STORAGE_HOSTr#r#T/var/www/ideatree/venv/lib/python3.10/site-packages/google/cloud/storage/_helpers.py_get_storage_hostCr%cCsttjttjSr)rgetenvrPROJECTLEGACY_PROJECTr#r#r#r$_get_environ_projectGs r*cCs4|durdSt|d|dgstd|S)zPre-flight ``Bucket`` name validation. :type name: str or :data:`NoneType` :param name: Proposed bucket name. :rtype: str or :data:`NoneType` :returns: ``name`` if valid. Nrz8Bucket names must start and end with a number or letter.)allisalnum ValueError)namer#r#r$_validate_nameNs  r0c @seZdZdZdddZeddZeddZed d Zd d Z d dZ eddZ dddddddde e f ddZddZddZddddde efddZddddde efddZdS)_PropertyMixina1Abstract mixin for cloud storage classes with associated properties. Non-abstract subclasses should implement: - path - client - user_project :type name: str :param name: The name of the object. Bucket names must start and end with a number or letter. NcCs||_i|_t|_dSr)r/ _propertiesset_changes)selfr/r#r#r$__init__ms z_PropertyMixin.__init__cCt)z$Abstract getter for the object path.NotImplementedErrorr5r#r#r$pathrz_PropertyMixin.pathcCr7)z&Abstract getter for the object client.r8r:r#r#r$clientwr<z_PropertyMixin.clientcCr7)z,Abstract getter for the object user_project.r8r:r#r#r$ user_project|r<z_PropertyMixin.user_projectcCs|dur|j}|S)aCheck client or verify over-ride. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :rtype: :class:`google.cloud.storage.client.Client` :returns: The client passed in or the currently bound client. N)r=)r5r=r#r#r$_require_clients z_PropertyMixin._require_clientcCsiS)a@Return any encryption headers needed to fetch the object. .. note:: Defined here because :meth:`reload` calls it, but this method is really only relevant for :class:`~google.cloud.storage.blob.Blob`. :rtype: dict :returns: a mapping of encryption-related headers. r#r:r#r#r$_encryption_headerss z"_PropertyMixin._encryption_headerscCsi}|jdur |j|d<|S)zDefault query parameters.N userProject)r>)r5paramsr#r#r$ _query_paramss  z_PropertyMixin._query_paramsnoAclc Csf||}|j} || d<t| ||||d|} t| ||d|j|j| | | | |d} || dS)a<Reload properties from Cloud Storage. If :attr:`user_project` is set, bills the API request to that project. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :type projection: str :param projection: (Optional) If used, must be 'full' or 'noAcl'. Defaults to ``'noAcl'``. Specifies the set of properties to return. :type if_etag_match: Union[str, Set[str]] :param if_etag_match: (Optional) See :ref:`using-if-etag-match` :type if_etag_not_match: Union[str, Set[str]]) :param if_etag_not_match: (Optional) See :ref:`using-if-etag-not-match` :type if_generation_match: long :param if_generation_match: (Optional) See :ref:`using-if-generation-match` :type if_generation_not_match: long :param if_generation_not_match: (Optional) See :ref:`using-if-generation-not-match` :type if_metageneration_match: long :param if_metageneration_match: (Optional) See :ref:`using-if-metageneration-match` :type if_metageneration_not_match: long :param if_metageneration_not_match: (Optional) See :ref:`using-if-metageneration-not-match` :type timeout: float or tuple :param timeout: (Optional) The amount of time, in seconds, to wait for the server response. See: :ref:`configuring_timeouts` :type retry: google.api_core.retry.Retry or google.cloud.storage.retry.ConditionalRetryPolicy :param retry: (Optional) How to retry the RPC. See: :ref:`configuring_retries` projectionr rrr)r r ) query_paramsheaderstimeoutretry_target_objectN)r?rC _add_generation_match_parametersr@_add_etag_match_headers _get_resourcer;_set_properties)r5r=rEr r r rrrrIrJrGrH api_responser#r#r$reloads. :z_PropertyMixin.reloadcCs|j|||j|<dS)aUpdate field of this object's properties. This method will only update the field provided and will not touch the other fields. It **will not** reload the properties from the server. The behavior is local only and syncing occurs via :meth:`patch`. :type name: str :param name: The field name to update. :type value: object :param value: The value being updated. N)r4addr2)r5r/valuer#r#r$_patch_propertys z_PropertyMixin._patch_propertycCs||_t|_dS)zSet the properties for the current object. :type value: dict or :class:`google.cloud.storage.batch._FutureDict` :param value: The properties to be set. N)r2r3r4r5rSr#r#r$rO s z_PropertyMixin._set_propertiesc sd|}j}d|d<t|||||dfddjD} |jj| |||d} | dS)aSends all changed properties in a PATCH request. Updates the ``_properties`` with the response from the backend. If :attr:`user_project` is set, bills the API request to that project. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :type if_generation_match: long :param if_generation_match: (Optional) See :ref:`using-if-generation-match` :type if_generation_not_match: long :param if_generation_not_match: (Optional) See :ref:`using-if-generation-not-match` :type if_metageneration_match: long :param if_metageneration_match: (Optional) See :ref:`using-if-metageneration-match` :type if_metageneration_not_match: long :param if_metageneration_not_match: (Optional) See :ref:`using-if-metageneration-not-match` :type timeout: float or tuple :param timeout: (Optional) The amount of time, in seconds, to wait for the server response. See: :ref:`configuring_timeouts` :type retry: google.api_core.retry.Retry or google.cloud.storage.retry.ConditionalRetryPolicy :param retry: (Optional) How to retry the RPC. See: :ref:`configuring_retries` fullrErFcsi|]}|j|qSr#)r2).0keyr:r#r$ Nz(_PropertyMixin.patch..)rGrKrIrJN)r?rCrLr4_patch_resourcer;rO) r5r=r rrrrIrJrGupdate_propertiesrPr#r:r$patchs( .z_PropertyMixin.patchc CsR||}|j}d|d<t|||||d|j|j|j||||d} || dS)aSends all properties in a PUT request. Updates the ``_properties`` with the response from the backend. If :attr:`user_project` is set, bills the API request to that project. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :type if_generation_match: long :param if_generation_match: (Optional) See :ref:`using-if-generation-match` :type if_generation_not_match: long :param if_generation_not_match: (Optional) See :ref:`using-if-generation-not-match` :type if_metageneration_match: long :param if_metageneration_match: (Optional) See :ref:`using-if-metageneration-match` :type if_metageneration_not_match: long :param if_metageneration_not_match: (Optional) See :ref:`using-if-metageneration-not-match` :type timeout: float or tuple :param timeout: (Optional) The amount of time, in seconds, to wait for the server response. See: :ref:`configuring_timeouts` :type retry: google.api_core.retry.Retry or google.cloud.storage.retry.ConditionalRetryPolicy :param retry: (Optional) How to retry the RPC. See: :ref:`configuring_retries` rVrErF)rGrIrJrKN)r?rCrL _put_resourcer;r2rO) r5r=r rrrrIrJrGrPr#r#r$update[s& .z_PropertyMixin.updater)__name__ __module__ __qualname____doc__r6propertyr;r=r>r?r@rCrrrQrTrOr r]r_r#r#r#r$r1`sT       T  Ir1cs"fdd}fdd}t||S)zHCreate a property descriptor around the :class:`_PropertyMixin` helpers.cs |jS)zScalar property getter.)r2r r: fieldnamer#r$_getters z!_scalar_property.._gettercs||dS)zScalar property setter.N)rTrUrer#r$_settersz!_scalar_property.._setter)rd)rfrgrhr#rer$_scalar_propertys   ri cCs>||}t|dkr||||}t|dks dSdS)aRead blocks from a buffer and update a hash with them. :type buffer_object: bytes buffer :param buffer_object: Buffer containing bytes used to update a hash object. :type hash_obj: object that implements update :param hash_obj: A hash object (MD5 or CRC32-C). :type digest_block_size: int :param digest_block_size: The block size to write to the hash. Defaults to 8192. rN)readlenr_) buffer_objecthash_objdigest_block_sizeblockr#r#r$_write_buffer_to_hashs   rqcCs"t}t|||}t|S)a Get MD5 hash of bytes (as base64). :type buffer_object: bytes buffer :param buffer_object: Buffer containing bytes used to compute an MD5 hash (as base64). :rtype: str :returns: A base64 encoded digest of the MD5 hash. )rrqdigestbase64 b64encode)rmrn digest_bytesr#r#r$_base64_md5hashs  rvcKsBtD]\}}||}|durt|tr|g}d|||<qdS)zAdd generation match parameters into the given parameters list. :type headers: dict :param headers: Headers dict. :type match_parameters: dict :param match_parameters: if*etag*match parameters to add. N, )_ETAG_MATCH_PARAMETERSr isinstancestrjoin)rHmatch_parameterssnakecase_name header_namerSr#r#r$rMs  rMcKsZtD](\}}||}|dur*t|tr|||fqt|tr&|||<qtdqdS)abAdd generation match parameters into the given parameters list. :type parameters: list or dict :param parameters: Parameters list or dict. :type match_parameters: dict :param match_parameters: if*generation*match parameters to add. :raises: :exc:`ValueError` if ``parameters`` is not a ``list()`` or a ``dict()``. Nz5`parameters` argument should be a dict() or a list().)_GENERATION_MATCH_PARAMETERSr rylistappenddictr.) parametersr|r}camelcase_namerSr#r#r$rLs    rLcKsbtdd|Ddkr/dd|D}d|dd}|d}d |d |}t|dS) zRaise ``ValueError`` exception if more than one parameter was set. :type error: :exc:`ValueError` :param error: Description of which fields were set :raises: :class:`~ValueError` containing the fields that were set css|]}|duVqdSrr#)rWargr#r#r$ sz._raise_if_more_than_one_set..cSsg|]}d|dqS)'r#)rWr/r#r#r$ rZz/_raise_if_more_than_one_set..rwNr+zPass at most one of z and )sumvalueskeysr{r.)kwargs escaped_keys keys_but_lastlast_keymsgr#r#r$_raise_if_more_than_one_setsrcCs(t|}|jr |jr |S|d|dS)a!Helper to build bucket bound hostname URL. :type host: str :param host: Host name. :type scheme: str :param scheme: (Optional) Web scheme. If passed, use it as a scheme in the result URL. :rtype: str :returns: A bucket bound hostname URL. z:///)rschemenetloc)hostr url_partsr#r#r$_bucket_bound_hostname_urls rcCsZ|dur |dur td|durtj|j|j|j|jdS|dur'tj|dStjddS)a~Convert google.api.core.Retry to google.resumable_media.RetryStrategy. Custom predicates are not translated. :type retry: google.api_core.Retry :param retry: (Optional) The google.api_core.Retry object to translate. :type num_retries: int :param num_retries: (Optional) The number of retries desired. This is supported for backwards compatibility and is mutually exclusive with `retry`. :rtype: google.resumable_media.RetryStrategy :returns: A RetryStrategy with all applicable attributes copied from input, or a RetryStrategy with max_retries set to 0 if None was input. Nz6num_retries and retry arguments are mutually exclusive) max_sleepmax_cumulative_retry initial_delay multiplier) max_retriesr)r.r RetryStrategy_maximum _deadline_initial _multiplier)rJ num_retriesr#r#r$(_api_core_retry_to_resumable_media_retry(s  rcCsdttS)Nzgccl-invocation-id/)rzrr#r#r#r$_get_invocation_idJr&rapplication/json; charset=UTF-8cCs"dd||dt||p|dS)zGet the headers for a request. Args: user_agent (str): The user-agent for requests. Returns: Dict: The headers to be used for the request. zapplication/jsonz gzip, deflate )AcceptzAccept-Encodingz User-AgentzX-Goog-API-Clientz content-typezx-upload-content-type)r) user_agent content_typex_upload_content_typer#r#r$_get_default_headersNs r)rjr)rN)'rcrshashlibrr urllib.parseruuidrgoogler google.authrgoogle.cloud.storage.constantsrgoogle.cloud.storage.retryrr r!r"_BASE_STORAGE_URIrxr_NUM_RETRIES_MESSAGEr%r*r0objectr1rirqrvrMrLrrrrrr#r#r#r$sN         B   "