CURRENT PATH:
/
opt
/
gsutil
/
gslib
/
commands
/
__pycache__
/
[ ⬅ KEMBALI ]
|
[ HOME ]
Upload File:
Upload Ke Sini
Dir Baru
File Baru
Editing:
setmeta.cpython-39.pyc
a +(Wgs? � @ s� d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlZddlmZ ddl m Z dd l m Z dd l m Z dd l mZ dd lmZ dd lmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddl m Z ddl m Z ddl m!Z! ddl"m#Z# ddl$m%Z% ddl&m'Z' ddl(m)Z) ddl(m*Z* ddl+m,Z, dd l+m-Z- dd l.m/Z/ dd l.m0Z0 dd l.m1Z1 e!j2Z3d Z4d!e4 d" Z5g d#�Z6g d$�Z7d%d&� Z8d+d'd(�Z9G d)d*� d*e�Z:dS ),zDImplementation of setmeta command for setting cloud object metadata.� )�absolute_import)�print_function)�division)�unicode_literalsN)�encoding)�AccessDeniedException)�PreconditionException)� Preconditions)�Command)�CommandArgument)� ApiSelector)�CommandException)�NameExpansionIterator)� SeekAheadNameExpansionIterator)�StorageUrlFromString)�storage_v1_messages)�MetadataMessage)� constants)�parallelism_framework_util)�GetCloudApiInstance)�IsCustomMetadataHeader)�Retry)�GcloudStorageFlag)�GcloudStorageMap)�InsistAsciiHeader)�InsistAsciiHeaderValue)�CopyObjectMetadata)�ObjectMetadataFromHeaders)�PreconditionsFromHeadersz6 gsutil setmeta -h [header:value|header] ... url... z <B>SYNOPSIS</B> u� <B>DESCRIPTION</B> The gsutil setmeta command allows you to set or remove the metadata on one or more objects. It takes one or more header arguments followed by one or more URLs, where each header argument is in one of two forms: - If you specify ``header:value``, it sets the provided value for the given header on all applicable objects. - If you specify ``header`` (with no value), it removes the given header from all applicable objects. For example, the following command sets the ``Content-Type`` and ``Cache-Control`` headers while also removing the ``Content-Disposition`` header on the specified objects: gsutil setmeta -h "Content-Type:text/html" \ -h "Cache-Control:public, max-age=3600" \ -h "Content-Disposition" gs://bucket/*.html If you have a large number of objects to update you might want to use the gsutil -m option, to perform a parallel (multi-threaded/multi-processing) update: gsutil -m setmeta -h "Content-Type:text/html" \ -h "Cache-Control:public, max-age=3600" \ -h "Content-Disposition" gs://bucket/*.html You can also use the setmeta command to set custom metadata on an object: gsutil setmeta -h "x-goog-meta-icecreamflavor:vanilla" gs://bucket/object Custom metadata is always prefixed in gsutil with ``x-goog-meta-``. This distinguishes it from standard request headers. Other tools that send and receive object metadata by using the request body do not use this prefix. While gsutil supports custom metadata with arbitrary Unicode values, note that when setting metadata using the XML API, which sends metadata as HTTP headers, Unicode characters are encoded using UTF-8, then url-encoded to ASCII. For example: gsutil setmeta -h "x-goog-meta-foo: ã" gs://bucket/object stores the custom metadata key-value pair of ``foo`` and ``%C3%A3``. Subsequently, running ``ls -L`` using the JSON API to list the object's metadata prints ``%C3%A3``, while ``ls -L`` using the XML API url-decodes this value automatically, printing the character ``ã``. The setmeta command reads each object's current generation and metageneration and uses those as preconditions unless they are otherwise specified by top-level arguments. For example, the following command sets the custom metadata ``icecreamflavor:vanilla`` if the current live object has a metageneration of 2: gsutil -h "x-goog-if-metageneration-match:2" setmeta -h "x-goog-meta-icecreamflavor:vanilla" See `Object metadata <https://cloud.google.com/storage/docs/metadata>`_ for more information about object metadata. <B>OPTIONS</B> -h Specifies a header:value to be added, or header to be removed, from each named object. )z cache-controlzcontent-dispositionzcontent-encodingzcontent-languagez content-typez custom-time)�storage�objects�updatec C s | j �|� d| _dS )zDException handler that maintains state about post-completion status.FN)�logger�error�everything_set_okay)�cls�e� r' �%/opt/gsutil/gslib/commands/setmeta.py� _SetMetadataExceptionHandler� s r) c C s | j ||d� d S )N�� thread_state)�SetMetadataFunc)r% �name_expansion_resultr+ r' r' r( �_SetMetadataFuncWrapper� s r. c s� e Zd ZdZejddgedejdddde j e j ge j e � � gd� Zejddgdd ei d �Zeei d �Z� fd d �Zdd� Zeeddd�ddd��Zdd� Zdd� Z� Z S )�SetMetaCommandz)Implementation of gsutil setmeta command.�setmetaZ setheader� zh:rRF) �command_name_aliases�usage_synopsis�min_args�max_args�supported_sub_args� file_url_ok�provider_url_ok�urls_start_arg�gs_api_support�gs_default_api�argparse_arguments� command_helpz(Set metadata on already uploaded objects)� help_name�help_name_aliases� help_type�help_one_line_summary� help_text�subcommand_help_text��gcloud_command�flag_mapc s� g }| j D ]\}}|dv r dg} q&q | �| �� �\}}g | _ | jdd� |D �dd�}| j|dd�}t| | | }t|i d�} t� �| �S ) N)z-rz-Rz --recursivec S s i | ] }|d �qS )Nr' )�.0Z clear_keyr' r' r( � <dictcomp>� � z:SetMetaCommand.get_gcloud_storage_args.<locals>.<dictcomp>T)�unsetFrD )�sub_opts�_ParseMetadataHeaders� _GetHeaderStringsFromSubOpts�_translate_headers� _GCLOUD_OBJECTS_UPDATE_COMMANDr �super�get_gcloud_storage_args) �selfZrecursive_flag�o�_Z clear_setZset_dict� clear_flags� set_flags�command�gcloud_storage_map�� __class__r' r( rQ � s* �� ��z&SetMetaCommand.get_gcloud_storage_argsc C sN | � | �� �\}}|| _|D ]}d| j|< q | js:td��t| j�dkr~| js~t| jd �}|�� rl|� � s~td| jd ��d| _ t | j �| _ t| j| j| j| j| j| j| j| jg d�d� }t| j| j| �� | j| j| j| jd �}z| jt|td|d � W n< t�y8 } z"|j d k�r"| � � � W Y d }~n d }~0 0 | j �sJtd ��dS )z,Command entry point for the setmeta command.� z|gsutil setmeta requires one or more headers to be provided with the -h flag. See "gsutil help setmeta" for more information.r1 r z URL (%s) must name an objectT)� generation�metadata�metageneration)� all_versions�continue_on_error�bucket_listing_fields)r_ � project_id)� fail_on_error�seek_ahead_iteratori� Nz+Metadata for some objects could not be set.) rL rM �metadata_changer �len�args�recursion_requestedr � IsCloudUrl�IsObjectr$ r �headers� preconditionsr � command_name�debugr" � gsutil_apir_ �parallel_operationsr �GetSeekAheadGsutilApirb �Applyr. r) r �status�_WarnServiceAccounts)rR �metadata_minus� metadata_plus�header�url�name_expansion_iteratorrd r& r' r' r( � RunCommand� sd � � � � � zSetMetaCommand.RunCommand� )�tries� timeout_secsNc C s� t | |d�}|j}| j�d|� t�tj|j�}t | j j | j j d�}|j du rV|j |_ |j du rh|j|_ t| j�}|j|jd�}|tjkr�n(|tjkr�t||dd� |}d|_ d|_|j|j|j||j ||jdgd � t|jt t � � d �� dS ) z�Sets metadata on an object. Args: name_expansion_result: NameExpansionResult describing target object. thread_state: gsutil Cloud API instance to use for the operation. r* zSetting metadata on %s...)� gen_match�meta_gen_matchN)�providerT)�override�id)r\ rl r� �fields)� message_time) r �expanded_storage_urlr" �infor � JsonToMessage�apitools_messages�Object�expanded_resultr rl r~ r r\ r^ r re �GetApiSelector�schemer �XML�JSONr �PatchObjectMetadata� bucket_name� object_name�_PutToQueueWithTimeout� status_queuer �time) rR r- r+ ro � exp_src_url�cloud_obj_metadatarl �patch_obj_metadata�apir' r' r( r, sD �� � �z SetMetaCommand.SetMetadataFuncc C sL | j s g S g }| j D ]2\}}|dkrd|v s4d|v r<td��|�|� q|S )a: Gets header values from after the "setmeta" part of the command. Example: $ gsutil -h not:parsed setmeta is:parsed gs://bucket/object -> ["is:parsed"] Returns: List[str]: Headers without the "-h" but not yet split on colons. Raises: CommandException Found canned ACL. z-hz x-goog-aclz x-amz-aclzWgsutil setmeta no longer allows canned ACLs. Use gsutil acl set ... to set canned ACLs.)rK r �append)rR rk rS �ar' r' r( rM @ s � z+SetMetaCommand._GetHeaderStringsFromSubOptsc C sV t � }t � }i }i }d}d}d}d} |D ]�} | �d�} | \} } }t| � | �� }t|�}|s||tvr|td| ttt��f ��|r�|r�||| < |d7 }q�t | |� t |�}|||< |d7 }q(|r�|� | � | d7 } q(|� |� |d7 }q(|t |�k�s2|t |�k�s2|t |�k�s2| t |�k�s2|� t |�� ���r:td��|�|� |�|� ||fS )z�Validates and parses metadata changes from the headers argument. Args: headers: Header dict to validate and parse. Returns: (metadata_plus, metadata_minus): Tuple of header sets to add and remove. r �:zhInvalid or disallowed header (%s). Only these fields (plus x-goog-meta-* fields) can be set or unset: %sr1 z%Each header must appear at most once.)�set� partitionr �lowerr �SETTABLE_FIELDSr �sorted�listr �str�addrf � intersection�keysr! )rR rk ru Zcust_metadata_minusrv Zcust_metadata_plusZnum_metadata_plus_elemsZ num_cust_metadata_plus_elemsZnum_metadata_minus_elemsZ num_cust_metadata_minus_elemsZmd_arg�partsrw rT �valueZlowercase_headerZis_custom_metar' r' r( rL X s\ �� � � �� z$SetMetaCommand._ParseMetadataHeaders)N) �__name__� __module__� __qualname__�__doc__r �CreateCommandSpec� _SYNOPSISr �NO_MAXr r� r� r � MakeZeroOrMoreCloudURLsArgument� command_spec�HelpSpec�_DETAILED_HELP_TEXT� help_specr rO rX rQ rz r r r, rM rL � __classcell__r' r' rY r( r/ � sH ���� � ? 1r/ )N);r� � __future__r r r r r� �apitools.base.pyr �gslib.cloud_apir r r � gslib.commandr �gslib.command_argumentr �gslib.cs_api_mapr �gslib.exceptionr �gslib.name_expansionr r �gslib.storage_urlr �"gslib.third_party.storage_apitoolsr r� �gslib.thread_messager Z gslib.utilsr r � gslib.utils.cloud_api_helperr �gslib.utils.metadata_utilr �gslib.utils.retry_utilr �gslib.utils.shim_utilr r Zgslib.utils.text_utilr r � gslib.utils.translation_helperr r r �PutToQueueWithTimeoutr� r� r� r� rO r) r. r/ r' r' r' r( �<module> sT ��H
SIMPAN
[ BATAL ]