CURRENT PATH:
/
opt
/
gsutil
/
gslib
/
__pycache__
/
[ ⬅ KEMBALI ]
|
[ HOME ]
Upload File:
Upload Ke Sini
Dir Baru
File Baru
Editing:
cloud_api_delegator.cpython-39.pyc
a +(Wg}w � @ s� d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlZddlmZ ddlm Z dd l m Z dd l m Z dd l mZ dd l mZ dd lmZ ddlmZ G dd� de �ZdS )zBGsutil API delegator for interacting with cloud storage providers.� )�absolute_import)�print_function)�division)�unicode_literalsN)�config)�context_config)�ArgumentException)�CloudApi)�ApiMapConstants)� ApiSelector)�CommandException)� boto_utilc s e Zd ZdZdj� fdd� Zdd� Zdd � Zdkd d �Zdld d �Zdmdd�Z dndd�Z dodd�Z dpdd�Z dqdd�Z drdd�Zdsdd�Zdtd d �Zdud d �Zdvd d!�Zdwd"d#�Zdxd$d%�Zdyd&d'�Zdddd(ejjddddddf d)d*�Zdzd+d,�Zd{d-d.�Zd|d/d0�Z d}d1d2�Z d~d3d4�Z dd5d6�Z d�d7d8�Z d�d9d:�Z!d�d;d<�Z"d�d=d>�Z#d�d?d@�Z$d�dAdB�Z%d�dCdD�Z&d�dEdF�Z'd�dGdH�Z(d�dIdJ�Z)d�dKdL�Z*d�dMdN�Z+d�dOdP�Z,dQdR� Z-d�dSdT�Z.d�dUdV�Z/d�dXdY�Z0d�dZd[�Z1d�d\d]�Z2d�d^d_�Z3d�d`da�Z4d�dbdc�Z5d�ddde�Z6d�dfdg�Z7d�dhdi�Z8� Z9S )��CloudApiDelegatora� Class that handles delegating requests to gsutil Cloud API implementations. This class is responsible for determining at runtime which gsutil Cloud API implementation should service the request based on the Cloud storage provider, command-level API support, and configuration file override. During initialization it takes as an argument a gsutil_api_map which maps providers to their default and supported gsutil Cloud API implementations (see comments in cs_api_map for details). Instantiation of multiple delegators per-thread is required for multiprocess and/or multithreaded operations. Calling methods on the same delegator in multiple threads is unsafe. Nr c s\ t t| �j|||||||| | d� || _tj�ddd��� | _i | _ | jt j sXt d��dS )a3 Performs necessary setup for delegating cloud storage requests. This function has different arguments than the gsutil Cloud API __init__ function because of the delegation responsibilties of this class. Args: bucket_storage_uri_class: boto storage_uri class, used by APIs that provide boto translation or mocking. gsutil_api_map: Map of providers and API selector tuples to api classes which can be used to communicate with those providers. logger: logging.logger for outputting log messages. status_queue: Queue for relaying status to UI. provider: Default provider prefix describing cloud storage provider to connect to. debug: Debug level for the API implementation (0..3). http_headers (dict|None): Arbitrary headers to be included in every request. trace_token: Apiary trace token to pass to API. perf_trace_token: Performance trace token to use when making API calls. user_project: Project to be billed for this project. ��provider�debug� http_headers� trace_token�perf_trace_token� user_project�GSUtil� prefer_api� z.No apiclass supplied for gsutil Cloud API map.N) �superr �__init__�api_map�botor �get�upperr � loaded_apisr �API_MAPr ) �self�bucket_storage_uri_class�gsutil_api_map�logger� status_queuer r r r r r �� __class__� �(/opt/gsutil/gslib/cloud_api_delegator.pyr 1 s � zCloudApiDelegator.__init__c C sd |p| j }|std��t|�}|| jvr2i | j|< | �|�}|| j| vrV| �||� | j| | S )a� Returns a valid CloudApi for use by the caller. This function lazy-loads connection and credentials using the API map and credential store provided during class initialization. Args: provider: Provider to load API for. If None, class-wide default is used. Raises: ArgumentException if there is no matching API available in the API map. Returns: Valid API instance that can be used to communicate with the Cloud Storage provider. z No provider selected for _GetApi)r r �strr �GetApiSelector�_LoadApi�r! r Z api_selectorr( r( r) �_GetApi` s zCloudApiDelegator._GetApic C s� || j tj vr td| ��|| j tj | vr@td||f ��| j tj | | | j| j| j|| j| j| j | j | j d� | j | |< dS )z�Loads a CloudApi into the loaded_apis map for this class. Args: provider: Provider to load the API for. api_selector: cs_api_map.ApiSelector defining the API type. z7gsutil Cloud API map contains no entry for provider %s.z=gsutil Cloud API map does not support API %s for provider %s.r N) r r r r r" r$ r% r r r r r r r- r( r( r) r, ~ s, �����zCloudApiDelegator._LoadApic C s" |p| j }|std��|| jtj vsF| jtj | | jtj | vrRtd| ��|| jtj vrntd| ��| jtj | }|dko�t�� }|dko�t � dd�p�t � dd�}|r�|r�t d��n4|r�t j }n(|r�t j}n | j| jtj | v r�| j}|t j k�r t�� �r t�� j�r td ��|S ) a1 Returns a cs_api_map.ApiSelector based on input and configuration. Args: provider: Provider to return the ApiSelector for. If None, class-wide default is used. Returns: cs_api_map.ApiSelector that will be used for calls to the delegator for this provider. z!No provider selected for CloudApiz(No default api available for provider %sz+No supported apis available for provider %s�gsr Zencryption_keyZdecryption_key1a gsutil does not support HMAC credentials with customer-supplied encryption keys (CSEK) or customer-managed KMS encryption keys (CMEK). Please generate and include non-HMAC credentials in your .boto configuration file, or to access public encrypted objects, remove your HMAC credentials.z�User enabled mTLS by setting "use_client_certificate", but mTLS is not supported for the selected XML API. Try configuring for the GCS JSON API or setting "use_client_certificate" to "False" in the Boto config.)r r r r Z DEFAULT_MAPr Z SUPPORT_MAPr � UsingGsHmacr � has_optionr r �XML�JSONr r �get_context_config�use_client_certificate)r! r Zselected_provider�apiZ using_gs_hmacZconfigured_encryptionr( r( r) r+ � sP ���� �� ���z CloudApiDelegator.GetApiSelectorc C s | � |��� S �N)r. �GetServiceAccountId)r! r r( r( r) r8 � s z%CloudApiDelegator.GetServiceAccountIdc C s | � |�j||d�S �N)�fields)r. � GetBucket�r! � bucket_namer r: r( r( r) r; � s zCloudApiDelegator.GetBucketc C s | � |�j||d�S r9 )r. �GetBucketIamPolicyr< r( r( r) r> � s z$CloudApiDelegator.GetBucketIamPolicyc C s | � |��||�S r7 )r. �SetBucketIamPolicy)r! r= �policyr r( r( r) r? � s z$CloudApiDelegator.SetBucketIamPolicyc C s | � |�j||d�S )N)� project_idr: )r. � ListBuckets)r! rA r r: r( r( r) rB � s �z CloudApiDelegator.ListBucketsc C s | � |�j||||||d�S )N)� canned_acl�canned_def_acl� preconditionsr: )r. � PatchBucket)r! r= �metadatarC rD rE r r: r( r( r) rF � s �z CloudApiDelegator.PatchBucketc C s | � |�j|||d�S )N)r )r. �LockRetentionPolicy)r! r= �metagenerationr r( r( r) rH � s �z%CloudApiDelegator.LockRetentionPolicyc C s | � |�j||||d�S )N)rA rG r: )r. � CreateBucket)r! r= rA rG r r: r( r( r) rJ s �z CloudApiDelegator.CreateBucketc C s | � |�j||d�S )N)rE )r. � DeleteBucket)r! r= rE r r( r( r) rK s �z CloudApiDelegator.DeleteBucketc C s | � |�j||||d�S r9 )r. �GetObjectIamPolicy�r! r= � object_name� generationr r: r( r( r) rL s �z$CloudApiDelegator.GetObjectIamPolicyc C s | � |��||||�S r7 )r. �SetObjectIamPolicy)r! r= rN r@ rO r r( r( r) rP s �z$CloudApiDelegator.SetObjectIamPolicyc C s | � |�j|||||d�S )N)�prefix� delimiter� all_versionsr: )r. � ListObjects)r! r= rQ rR rS r r: r( r( r) rT ' s �z CloudApiDelegator.ListObjectsc C s | � |�j||||d�S )N)rO r: )r. �GetObjectMetadatarM r( r( r) rU 4 s �z#CloudApiDelegator.GetObjectMetadatac C s | � |�j|||||||d�S )N)rC rO rE r: )r. �PatchObjectMetadata) r! r= rN rG rC rO rE r r: r( r( r) rV ? s �z%CloudApiDelegator.PatchObjectMetadataFc C s* | � |�j|||||| | ||| | | |d� S )N) �compressed_encoding�download_strategy� start_byte�end_byterO � object_size�progress_callback�serialization_data� digesters�decryption_tuple)r. �GetObjectMedia)r! r= rN �download_streamr rO r[ rW rX rY rZ r\ r] r^ r_ r( r( r) r` Q s �z CloudApiDelegator.GetObjectMediac C s" | � |�j|||||||| | d� S )N)�sizerC rE r\ �encryption_tupler: � gzip_encoded)r. � UploadObject) r! � upload_stream�object_metadatarb rC rE r\ rc r r: rd r( r( r) re o s �z CloudApiDelegator.UploadObjectc C s | � |�j|||||||| d�S )N)rC rE r\ rc r: rd )r. �UploadObjectStreaming) r! rf rg rC rE r\ rc r r: rd r( r( r) rh � s �z'CloudApiDelegator.UploadObjectStreamingc C s& | � | �j||||||||| | | d� S )N) rC rE rb r] �tracker_callbackr\ rc r: rd )r. �UploadObjectResumable) r! rf rg rC rE rb r] ri r\ rc r r: rd r( r( r) rj � s �z'CloudApiDelegator.UploadObjectResumablec C s$ | � | �j||||||||| | d� S )N)�src_generationrC rE r\ �max_bytes_per_callrc r_ r: )r. � CopyObject) r! �src_obj_metadata�dst_obj_metadatark rC rE r\ rl rc r_ r r: r( r( r) rm � s �z CloudApiDelegator.CopyObjectc C s | � |�j|||||d�S )N)rE rc r: )r. � ComposeObject)r! �src_objs_metadataro rE rc r r: r( r( r) rp � s �z CloudApiDelegator.ComposeObjectc C s | � |�j||||d�S )N)rE rO )r. � DeleteObject)r! r= rN rE rO r r( r( r) rr � s �z CloudApiDelegator.DeleteObjectc C s | � |�j|||||d�S )N)�tokenr: )r. � WatchBucket)r! r= �address� channel_idrs r r: r( r( r) rt � s �z CloudApiDelegator.WatchBucketc C s | � |��||�S r7 )r. � StopChannel)r! rv � resource_idr r( r( r) rw � s z CloudApiDelegator.StopChannelc C s | � |��|�S r7 )r. � ListChannels�r! r= r r( r( r) ry � s z CloudApiDelegator.ListChannelsc C s | � |��|�S r7 )r. �GetProjectServiceAccount)r! �project_numberr r( r( r) r{ � s z*CloudApiDelegator.GetProjectServiceAccountc C s | � |��||||||�S r7 )r. �CreateNotificationConfig)r! r= � pubsub_topic�payload_format� event_types�custom_attributes�object_name_prefixr r( r( r) r} � s �z*CloudApiDelegator.CreateNotificationConfigc C s | � |��||�S r7 )r. �DeleteNotificationConfig)r! r= � notificationr r( r( r) r� s �z*CloudApiDelegator.DeleteNotificationConfigc C s | � |��|�S r7 )r. �ListNotificationConfigsrz r( r( r) r� s z)CloudApiDelegator.ListNotificationConfigsc C s | � |��|�S r7 )r. �ListBucketAccessControlsrz r( r( r) r� s z*CloudApiDelegator.ListBucketAccessControlsc C s | � |��||�S r7 )r. �ListObjectAccessControls)r! r= rN r r( r( r) r� s �z*CloudApiDelegator.ListObjectAccessControlsc C s | � |��||�S r7 )r. � CreateHmacKey)r! rA �service_account_emailr r( r( r) r� s �z CloudApiDelegator.CreateHmacKeyc C s | � |��||�S r7 )r. � DeleteHmacKey�r! rA � access_idr r( r( r) r� s z CloudApiDelegator.DeleteHmacKeyc C s | � |��||�S r7 )r. � GetHmacKeyr� r( r( r) r� s z CloudApiDelegator.GetHmacKeyc C s | � |��|||�S r7 )r. � ListHmacKeys)r! rA r� �show_deleted_keysr r( r( r) r� s �z CloudApiDelegator.ListHmacKeysc C s | � |�j|||||||| d�S )N)�method�duration�pathrO r$ �region�signed_headers�string_to_sign_debug)r. �SignUrl) r! r r� r� r� rO r$ r� r� r� r( r( r) r� ' s �zCloudApiDelegator.SignUrlc C s | � |��||||�S r7 )r. � UpdateHmacKey)r! rA r� �state�etagr r( r( r) r� 3 s �z CloudApiDelegator.UpdateHmacKeyc C s | � |�j||d�S )a� XML compatibility function for getting ACLs. Args: storage_url: StorageUrl object. def_obj_acl: If true, get the default object ACL on a bucket. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: ACL XML for the resource specified by storage_url. )� def_obj_acl)r. �XmlPassThroughGetAcl)r! � storage_urlr� r r( r( r) r� 7 s �z&CloudApiDelegator.XmlPassThroughGetAclTc C s | � |�j||||d� dS )a9 XML compatibility function for setting ACLs. Args: acl_text: XML ACL or canned ACL string. storage_url: StorageUrl object. canned: If true, acl_text is treated as a canned ACL string. def_obj_acl: If true, set the default object ACL on a bucket. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: None. )�cannedr� N)r. �XmlPassThroughSetAcl)r! Zacl_textr� r� r� r r( r( r) r� J s �z&CloudApiDelegator.XmlPassThroughSetAclc C s | � |��|�S )a� XML compatibility function for getting CORS configuration on a bucket. Args: storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: CORS configuration XML for the bucket specified by storage_url. )r. �XmlPassThroughGetCors�r! r� r r( r( r) r� f s z'CloudApiDelegator.XmlPassThroughGetCorsc C s | � |��||� dS )a� XML compatibility function for setting CORS configuration on a bucket. Args: cors_text: Raw CORS XML string. storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: None. N)r. �XmlPassThroughSetCors)r! Z cors_textr� r r( r( r) r� w s z'CloudApiDelegator.XmlPassThroughSetCorsc C s | � |��|�S )a� XML compatibility function for getting lifecycle config on a bucket. Args: storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: Lifecycle configuration XML for the bucket specified by storage_url. )r. �XmlPassThroughGetLifecycler� r( r( r) r� � s z,CloudApiDelegator.XmlPassThroughGetLifecyclec C s | � |��||� dS )a� XML compatibility function for setting lifecycle config on a bucket. Args: lifecycle_text: Raw lifecycle configuration XML string. storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: None. N)r. �XmlPassThroughSetLifecycle)r! Zlifecycle_textr� r r( r( r) r� � s �z,CloudApiDelegator.XmlPassThroughSetLifecyclec C s | � |��|�S )a� XML compatibility function for getting logging configuration on a bucket. Args: storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: Logging configuration XML for the bucket specified by storage_url. )r. �XmlPassThroughGetLoggingr� r( r( r) r� � s z*CloudApiDelegator.XmlPassThroughGetLoggingc C s | � |��||�S )a` XML compatibility function for setting tagging configuration on a bucket. This passthrough provides support for setting a tagging configuration (equivalent to a label configuration) on a cloud bucket. Args: tags_text: Raw tagging configuration XML string. storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: None. )r. �XmlPassThroughSetTagging)r! Z tags_textr� r r( r( r) r� � s �z*CloudApiDelegator.XmlPassThroughSetTaggingc C s | � |��|�S )a� XML compatibility function for getting tagging configuration on a bucket. Args: storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: Tagging configuration XML for the bucket specified by storage_url. )r. �XmlPassThroughGetTaggingr� r( r( r) r� � s z*CloudApiDelegator.XmlPassThroughGetTaggingc C s | � |��|�S )a� XML compatibility function for getting website configuration on a bucket. Args: storage_url: StorageUrl object. provider: Cloud storage provider to connect to. If not present, class-wide default is used. Raises: ArgumentException for errors during input validation. ServiceException for errors interacting with cloud storage providers. Returns: Website configuration XML for the bucket specified by storage_url. )r. �XmlPassThroughGetWebsiter� r( r( r) r� � s z*CloudApiDelegator.XmlPassThroughGetWebsite)Nr NNNN)N)N)NN)NN)N)NNN)NNNNN)N)NNNN)NN)NNN)NN)NNNNN)NNN)NNNNN)NNNNNNNF)NNNNNNF) NNNNNNNNNF) NNNNNNNNN)NNNN)NNN)NNN)N)N)N)NNNN)N)N)N)N)N)N)N)FN)N)FN)TFN)N)N)N)N)N)N)N)N):�__name__� __module__� __qualname__�__doc__r r. r, r+ r8 r; r> r? rB rF rH rJ rK rL rP rT rU rV r �DownloadStrategy�ONE_SHOTr` re rh rj rm rp rr rt rw ry r{ r} r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� � __classcell__r( r( r& r) r ! s* �/ G � � � � � � � � ! � � � � � � � � � � � r )r� � __future__r r r r r r �gslibr �gslib.cloud_apir r �gslib.cs_api_mapr r �gslib.exceptionr � gslib.utilsr r r( r( r( r) �<module> s
SIMPAN
[ BATAL ]