CURRENT PATH:
/
opt
/
gsutil
/
gslib
/
__pycache__
/
[ ⬅ KEMBALI ]
|
[ HOME ]
Upload File:
Upload Ke Sini
Dir Baru
File Baru
Editing:
__main__.cpython-39.pyc
a +(WgY� � @ s� d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlZddlmZ ddlmZ dd lmZ ddlZdd lmZ dd lmZ dd l m Z dd l m Z ddl m!Z! ddl"Z"ddlZddl#m$Z$m%Z% ddlm&Z& ze � \Z'Z(W n� e�y� Z) z~e)j*�rVe)j+nde)j+ Z+de+ Z,ze%j-e,dej.d� W n e/�y� ej.�0e,� Y n0 e)�r�e&�1e)� e�2d� W Y dZ)[)n dZ)[)0 0 e!e(e&j3�4� �e_5e" j6ej57 _6ddl7Z7ddl8Z8ddl9m:Z: ddl9m;Z< ddlm=Z= ddlm>Z> ddl?m@Z@ ddl?mAZA dd l?mBZB dd l?mCZC dd l?mDZD dd lEmFZF ddlGmH mI mZJ dd l#mKZK dd!l#mLZL dd"l#m$Z$ dd#lMmNZN dd$lMmOZO dd%lMmPZP g d&�ZQz ddlRZRW n eS�y Y n0 d'�T� ZUd(�T� ZVd)�T� ZWdaXd*aYd+d,� ZZd-d.� Z[dLd/d0�Z\d1d2� Z]G d3d4� d4e j^�Z_e j`fd5d6�Zad7d8� Zbd9d:� Zcd;d<� Zdd=d>� Zed?d@� ZfdAdB� ZgdCdD� ZhdEdF� ZidMdGdH�ZjdIdJ� ZkeldKk�r�e�2eb� � dS )Nz7Main module for Google Cloud Storage command line tool.� )�absolute_import)�print_function)�division)�unicode_literalsN)� configparser)�range)� exceptions)�CommandException)�ControlCException)� check_python_version_support)�GetArgumentsAndOptions)� GetUserAgent)� system_util� text_util)�metrics�CommandException: %s�%s � ��end�file� )� reauth_creds)�errors)�context_config)�wildcard_iterator)�AccessDeniedException)�ArgumentException)�BadRequestException)�ProjectIdException)�ServiceException)� CommandRunner)� boto_util)� constants)r )�GetCaughtSignals)�InitializeSignalHandling)�RegisterSignalHandler)�proxy� proxy_port� proxy_user� proxy_passa� ***************************** WARNING ***************************** *** You are running gsutil with debug output enabled. *** Be aware that debug output includes authentication credentials. *** Make sure to remove the value of the Authorization header for *** each HTTP request printed to the console prior to posting to *** a public medium such as a forum post or Stack Overflow. ***************************** WARNING ***************************** aK ***************************** WARNING ***************************** *** You are running gsutil with trace output enabled. *** Be aware that trace output includes authentication credentials *** and may include the contents of any files accessed during the trace. ***************************** WARNING ***************************** a� ***************************** WARNING ***************************** *** You are running gsutil with the "https_validate_certificates" config *** variable set to False. This option should always be set to True in *** production environments to protect against man-in-the-middle attacks, *** and leaking of user data. ***************************** WARNING ***************************** Fc C s" t � tjj�� jr tj�� dS )aT Cleans up if process is killed with SIGINT, SIGQUIT or SIGTERM. Note that this method is called after main() has been called, so it has access to all the modules imported at the start of main(). Args: signal_num: Unused, but required in the method signature. cur_stack_frame: Unused, but required in the method signature. N)�_Cleanup�gslib�utils�parallelism_framework_util�$CheckMultiprocessingAvailableAndInit� is_available�commandZ TeardownMultiprocessingProcesses)� signal_num�cur_stack_frame� r4 � /opt/gsutil/gslib/__main__.py�_CleanupSignalHandler� s r6 c C s. t �� D ] } zt�| � W q Y q0 qd S )N)r" ZGetCleanupFiles�os�unlink)Zfnamer4 r4 r5 r+ � s r+ c C s� t tjkstr.t�� }dt�dd|�| f }nd| }ztj |dt j d� W n t yj t j � |� Y n0 |rzt�|� t �d� dS ) z�Outputs message to stderr and exits gsutil with code 1. This function should only be called in single-process, single-threaded mode. Args: message: Message to print to stderr. exception: The exception that caused gsutil to fail. z(DEBUG: Exception stack trace: %s %s �\n� r r r r N)� debug_levelr# �DEBUGLEVEL_DUMP_REQUESTS�test_exception_traces� tracebackZ format_exc�re�subr � print_to_fd�sys�stderr�UnicodeDecodeError�writer � LogFatalError�exit)�message� exception� stack_trace�errr4 r4 r5 �_OutputAndExit� s � rL c C s | � d� t�d� d S )N�helpr )�RunNamedCommandrB rG )�command_runnerr4 r4 r5 �_OutputUsageAndExit� s rP c s" e Zd ZdZd� fdd� Z� ZS )�GsutilFormatterz<A logging.Formatter that supports logging microseconds (%f).Nc s, |rt j �|j��|�S tt| �j||d�S )N)�datefmt)�datetimeZ fromtimestampZcreated�strftime�superrQ � formatTime)�self�recordrR �� __class__r4 r5 rV � s zGsutilFormatter.formatTime)N)�__name__� __module__� __qualname__�__doc__rV � __classcell__r4 r4 rY r5 rQ � s rQ c C sF d}d}t ||d�}t�� }|�|� t�� }|�|� |�| � dS )zASimilar to logging.basicConfig() except it always adds a handler.z3%(levelname)s %(asctime)s %(filename)s] %(message)sz%m%d %H:%M:%S.%f)ZfmtrR N)rQ �loggingZ StreamHandlerZ setFormatter� getLoggerZ addHandler�setLevel)�levelZ log_formatZ date_formatZ formatterZhandlerZ root_loggerr4 r4 r5 �_ConfigureRootLogger� s rd c # C sx t � dd l} dd l} dd l} ddlm} ddlm} | jj � � j rZ| j � � | j� � n | j �� zLdd l}t�� \}}|j�||� |j�| jj �� � |�| jj �� � W n ty� Y n0 t� \}}|s�t|��t�d� t � � t� � t � }t j �std�!t"�#d����i } d} d} d} da$d } d }da%d }t&tj'�dk�rVtj'�(d� t)j*�+d d ��s�t)j*�,d ��s�t)j*�-d � t)j*�.d d d � t/� D ]}t0|t1� �q��z�t2D �]�\}}|d v �r�t3j4a$�q�|d v �r�t$t3j4k�r�t3j5a$nt3j4a$�q�|dv �r t6|� �q�|dv �rB|�7d�\}}}|�s4t6|� || |�8� < n�|dv �rRd } n�|dv �rbd } n�|dk�rr|}n�|dv �r�d } n�|dv �r�|t3_9n�|dk�r�|}n�|dk�r�|} n�|dk�r�d a%dt3_:nv|dv �r�|�7d�\}}}|�s�t6|� |�7d�\}}}|�r|�st6|� t)j*�,|��s0t)j*�-|� t)j*�;|||� �q�t �<� t _=t>j?t2d � t$t@_A| �rrtjB�CtD� t$t3j4k�rZtjB�CtE� tFtGjHd � |�Id d g� g }d D ]4}z|�Jt)j*�K|�� W n tLjM�y� Y n0 �q�tNt&|��D ](} || d } | tOv �r�| d!f|| < �q�tjB�Cd"d#�!tj'� � tjB�Cd$t �P� � tjB�Cd%tQ|� � n`| �rftGjRntGjS} tGjR} tGjT} tF| d � tUjVjW�X| � tUjYjZjW�X| � tUj[j\�X| � t]j\�X| � dd l^}!|!j_j`|!_`t ja�s�tjB�Ctb� | �r�d&}"n,tc�s�d}"n tcd }"|"d'k�rtd�etG�f� � tg� thji�jd(d)�d*v �rBtk|�W tl� S tm||"tcdd � | t$| | ||d+� W tl� S tl� 0 d S ),Nr )� oauth2_client)�credentials_libr � zcYour boto configuration has is_secure = False. Gsutil cannot be run this way, for security reasons.FrM �BotoZhttps_validate_certificatesT)z-dz--debug)z-Dz--detailedDebug)z-?z--help)z-hz--header�:)z-mz--multithreaded)z-qz--quietz-u)z-vz --version)z-iz --impersonate-service-accountz--perf-trace-tokenz --trace-tokenz--testexceptiontracesi )z-oz--option�=)Z global_opts)rc �verz-l)rh �GSUtilZREDACTEDzCommand being run: %s � zconfig_file_list: %s z config: %s �version�testZ _ARGCOMPLETE�0)�1�2)�args�headersr; � trace_token�parallel_operations�perf_trace_token� user_project)nr% Zgslib.boto_translationZ gslib.commandZ&gslib.utils.parallelism_framework_util�gcs_oauth2_boto_pluginre Zapitools.base.pyrf r- r. r/ r0 r1 Z"InitializeMultiprocessingVariablesZboto_translationZ InitializeThreadingVariablesr ZGetGsutilClientIdAndSecretZ oauth2_helperZ SetFallbackClientIdAndSecretZSetLockZ CreateLockZSetCredentialsCacheFileLock� ImportErrorr r rB rG r" ZMonkeyPatchBotoZMonkeyPatchHttpr! ZBOTO_IS_SECURE�join�textwrap�wrapr; r= �len�argv�append�boto�configZ has_optionZ has_sectionZ add_sectionZsetboolr$ r& r6 �optsr# r< Z%DEBUGLEVEL_DUMP_REQUESTS_AND_PAYLOADSrP � partition�lowerZIMPERSONATE_SERVICE_ACCOUNTZLONG_RETRY_WARN_SEC�setZConfigureCertsFileZconfigured_certs_filer ZLogCommandParams�httplib2Z debuglevelrC rE � TRACE_WARNING� DEBUG_WARNINGrd r` �DEBUGrN �extend�itemsr ZNoSectionErrorr �CONFIG_KEYS_TO_REDACT�GetFriendlyConfigFilePaths�strZWARNING�INFOZERROR� oauth2client�client�loggerrb ZcontribZmultiprocess_file_storageZ transportZ_LOGGERr �six�moves�inputZ CERTIFICATE_VALIDATION_ENABLED� HTTP_WARNINGrs r Zcreate_context_configra � _CheckAndWarnForProxyDifferencesr7 �environ�get�_PerformTabCompletionr+ �#_RunNamedCommandAndHandleExceptions)#r, re rf ry Zgsutil_client_idZgsutil_client_secret� supportedrK rO rt rv �quietrn ru rw rx r2 �o�aZhdr_name�_Zhdr_valZopt_section_nameZ opt_valueZ opt_sectionZopt_nameZ config_itemsZconfig_section�iZconfig_item_keyZroot_logger_levelZoa2c_logger_levelZ+oa2c_multiprocess_file_storage_logger_levelr� � command_namer4 r4 r5 �main� sB �� � � �� � � � � � r� c C sZ t j�ddd�} t j�ddd �s&| �rVdD �](}|tjv r*tj| r*g }t�|�}|jt j�ddd �kr�|� dt j�ddd �||jf � |j t j�ddd �kr�|� dt j�ddd �||j f � |j t j�dd d �kr�|� d | � |j s�| �r|j | k�r|� d | ||j f � |�rLt j�d �t�d | ��� t j�dd �|� � tj|= q*d S )Nrh r( r r' )Z http_proxyZ https_proxyZ HTTPS_PROXYz6Boto proxy host: "%s" differs from %s proxy host: "%s"r) z6Boto proxy user: "%s" differs from %s proxy user: "%s"r* z2Boto proxy password differs from %s proxy passwordz6Boto proxy port: "%s" differs from %s proxy port: "%s"rg z�WARNING: Proxy configuration is present in both the %s environment variable and boto configuration, but configuration differs. boto configuration proxy values will be used. Differences detected:z %s )r� r� Zgetintr� r7 r� r" ZProxyInfoFromEnvironmentVarZ proxy_hostr� r) r* r( rB rC rE r{ r| r} )Z boto_portZ proxy_env_varZdiffering_valuesZ proxy_infor4 r4 r5 r� � sl ����� ������� � �� ���r� c C s � t d| | d� d S )Nz Failure: %s.�rH rI )rL ��er4 r4 r5 �_HandleUnknownFailure� s r� c C s, | j rt| j| d� ntd| j | d� d S )Nr� r )� informationalrL �reasonr� r4 r4 r5 �_HandleCommandException� s r� c C sT t dkr>d�t�t�� ��}td| t�dd|�f t� d� ntd| t� d� dS ) z�Called when user hits ^C. This function prints a brief message instead of the normal Python stack trace (unless -D option is used). Args: signal_num: Signal that was caught. cur_stack_frame: Unused. � r z@DEBUG: Caught CTRL-C (signal %d) - Exception stack trace: %sr9 r: �rI z#Caught CTRL-C (signal %d) - exitingN) r; r{ r> � format_listZ extract_stackrL r? r@ r )r2 r3 rJ r4 r4 r5 �_HandleControlC� s ���r� c C s ddl }|�� dS )zFCalled when user hits ^\, so we can force breakpoint a running gsutil.r N)�pdbZ set_trace)r2 r3 r� r4 r4 r5 �_HandleSigQuit s r� c C s. t j�dd�}d}|r"|d| 7 }|d7 }|S )z�Constructs a help string for an access control error. Args: reason: e.reason string from caught exception. Returns: Contructed help text. rl �default_project_idaX Your request resulted in an AccountProblem (403) error. Usually this happens if you attempt to create a bucket without first having enabled billing for the project you are using. Please ensure billing is enabled for your project by following the instructions at `Google Cloud Platform Console<https://support.google.com/cloud/answer/6158867>`. z�In the project overview, ensure that the Project Number listed for your project matches the project ID (%s) from your boto config file. a� If the above doesn't resolve your AccountProblem, please send mail to buganizer-system+187143@google.com requesting assistance, noting the exact command you ran, the fact that you received a 403 AccountProblem error, and your project ID. Please do not post your project ID on StackOverflow. Note: It's possible to use Google Cloud Storage without enabling billing if you're only listing or reading objects for which you're authorized, or if you're uploading objects to a bucket billed to a project that has billing enabled. But if you're attempting to create buckets or upload objects to a bucket owned by your own project, you must first enable billing for that project.)r� r� � get_value)r� r� Z acct_helpr4 r4 r5 � _ConstructAccountProblemHelp s ���� r� c C s� t �� sPtj�ddd�sPt�� r2d�t� d��}nd�t� d��}t || d� nV| j r�| j dkst| j d kstd | j v r�d �|�� d �d kr�t d�t� t | j ���| d� d S )NZTestsZ bypass_anonymous_access_warningFrg z�You are attempting to access protected data with no configured credentials. Please visit https://cloud.google.com/console#/project and sign up for an account, and then run the "gcloud auth login" command to configure gsutil to use these credentials.z�You are attempting to access protected data with no configured credentials. Please visit https://cloud.google.com/console#/project and sign up for an account, and then run the "gsutil config" command to configure gsutil to use these credentials.r� ZAccountProblemzAccount disabled.z3account for the specified project has been disabled�,zgs://���r� )r" ZHasConfiguredCredentialsr� r� r� r �InvokedViaCloudSdkr{ r| r} rL r� �findr� )r� rs rH r4 r4 r5 �"_CheckAndHandleCredentialException> s: �����������r� c C s* z@t tjtdd� tjs$t tjt� | j|||||||d|d� W S t y� } z>t | �� d�dkrpt d| d� nt t | �| d� W Y d } ~ �n�d } ~ 0 t y� } zt| � W Y d } ~ �nld } ~ 0 tjy� } z tt | j�� W Y d } ~ �n8d } ~ 0 tjj�y2 } z t d | j | d� W Y d } ~ �n�d } ~ 0 tjj�yn } z t d | j | d� W Y d } ~ �n�d } ~ 0 tjj�y� } zt d | d� W Y d } ~ �n�d } ~ 0 tjj�y� } z t t | �| d� W Y d } ~ �nPd } ~ 0 t�yP } zZ| j t j k�s tj�r(| j t j k�r(t� � �s(t �!d � nt d| j" | d� W Y d } ~ �n�d } ~ 0 t#�y� } zJ| j t j k�s�tj�r�| j t j k�r�t� � �s�t �!d � n� W Y d } ~ �n|d } ~ 0 t$j%�y� } z t | j&| d� W Y d } ~ �nFd } ~ 0 t'�y } zt d| d� W Y d } ~ �nd } ~ 0 t(�yb } z0| j&dk�r@t)| |� t | | d� W Y d } ~ �n�d } ~ 0 t*�y� } z$t)| |� t | | d� W Y d } ~ �n�d } ~ 0 t+�y� } zt | | d� W Y d } ~ �n^d } ~ 0 t,�y } zt | | d� W Y d } ~ �n,d } ~ 0 t-j.j/t0j1t0j2f�yZ } z2t�3� �r8t d| d� n t d| d� W Y d } ~ �n�d } ~ 0 t4j5�y� } z4t dt6| j7dd�| j8�p�df | d� W Y d } ~ �n�d } ~ 0 t9j:�y4 } zr| j;d t j k�r�t d| d� nF| j;d t j<k�rd�=|��>d��rt d�=t?�@d��| d� ntA| � W Y d } ~ n�d } ~ 0 t-j.jB�y| } z,t dd�=t?�@d | �� | d� W Y d } ~ n�d } ~ 0 tCjD�y� t�3� �r�t d � nt d � Y nz tE�y$ } z`d �=tF�G� �} d t | �v �r�t d!| | d� n d"t | �v �rt d#| | d� tA| � W Y d } ~ n d } ~ 0 0 d S )$z/Runs the command and handles common exceptions.T)Zis_final_handler)rw Zcollect_analyticsrx Zsecret_access_keyr� zdMissing credentials for the given URI(s). Does your boto config file contain all needed credentials?r� r� NzInvalidUriError: %s.zInvalidUrlError: %s.�NotReadyToAuthenticater z OSError: %s.z�You are attempting to perform an operation that requires a project id, with none configured. Please re-run gsutil config and make sure to follow the instructions for finding and entering your default project id.ZMissingSecurityHeaderz<Your credentials are invalid. Please run $ gcloud auth loginz�Your credentials are invalid. For more help, see "gsutil help creds", or re-run the gsutil config command (see "gsutil help config").zHttpError: %s, %s�statusr a< Got a "Broken pipe" error. This can happen to clients using Python 2.x, when the server sends an error response and then closes the socket (see http://bugs.python.org/issue5542). If you are trying to upload a large object you might retry with a small (say 200k) object, and see if you get a more specific error code.rm zs3://rg ac Got a "Connection reset by peer" error. One way this can happen is when copying data to/from an S3 regional bucket. If you are using a regional S3 bucket you could try re-running this command using the regional S3 endpoint, for example s3://s3-<region>.amazonaws.com/your-bucket. For details about this problem see https://github.com/boto/boto/issues/2207z %s z�Failed to retrieve valid credentials (%s). Make sure you selected and pasted the ENTIRE authorization code (including any numeric prefix e.g. '4/').zKYou must re-authenticate with your SAML IdP. Please run $ gcloud auth loginzGYou must re-authenticate with your SAML IdP. Please run $ gsutil configz, zmac verify failurez�Encountered an error while refreshing access token. If you are using a service account, please verify that the gs_service_key_file_password field in your config file(s), %s, is correct.zasn1 encoding routinesz�Encountered an error while refreshing access token. If you are using a service account, please verify that the gs_service_key_file field in your config file(s), %s, is correct.)Hr& �signal�SIGINTr� r Z IS_WINDOWS�SIGQUITr� rN �AttributeErrorr� r� rL r r� �getoptZ GetoptError�msgr� rI ZInvalidUriErrorrH r, �InvalidUrlErrorZ auth_handlerr� �ExternalBinaryError�OSError�errnoZEPIPE�EINVALZIsRunningInteractivelyrB rG �strerror�IOErrorr ZWildcardExceptionr� r r r� r r r r� r� ZHttpAccessTokenRefreshError�google_auth_exceptionsZ OAuthErrorZ RefreshErrorr� �apitools_exceptionsZ HttpError�getattr�response�content�socket�errorrs Z ECONNRESETr{ �containsr| r} r� ZFlowExchangeError� reauth_errorsZ ReauthSamlLoginRequiredError� Exceptionr" r� ) rO r� rs rt r; ru rv rw rx r� Z config_pathsr4 r4 r5 r� c s � �& $(("&� �� (� �� $� " """� �� �� �$��� ���� ����r� c C st zddl }ddl}W n4 tyH } z td| |d� W Y d}~n d}~0 0 |jdd�}| �|� |j|tjd� dS )z6Performs gsutil-specific tab completion for the shell.r NzIA library required for performing tab completion was not found. Cause: %sr� F)Zadd_help)� exit_method) � argcomplete�argparserz rL ZArgumentParserZ ConfigureCommandArgumentParsersZ autocompleterB rG )rO r� r� r� Zparserr4 r4 r5 r� s �� r� �__main__)N)NNr NFNN)mr^ � __future__r r r r rS r� r� r` r7 r? r� r� rB r| r> r� Z six.movesr r Z google.authr r� �gslib.exceptionr, r r �gslib.utils.version_checkr Zgslib.utils.arg_helperr Z gslib.utils.user_agent_helperr r� Z gslib.utilsr r r r� rs r� r� r� rK rA rC rD rE rF rG ZMetricsCollectorZ IsDisabled� USER_AGENTZ UserAgentr� r� Z google_reauthr r r� r r Zgslib.cloud_apir r r r r Zgslib.command_runnerr! Zapitools.base.py.exceptions�base�pyr� r" r# Zgslib.sig_handlingr$ r% r& r� ry rz �lstripr� r� r� r; r= r6 r+ rL rP Z FormatterrQ r� rd r� r� r� r� r� r� r� r� r� r� r[ r4 r4 r4 r5 �<module> s� c-&' � 3
SIMPAN
[ BATAL ]