CURRENT PATH:
/
opt
/
gsutil
/
gslib
/
__pycache__
/
[ ⬅ KEMBALI ]
|
[ HOME ]
Upload File:
Upload Ke Sini
Dir Baru
File Baru
Editing:
ui_controller.cpython-39.pyc
a +(Wg�� � @ s� d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlZddl Z ddl Z ddl m Z dd lmZ dd lmZ dd lmZ dd lmZ dd lmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlm Z ddl m Z ddl m Z ddl m Z ddl m!Z! e j"Z#G dd� de$�Z%d*d d �Z&G d d � d e$�Z'G d d!� d!e'�Z(G d"d#� d#e'�Z)G d$d%� d%e$�Z*G d&d'� d'e$�Z+G d(d)� d)e j,�Z-dS )+zFBase classes for gsutil UI controller, UIThread and MainThreadUIQueue.� )�absolute_import)�print_function)�division)�unicode_literals)�dequeN)�queue)�LogPerformanceSummaryParams)�LogRetryableError)� FileMessage)� FinalMessage)�MetadataMessage)�PerformanceSummaryMessage)�ProducerThreadMessage)�ProgressMessage)�RetryableErrorMessage)�SeekAheadMessage)� StatusMessage)�parallelism_framework_util)� DecimalShort)� HumanReadableWithDecimalPlaces)�MakeHumanReadable)� PrettyTimec @ s e Zd ZdZdZdZdZdZdS )�EstimationSourcezenum for total size source.� � � � N)�__name__� __module__� __qualname__�__doc__�PRODUCER_THREAD_FINAL�SEEK_AHEAD_THREAD�PRODUCER_THREAD_ESTIMATE�INDIVIDUAL_MESSAGES� r% r% �"/opt/gsutil/gslib/ui_controller.pyr 2 s r r c C sb t | |d�}|�� }ttt|d ���dkrTt|d �| d }|d d|� |d< dd�|� S )z�Adjusts proper width for printing num_bytes in readable format. Args: num_bytes: The number of bytes we must display. decimal_places: The standard number of decimal places. Returns: String of fixed width representing num_bytes. )�decimal_placesr i� r Nz%9s� )r �split�int�round�float�len�join)� num_bytesr' Zhuman_readable� number_formatZlast_characterr% r% r& �BytesToFixedWidthStringF s �r1 c @ s� e Zd ZdZG dd� de�Zd#d d �Zd d� Zdd� Zdd� Z dd� Z dd� Z dd� Z dd� Z dd � Zejfd d �Zd d � Zejfd!d"�Zd S )$�StatusMessageManagerz�General manager for common functions shared by data and metadata managers. This subclass has the responsibility of having a common constructor and the same handler for SeekAheadMessages and ProducerThreadMessages. c @ s e Zd ZdZdd� ZdS )z+StatusMessageManager._ThroughputInformationz�Class that contains all information needed for throughput calculation. This _ThroughputInformation is used to track progress and time at several points of our operation. c C s || _ || _dS )z�Constructor of _ThroughputInformation. Args: progress: The current progress, in bytes/second or objects/second. report_time: Float representing when progress was reported (seconds since Epoch). N)�progress�time)�selfr3 Z report_timer% r% r& �__init__h s z4StatusMessageManager._ThroughputInformation.__init__N�r r r r r6 r% r% r% r& �_ThroughputInformationa s r8 r �333333�?� � FN�P c C s� || _ || _|| _|| _|| _|| _|| _|| _tj | _ tj | _ d| _ d| _ | jrX| jnt�� | _| j| _| j| _d| _t� | _d| _g d�| _d| _d| _d| _ d| _d| _dS )aj Instantiates a StatusMessageManager. Args: update_message_period: Minimum period for refreshing and displaying new information. A non-positive value will ignore any time restrictions imposed by this field, but it will affect throughput and time remaining estimations. update_spinner_period: Minimum period for refreshing and displaying the spinner. A non-positive value will ignore any time restrictions imposed by this field. sliding_throughput_period: Sliding period for throughput calculation. A non-positive value will make it impossible to calculate the throughput. first_throughput_latency: Minimum waiting time before actually displaying throughput info. A non-positive value will ignore any time restrictions imposed by this field. quiet_mode: If True, do not print status messages (but still process them for analytics reporting as necessary). custom_time: If a custom start_time is desired. Used for testing. verbose: Tells whether or not the operation is on verbose mode. console_width: Width to display on console. This should not adjust the visual output, just the space padding. For proper visualization, we recommend setting this field to at least 80. r g )�/�-�\�|FN)�update_message_period�update_spinner_period�sliding_throughput_period�first_throughput_latency� quiet_mode� custom_time�verbose� console_widthr r$ �num_objects_source�total_size_source� num_objects� total_sizer4 �refresh_message_time� start_time�refresh_spinner_time� throughputr � old_progress�last_progress_time�spinner_char_list�current_spinner_index�objects_finished�object_report_change� final_message� r5 rA rB rC rD rE rF rG rH r% r% r& r6 s s6 $�� z StatusMessageManager.__init__c C s | j | j S )zpReturns the current spinner character. Returns: char_to_print: Char to be printed as the spinner )rS rT �r5 r% r% r& � GetSpinner� s z StatusMessageManager.GetSpinnerc C s | j d t| j� | _ dS )z&Updates the current spinner character.r N)rT r- rS rY r% r% r& � UpdateSpinner� s �z"StatusMessageManager.UpdateSpinnerc C s� |j rH| jtjkr"tj| _|j| _| jtjkrD|jrDtj| _|j| _dS | jtjkrdtj| _|j| _| jtjkr�|jr�tj| _|j| _dS )zqHandles a ProducerThreadMessage. Args: status_message: The ProducerThreadMessage to be processed. N) �finishedrI r r! rK rJ �sizerL r# �r5 �status_messager% r% r& � _HandleProducerThreadMessage� s$ � �z1StatusMessageManager._HandleProducerThreadMessagec C sv d|j }|jr>|dt|j� 7 }| jtjkr>tj| _|j| _| jtjkrZtj| _|j | _ |d7 }| jsr|� |� dS )z�Handles a SeekAheadMessage. Args: status_message: The SeekAheadMessage to be processed. stream: Stream to print messages. z,Estimated work for this command: objects: %sz, total size: %s� N) rK r] r rJ r r" rL rI rE �write)r5 r_ �streamZestimate_messager% r% r& �_HandleSeekAheadMessage� s �� z,StatusMessageManager._HandleSeekAheadMessagec C s t |jd� dS )zyHandles a PerformanceSummaryMessage. Args: status_message: The PerformanceSummaryMessage to be processed. )� uses_sliceN)r re r^ r% r% r& � _HandlePerformanceSummaryMessage� s z5StatusMessageManager._HandlePerformanceSummaryMessagec C s || j | jkS )z�Decides whether enough time has passed to start tracking throughput. Args: cur_time: current time. Returns: Whether or not we should track the throughput. )rN rD �r5 �cur_timer% r% r& �ShouldTrackThroughput s z*StatusMessageManager.ShouldTrackThroughputc C s$ || j | jk}| j}|s | jo"|S )z�Decides whether or not it is time for printing a new progress. Args: cur_time: current time. Returns: Whether or not we should print the progress. )rM rA rK rV )r5 rh Zsufficient_time_elapsedZnonzero_reportr% r% r& �ShouldPrintProgress s ���z(StatusMessageManager.ShouldPrintProgressc C s || j | jko| jS )z�Decides whether or not it is time for updating the spinner character. Args: cur_time: Current time. Returns: Whether or not we should update and print the spinner. )rO rB rL rg r% r% r& �ShouldPrintSpinner s �z'StatusMessageManager.ShouldPrintSpinnerc C s$ | � � | js |�| �� d � dS )z�Prints a spinner character. Args: stream: Stream to print messages. Usually sys.stderr, but customizable for testing. � N)r[ rE rb rZ )r5 rc r% r% r& � PrintSpinner+ s z!StatusMessageManager.PrintSpinnerc C s� t | j�dkr0|| jd j | jkr0| j�� q | js:dS | jd }| j|jkrZd| _dS ||j | j|j | _td| j�| _dS )a� Updates throughput if the required period for calculation has passed. The throughput is calculated by taking all the progress (objects or bytes) processed within the last sliding_throughput_period seconds, and dividing that by the time period between the oldest progress time within that range and the last progress measurement, which are defined by oldest_progress[1] and last_progress_time, respectively. Among the pros of this approach, a connection break or a sudden change in throughput is quickly noticeable. Furthermore, using the last throughput measurement rather than the current time allows us to have a better estimation of the actual throughput. Args: cur_time: Current time to check whether or not it is time for a new throughput measurement. cur_progress: The current progress, in number of objects finished or in bytes. r r N) r- rQ r4 rC �popleftrR rP r3 �max)r5 rh Z cur_progressZoldest_progressr% r% r& �UpdateThroughput6 s � �z%StatusMessageManager.UpdateThroughputc C sb dt | j� }| jr&|dt| j� 7 }| jt|� }| js^|�d| d t|d�d d � dS )z�Prints a final message to indicate operation succeeded. Args: stream: Stream to print messages. Usually sys.stderr, but customizable for testing. z#Operation completed over %s objectsz/%sra �.r r( N) r rK rL r rH r- rE rb ro )r5 rc �string_to_print�remaining_widthr% r% r& �PrintFinalSummaryMessageY s �� ��z-StatusMessageManager.PrintFinalSummaryMessage)r r9 r: r; FNFr< )r r r r �objectr8 r6 rZ r[ r` rd rf ri rj rk �sys�stderrrm rp rt r% r% r% r& r2 Z s, � N #r2 c sP e Zd ZdZd� fd d � Zd d � Zd d� Zdd� Zej fdd�Z dd� Z � Z S )�MetadataManagera� Manages shared state for metadata operations. This manager is specific for metadata operations. Among its main functions, it receives incoming StatusMessages, storing all necessary data about the current and past states of the system necessary to display to the UI. It also provides methods for calculating metrics such as throughput and estimated time remaining. Finally, it provides methods for displaying messages to the UI. r r9 r: r; FNr< c s$ t t| �j||||||||d� dS )zhInstantiates a MetadataManager. See argument documentation in StatusMessageManager base class. �rA rB rC rD rE rF rG rH N)�superrx r6 rX �� __class__r% r& r6 v s ��zMetadataManager.__init__c C s | j S )zaGets the progress for a MetadataManager. Returns: The number of finished objects. )rU rY r% r% r& � GetProgress� s zMetadataManager.GetProgressc C s` | j d7 _ | jtjkr0tj| _| jd7 _d| _|j| _| j | jkr\| jtjkr\d| _ dS )zeHandles a MetadataMessage. Args: status_message: The MetadataMessage to be processed. r TN) rU rI r r$ rK rV r4 rR r! rW r^ r% r% r& �_HandleMetadataMessage� s �z&MetadataManager._HandleMetadataMessagec C s� d| _ t|t�r | �||� nTt|t�r4| �|� n>t|t�rJ| �|� n(t|t�r^t |� nt|t �rr| � |� | j � | �| j|j�� dS )z�Processes a message from _MainThreadUIQueue or _UIThread. Args: status_message: The StatusMessage item to be processed. stream: Stream to print messages. FN)rV � isinstancer rd r r` r r~ r r r rf rQ �appendr8 rU r4 �r5 r_ rc r% r% r& �ProcessMessage� s �z MetadataManager.ProcessMessagec C sB | j | j }| jr || j }nd}| �� }| jtjkr�dt| j� d t| j � d }| j | jkrhd}n"dtdt dt | j� | j �� }|d }ndt| j� d }d }| j | j | j kr�d | j }| jtjkr�| jr�d t|� } q�d } nd }d } d } | j||||| d�} | jt| � } | j�s>|�| t| d�d d � dS )ak Prints progress and throughput/time estimation. Prints total number of objects and number of finished objects with the percentage of work done, potentially including the throughput (in objects/second) and estimated time remaining. Args: stream: Stream to print messages. Usually sys.stderr, but customizable for testing. N�[r= z objects]�100�%3d�c �d �% Done� z%.2f objects/s�ETA z\{char_to_print} {objects_completed} {percentage_completed} {throughput} {time_remaining_str})� char_to_print�objects_completed�percentage_completedrP �time_remaining_strr r( rl )rK rU rP rZ rI r r" r �minr* r, rM rN rD r# r �formatrH r- rE rb ro ) r5 rc �total_remaining�time_remainingr� r� � percentager� rP r� � format_strrr rs r% r% r& � PrintProgress� sX �� �� � � ��z MetadataManager.PrintProgressc C s t |ttttttf�rdS dS �z�Determines whether this manager is suitable for handling status_message. Args: status_message: The StatusMessage object to be analyzed. Returns: True if this message can be properly handled by this manager, False otherwise. TF)r r r r r r r r^ r% r% r& �CanHandleMessage� s ��z MetadataManager.CanHandleMessage)r r9 r: r; FNFr< ) r r r r r6 r} r~ r� rv rw r� r� � __classcell__r% r% r{ r& rx k s �@rx c sx e Zd ZdZG dd� de�Zd � fd d � Zd d � Zdd� Zdd� Z dd� Z dd� Z dd� Z e jfdd�Zdd� Z� ZS ) � DataManagera� Manages shared state for data operations. This manager is specific for data operations. Among its main functions, it receives incoming StatusMessages, storing all necessary data about the current and past states of the system necessary to display to the UI. It also provides methods for calculating metrics such as throughput and estimated time remaining. Finally, it provides methods for displaying messages to the UI. c @ s e Zd ZdZdd� ZdS )z DataManager._ProgressInformationz�Class that contains all progress information needed for a given file. This _ProgressInformation is used as the value associated with a file_name in the dict that stores the information about all processed files. c C s d| _ d| _i | _|| _dS )zbConstructor of _ProgressInformation. Args: size: The total size of the file. r N)�new_progress_sum�existing_progress_sum�dictr] )r5 r] r% r% r& r6 s z)DataManager._ProgressInformation.__init__Nr7 r% r% r% r& �_ProgressInformation s r� r r9 r: r; FNc sT t t| �j||||||||d� d| _d| _d| _d| _i | _d| _d| _ d| _ dS )zdInstantiates a DataManager. See argument documentation in StatusMessageManager base class. ry Tr N) rz r� r6 � first_item�total_progress� new_progress�existing_progress�individual_file_progress�component_total�finished_components�existing_componentsrX r{ r% r& r6 3 s( �� zDataManager.__init__c C s | j S )znGets the progress for a DataManager. Returns: The number of processed bytes in this operation. )r� rY r% r% r& r} Z s zDataManager.GetProgressc C s: |j s�| jr0| js0|j| _| j| _| j| _d| _|jj}|j rD|j nd|_ | � |j �| j |< | j t jkr~t j| _ | jd7 _| jt jkr�t j| _| j|j 7 _d| _n�| jd7 _|jj}| j | }|j|j }| j|j | 7 _| j|j | 7 _|j| _| j |= d| _| j| jk�r6| j t jk�r6d| _dS )zsHandles a FileMessage that describes a file. Args: status_message: the FileMessage to be processed. Fr r TN)r\ r� rF r4 rM rN Zlast_throughput_time�src_url� url_stringr] r� r� rI r r$ rK rJ rL rV rU r� r� r� r� rR r! rW )r5 r_ � file_name� file_progress�total_bytes_transferredr% r% r& �_HandleFileDescriptionb sB � � �z"DataManager._HandleFileDescriptionc C sL |j }|tjkpJ|tjkpJ|tjkpJ|tjkpJ|tjkpJ|tjkpJ|tjkS )a Tells whether or not this FileMessage represent a file. This is needed because FileMessage is used by both files and components. Args: file_message: The FileMessage to be analyzed. Returns: Whether or not this represents a file. ) � message_typer � FILE_DOWNLOAD� FILE_UPLOAD�FILE_CLOUD_COPY�FILE_DAISY_COPY�FILE_LOCAL_COPY� FILE_REWRITE� FILE_HASH)r5 � file_messager� r% r% r& �_IsFile� s ������zDataManager._IsFilec C s� |j tjkr�|js�| jd7 _|jj}| j| }|j|j f}d|j f|j |< | j |j 7 _ | j |j 7 _ | j|j 7 _�nP|j tjks�|j tjk�r�|j�s | jd7 _|j tjk�r�|jj}| j| }| j |j7 _ |j|j f}d|jf|j |< | j |j7 _ | j|j7 _n�| jd7 _|jj}| j| }|j|j f}||j v �rb|j | nd}| j |j t|� 7 _ | j|j t|� 7 _|j| _| j|j t|� 7 _|j |d |d f|j |< dS )zxHandles a FileMessage that describes a component. Args: status_message: The FileMessage to be processed. r r �r r N)r� r �EXISTING_COMPONENTr\ r� r� r� r� � component_num�dst_urlr] r� r� r� r� �COMPONENT_TO_UPLOAD�COMPONENT_TO_DOWNLOADr� �bytes_already_downloadedr� �sumr� r4 rR r� �r5 r_ r� r� �key� last_updater% r% r& �_HandleComponentDescription� sT � � � � � �z'DataManager._HandleComponentDescriptionc C s� |j j}| j| }|j|jf}||jv r2|j| nd}| j|d 8 _| j|j|d 7 _| j|j|d 7 _| j |j|d 7 _ |j|d f|j|< |j | _ dS )z�Handles a ProgressMessage that tracks progress of a file or component. Args: status_message: The ProgressMessage to be processed. r� r r N) r� r� r� r� r� r� �processed_bytesr� r� r� r4 rR r� r% r% r& �_HandleProgressMessage� s � �z"DataManager._HandleProgressMessagec C s� d| _ t|t�r | �|� n�t|t�r4| �||� ntt|t�rj| �|�rT| �|� n | � |� t |d� n>t|t �r�| � |� n(t|t �r�t|� nt|t�r�| �|� | j�| �| j|j�� dS )z�Processes a message from _MainThreadUIQueue or _UIThread. Args: status_message: The StatusMessage item to be processed. stream: Stream to print messages. Here only for SeekAheadThread F)r� N)rV r r r` r rd r r� r� r� r r r� r r r rf rQ r� r8 r� r4 r� r% r% r& r� � s& �zDataManager.ProcessMessagec C st | j | j }| jr || j }nd}| �� }| jtjkrXdt| j� d t| j � d }ndt| j� d }dt | j�t | j �f }| j tjkr�| j | jkr�d}n"dt dt d t| j� | j �� }|d }nd }| j| j | jk�r t | j�d } | j tjk�r| j�rd t|� } nd } nd } d } d} | j||||| | d�} | jt| � } | j�sp|�| t| d�d d � dS )a� Prints progress and throughput/time estimation. If a ProducerThreadMessage or SeekAheadMessage has been provided, it outputs the number of files completed, number of total files, the current progress, the total size, and the percentage it represents. If none of those have been provided, it only includes the number of files completed, the current progress and total size (which might be updated), with no percentage as we do not know if more files are coming. It may also include time estimation (available only given ProducerThreadMessage or SeekAheadMessage provided) and throughput. For that to happen, there is an extra condition of at least first_throughput_latency seconds having been passed since the UIController started, and that either the ProducerThread or the SeekAheadThread have estimated total number of files and total size. Args: stream: Stream to print messages. Usually sys.stderr, but customizable for testing. Nr� r= z files]z[%s/%s]r� r� r� r� r� r� z/sr� zl{char_to_print} {objects_completed}{bytes_progress} {percentage_completed} {throughput} {time_remaining_str})r� r� �bytes_progressr� rP r� r r( rl )rL r� rP rZ rI r r" r rU rK r1 rJ r� r* r, rM rN rD r# r r� rH r- rE rb ro )r5 rc r� r� r� r� r� r� r� rP r� r� rr rs r% r% r& r� " sb ���� �� ���zDataManager.PrintProgressc C s t |tttttttf�r dS dS r� )r r r r r r r r r^ r% r% r& r� v s � z DataManager.CanHandleMessage)r r9 r: r; FNFN)r r r r ru r� r6 r} r� r� r� r� r� rv rw r� r� r� r% r% r{ r& r� s& �'58&Tr� c @ s. e Zd ZdZddd �Zdd d �Zdd d �ZdS )� UIControllerz�Controller UI class to integrate _MainThreadUIQueue and _UIThread. This class receives messages from _MainThreadUIQueue and _UIThread and send them to an appropriate manager, which will then processes and store data about them. r r9 r: r; FNc C s\ || _ || _|| _|| _|| _d| _|| _|| _d| _g | _ d| _ d| _ |rXt |d�| _ dS )a� Instantiates a UIController. Args: update_message_period: Minimum period for refreshing and displaying new information. A non-positive value will ignore any time restrictions imposed by this field. update_spinner_period: Minimum period for refreshing and displaying the spinner. A non-positive value will ignore any time restrictions imposed by this field. sliding_throughput_period: Sliding period for throughput calculation. A non-positive value will make it impossible to calculate the throughput. first_throughput_latency: Minimum waiting time before actually displaying throughput info. A non-positive value will ignore any time restrictions imposed by this field. quiet_mode: If True, do not print status messages (but still process them for analytics reporting as necessary). custom_time: If a custom start_time is desired. Used for testing. verbose: Tells whether or not the operation is on verbose mode. dump_status_messages_file: File path for logging all received status messages, for debugging purposes. Nr< F�ab) rG rA rB rC rD �managerrE rF rH �early_estimation_messages�printed_final_message�dump_status_message_fp�open) r5 rA rB rC rD rE rF rG �dump_status_messages_filer% r% r& r6 � s zUIController.__init__c C s� | j �||� | j �|�rN| j �|�r:| j �|| j �� � | j �|� || j _| j �|�rn| j � |� || j _ t |t �s�| j j r�| j jr�| js�d| _t| j jd� | j �|� dS )a� Processes a message, updates throughput and prints progress. Args: status_message: Message to be processed. Could be None if UIThread cannot retrieve message from status_queue. stream: stream to print messages. Usually sys.stderr, but customizable for testing. cur_time: Message time. Used to determine if it is time to refresh output, or calculate throughput. T)�num_objects_transferredN)r� r� rj ri rp r} r� rM rk rm rO r r rW rK r� r rt )r5 r_ rc rh r% r% r& �_HandleMessage� s& ���zUIController._HandleMessagec C s� t |t�sd|tkr`| js`t| j| j| j| j| j | j | j | j d�| _| j D ]}| j|||jd� qHdS | jr�| j�t|�� | j�d� |s�|j}| j�sTt |t�s�t |t�r�| j �|� dS t |t��rt| j| j| j| j| j | j | j | j d�| _| j D ]}| �|||� q�nFt| j| j| j| j| j | j | j | j d�| _| j D ]}| �|||� �q>| j�|��s�t |t��szt |t��r�t| j| j| j| j| j | j | j d�| _| j D ]}| �|||� �q�ndS | �|||� dS )a� Coordinates UI manager and calls appropriate function to handle message. Args: status_message: Message to be processed. Could be None if UIThread cannot retrieve message from status_queue. stream: Stream to print messages. Usually sys.stderr, but customizable for testing. cur_time: Message time. Used to determine if it is time to refresh output, or calculate throughput. ry )rh Nra )rA rB rC rD rF rG rH )r r �_ZERO_TASKS_TO_DO_ARGUMENTr� r� rA rB rC rD rE rF rG rH r� r� r4 r� rb �strr r r� r rx r� r r )r5 r_ rc rh Zestimation_messager% r% r& �Call� s� � � � � � � � zUIController.Call)r r9 r: r; FNFN)N)N)r r r r r6 r� r� r% r% r% r& r� � s � 1 r� c s* e Zd ZdZ� fdd�Zddd�Z� ZS )�MainThreadUIQueuea� Handles status display and processing in the main thread / master process. This class emulates a queue to cover main-thread activity before or after Apply, as well as for the single-threaded, single-process case, i.e., _SequentialApply. When multiple threads or processes are used during calls to Apply, the main thread is waiting for work to complete, and this queue must remain unused until Apply returns. Code producing arguments for Apply (such as the NameExpansionIterator) must not post messages to this queue to avoid race conditions with the UIThread. This class sends the messages it receives to UIController, which decides the correct course of action. c s t t| ��� || _|| _dS )z�Instantiates a _MainThreadUIQueue. Args: stream: Stream for printing messages. ui_controller: UIController to manage messages. N)rz r� r6 � ui_controllerrc )r5 rc r� r{ r% r& r6 L s zMainThreadUIQueue.__init__Nc C s | j �|| j� d S )N)r� r� rc )r5 r_ �timeoutr% r% r& �putY s zMainThreadUIQueue.put)N)r r r r r6 r� r� r% r% r{ r& r� = s r� c s* e Zd ZdZd� fdd� Zdd� Z� ZS )�UIThreada� Responsible for centralized printing across multiple processes/threads. This class pulls status messages that are posted to the centralized status queue and coordinates displaying status and progress to the user. It is used only during calls to _ParallelApply, which in turn is called only when multiple threads and/or processes are used. This class sends the messages it receives to UIController, which decides the correct course of action. r c s2 t t| ��� || _|| _|| _|| _| �� dS )z�Instantiates a _UIThread. Args: status_queue: Queue for reporting status updates. stream: Stream for printing messages. ui_controller: UI controller to manage messages. timeout: Timeout for getting a message. N)rz r� r6 � status_queuerc r� r� �start)r5 r� rc r� r� r{ r% r& r6 k s zUIThread.__init__c C s� zRz| j j| jd�}W n tjy2 d }Y qY n0 | j�|| j� |tkrqPqW n4 t y� } z | j� d| � W Y d }~n d }~0 0 d S )N)r� zException in UIThread: %s ) r� �getr� �Queue�Emptyr� r� rc r� � Exceptionrb )r5 r_ �er% r% r& �run| s z UIThread.run)r )r r r r r6 r� r� r% r% r{ r& r� _ s r� )r ).r � __future__r r r r � collectionsr rv � threadingr4 � six.movesr r� � gslib.metricsr r �gslib.thread_messager r r r r r r r r � gslib.utilsr �gslib.utils.unit_utilr r r r �ZERO_TASKS_TO_DO_ARGUMENTr� ru r r1 r2 rx r� r� r� �Threadr� r% r% r% r& �<module> sT � $ 2"
SIMPAN
[ BATAL ]