CURRENT PATH:
/
opt
/
alt
/
python37
/
lib64
/
python3.7
/
urllib
/
__pycache__
/
[ ⬅ KEMBALI ]
|
[ HOME ]
Upload File:
Upload Ke Sini
Dir Baru
File Baru
Editing:
robotparser.cpython-37.pyc
B 8O��=�G%� @ s\ d Z ddlZddlZddlZdgZe�dd�ZG dd� d�ZG dd� d�Z G d d � d �Z dS )a% robotparser.py Copyright (C) 2000 Bastian Kleineidam You can choose between two licenses when using this package: 1) GNU GPLv2 2) PSF license for Python 2.2 The robots.txt Exclusion Protocol is implemented as specified in http://www.robotstxt.org/norobots-rfc.txt � N�RobotFileParser�RequestRatezrequests secondsc @ sj e Zd ZdZddd�Zdd� Zdd� Zd d � Zdd� Zd d� Z dd� Z dd� Zdd� Zdd� Z dd� ZdS )r zs This class provides a set of methods to read, parse and answer questions about a single robots.txt file. � c C s, g | _ d | _d| _d| _| �|� d| _d S )NFr )�entries� default_entry�disallow_all� allow_all�set_url�last_checked)�self�url� r �7/opt/alt/python37/lib64/python3.7/urllib/robotparser.py�__init__ s zRobotFileParser.__init__c C s | j S )z�Returns the time the robots.txt file was last fetched. This is useful for long-running web spiders that need to check for new robots.txt files periodically. )r )r r r r �mtime$ s zRobotFileParser.mtimec C s ddl }|� � | _dS )zYSets the time the robots.txt file was last fetched to the current time. r N)�timer )r r r r r �modified- s zRobotFileParser.modifiedc C s&