관리-도구
편집 파일: robotparser.cpython-312.opt-2.pyc
� �Q�f�$ � � � d dl Z d dlZd dlZdgZ e j dd� Z G d� d� Z G d� d� Z G d� d � Z y) � N�RobotFileParser�RequestRatezrequests secondsc �X � e Zd Z dd�Zd� Zd� Zd� Zd� Zd� Zd� Z d� Z d � Zd � Zd� Z d� Zy )r c �z � g | _ g | _ d | _ d| _ d| _ | j |� d| _ y )NFr )�entries�sitemaps� default_entry�disallow_all� allow_all�set_url�last_checked��self�urls �9/opt/alt/python312/lib64/python3.12/urllib/robotparser.py�__init__zRobotFileParser.__init__ s; � ������ �!���!���������S����� c � � | j S �N)r �r s r �mtimezRobotFileParser.mtime% s � � � � � � r c �8 � dd l }|j � | _ y )Nr )�timer )r r s r �modifiedzRobotFileParser.modified. s � � � � �I�I�K��r c �r � || _ t j j |� dd \ | _ | _ y )N� � )r �urllib�parse�urlparse�host�pathr s r r zRobotFileParser.set_url6 s0 � �:����%�|�|�4�4�S�9�!�A�>��� �4�9r c � � t j j | j � }|j � }| j |j d� j � � y # t j j $ rT}|j dv rd| _ n4|j dk\ r |j dk rd| _ Y d }~y Y d }~y Y d }~y Y d }~y d }~ww xY w)Nzutf-8)i� i� Ti� i� ) r �request�urlopenr �readr �decode� splitlines�error� HTTPError�coder r )r �f�raw�errs r r&