관리-도구
편집 파일: util.cpython-36.pyc
3 �Re�� � @ s� d dl Z d dlmZ d dlZd dlZd dlmZ d dlZd dl Z d dl Z d dl Z d dl Z d dl Z d dlZy d dlZW n ek r� dZY nX d dlZd dlZd dlZd dlZd dlZy d dlZW n ek r� d dlZY nX d dlZddlmZ ddlm Z m Z m Z m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0 e j1e2�Z3e j4d�Z5e j4d�Z6e j4d �Z7e j4d �Z8e j4d �Z9e j4d �Z:e j4d �Z;e j4d�Z<dd� Z=dd� Z>dd� Z?dd� Z@dd� ZAd�dd�ZBdd � ZCd d � ZDd d � ZEejFd!d"� �ZGejFd#d$� �ZHejFd�d&d'��ZIG d(d)� d)eJ�ZKd*d+� ZLG d,d-� d-eJ�ZMd.d/� ZNG d0d1� d1eJ�ZOe j4d2e jP�ZQd3d4� ZRd�d5d6�ZSd7d8� ZTd9d:� ZUd;d<� ZVd=d>� ZWd?d@� ZXe j4dAe jY�ZZe j4dB�Z[d�dCdD�Z\e j4dE�Z]dFdG� Z^dHdI� Z_dJdK� Z`dLZadMdN� ZbdOdP� ZcG dQdR� dReJ�ZdG dSdT� dTeJ�ZeG dUdV� dVeJ�Zfd�Zgd�d_d`�Zhdadb� Zid�ZjG didj� djeJ�Zke j4dk�Zle j4dl�Zme j4dm�Zndndo� Zdpdq� Zoe�r�ddrlmpZqmrZrmsZs G dsdt� dte$jt�ZtG dudv� dveq�ZpG dwdx� dxepe'�Zuejvddy� Zwewd�k�rG d{d|� d|e$jx�Zxe�rG d}d~� d~e$jy�ZyG dd�� d�e%jz�Zze�rBG d�d�� d�e%j{�Z{G d�d�� d�e%j|�Z|d�d�� Z}G d�d�� d�eJ�Z~G d�d�� d�e~�ZG d�d�� d�e~�Z�G d�d�� d�e(�Z�G d�d�� d�eJ�Z�d�d�� Z�dS )�� N)�deque)�iglob� )�DistlibException)� string_types� text_type�shutil� raw_input�StringIO�cache_from_source�urlopen�urljoin�httplib� xmlrpclib� splittype� HTTPHandler�BaseConfigurator� valid_ident� Container� configparser�URLError�ZipFile�fsdecode�unquote�urlparsez^([\w\.-]+)\s*z^([\w\.*+-]+)\s*z^(<=?|>=?|={2,3}|[~!]=)\s*z*^((<=?)|(>=?)|={2,3}|[~!]=|in|not\s+in)\s*z^or\b\s*z ^and\b\s*z(\S+)\s*z(([\s\w\.{}()*+#:;,/?!~`@$%^&=|<>\[\]-]+)c s6 dd� �� �fdd���fdd���fdd�� � | �S ) ae Parse a marker string and return a dictionary containing a marker expression. The dictionary will contain keys "op", "lhs" and "rhs" for non-terminals in the expression grammar, or strings. A string contained in quotes is to be interpreted as a literal string, and a string not contained in quotes is a variable (such as os_name). c S s2 t j| �}|r.|j� d }| |j� d � } � n�| s<td��n�| d }|dkrXtd| ��dj|d�}| dd � } |g}x�| r�| d |kr�P qx| d |kr�|j|� | dd � } qxtj| �}|s�td| ��|j|j� d � | |j� d � } qxW dj|�}td| ��|j|� dj|�}| dd � j � } || fS ) Nr zunexpected end of inputz'"zinvalid expression: %s� r zerror in string literal: %szunterminated string: %s) � IDENTIFIER�match�groups�end� SyntaxError�replace�append� STRING_CHUNK�join�lstrip)� remaining�m�result�q�oq�parts�s� r- ��/builddir/build/BUILDROOT/alt-python36-pip-20.2.4-5.el8.x86_64/opt/alt/python36/lib/python3.6/site-packages/pip/_vendor/distlib/util.py� marker_varA s: z parse_marker.<locals>.marker_varc s� | rR| d dkrR� | dd � j � �\}} | d dkr@td| ��| dd � j � } n^�| �\}} xL| r�tj| �}|stP |j� d }| |j� d � } �| �\}} |||d�}q`W |}|| fS )Nr �(r �)z unterminated parenthesis: %s)�op�lhs�rhs)r% r � MARKER_OPr r r )r& r( r3 r' r2 r4 )�markerr/ r- r. � marker_expre s z!parse_marker.<locals>.marker_exprc sV � | �\}} x@| rLt j| �}|s"P | |j� d � } � | �\}} d||d�}qW || fS )N�and)r2 r3 r4 )�ANDr r )r& r3 r' r4 )r7 r- r. � marker_andx s z parse_marker.<locals>.marker_andc sV � | �\}} x@| rLt j| �}|s"P | |j� d � } � | �\}} d||d�}qW || fS )N�or)r2 r3 r4 )�ORr r )r& r3 r' r4 )r: r- r. r6 � s z parse_marker.<locals>.markerr- )� marker_stringr- )r6 r: r7 r/ r. � parse_marker8 s $ r> c C s2 | j � }| s|jd�r dS tj|�}|s6td| ��|j� d }||j� d� }d } } }}|op|d dk�r<|jdd�}|dk r�td| ��|d|� } ||d d� j� }g }xx| �r0tj| �}|s�td | ��|j |j� d � | |j� d� } | �sP | d d k�r td | ��| dd� j� } q�W |�s<d}|�r�|d d k�r�|dd� j� }t j|�}|�s|td | ��|j� d }t |�} | j �o�| j �s�td| ��||j� d� j� }n�dd� } |d dk�r�| |�\}}n�|jdd�}|dk �rtd| ��|d|� } ||d d� j� }tj| ��rB| | �\}} nXtj| �}|�s^td| ��|j� d } | |j� d� j� } | �r�td| ��d| fg}|�r�|d dk�r�td| ��|dd� j� }t|�\}}|�r�|d dk�r�td| ��|�s|}n d|djdd � |D ��f }t||||||d �S ) z� Parse a requirement passed in as a string. Return a Container whose attributes contain the various parts of the requirement. �#Nzname expected: %sr �[�]r zunterminated extra: %szmalformed extra: %s�,z comma expected in extras: %s�@zinvalid URI: %szInvalid URL: %sc S s� t j| �}d}|r�g }x�|j� d }| |j� d� } tj| �}|sNtd| ��|j� d }|j||f� | |j� d� } | s�| d dkr�P | dd� j� } t j| �}|std| ��qW |s�d}|| fS )z| Return a list of operator, version tuples if any are specified, else None. Nr zinvalid version: %srB r zinvalid constraint: %s)� COMPARE_OPr r r �VERSION_IDENTIFIERr r" r% )� ver_remainingr' �versionsr2 �vr- r- r. � get_versions� s, z'parse_requirement.<locals>.get_versionsr0 r1 z unterminated parenthesis: %szinvalid constraint: %sz~=�;zinvalid requirement: %sz unexpected trailing data: %sz%s %sz, c S s g | ] }d | �qS )z%s %sr- )�.0�conr- r- r. � <listcomp> s z%parse_requirement.<locals>.<listcomp>)�name�extras� constraintsr6 �url� requirement)�strip� startswithr r r r r �findr% r" � NON_SPACEr �scheme�netlocrD rE r> r$ r )�reqr& r' �distnamerO � mark_exprrG �uri�ir, �trI �_rH �rsr- r- r. �parse_requirement� s� ra c C s� dd� }i }x�|D ]�\}}}t jj| |�}x�t|�D ]t}t jj||�} x`t| �D ]T} || | �} |dkrt|j| d� qP||| �} |jt jjd�jd�} | d | || < qPW q4W qW |S )z%Find destinations for resources filesc S sD | j tjjd�} |j tjjd�}|j| �s.t�|t| �d � jd�S )N�/)r! �os�path�seprT �AssertionError�lenr% )�rootrd r- r- r. � get_rel_path s z)get_resources_dests.<locals>.get_rel_pathNrb )rc rd r$ r �popr! re �rstrip)�resources_root�rulesri � destinations�base�suffix�dest�prefix�abs_base�abs_glob�abs_path� resource_file�rel_path�rel_destr- r- r. �get_resources_dests s ry c C s( t td�rd} ntjttdtj�k} | S )N� real_prefixT� base_prefix)�hasattr�sysrr �getattr)r( r- r- r. �in_venv$ s r c C s$ t jjtj�} t| t�s t| �} | S )N)rc rd �normcaser} � executable� isinstancer r )r( r- r- r. �get_executable. s r� c C sT | }xJt |�}| }| r |r |}|r|d j� }||kr:P |rd||| f }qW |S )Nr z %c: %s %s)r �lower)�prompt� allowed_chars� error_prompt�default�pr, �cr- r- r. �proceed> s r� c C s< t |t�r|j� }i }x |D ]}|| kr | | ||< q W |S )N)r� r �split)�d�keysr( �keyr- r- r. �extract_by_keyN s r� c C s� t jd dkr tjd�| �} | j� }t|�} yrtj| �}|d d d }xR|j� D ]F\}}x<|j� D ]0\}}d||f }t |�} | d k s�t �| ||< qdW qRW |S t k r� | j dd� Y nX dd � } t j� } y| | | � W n< t jk �r | j� tj|�}t|�} | | | � Y nX i }xb| j� D ]V} i || < }xB| j| �D ]4\} }d| |f }t |�} | d k �spt �| || < �qFW �q*W |S ) Nr � zutf-8� extensionszpython.exports�exportsz%s = %sc S s$ t | d�r| j|� n | j|� d S )N� read_file)r| r� �readfp)�cp�streamr- r- r. � read_streamk s z!read_exports.<locals>.read_stream)r} � version_info�codecs� getreader�readr �json�load�items�get_export_entryrf � Exception�seekr � ConfigParser�MissingSectionHeaderError�close�textwrap�dedent�sections)r� �data�jdatar( �group�entries�krH r, �entryr� r� r� rN �valuer- r- r. � read_exportsW sD r� c C s� t jd dkr tjd�|�}tj� }x|| j� D ]p\}}|j|� x\|j� D ]P}|j d kr`|j }nd|j |j f }|j r�d|dj |j �f }|j ||j|� qJW q.W |j|� d S )Nr r� zutf-8z%s:%sz%s [%s]z, )r} r� r� � getwriterr r� r� � add_section�valuesrp rr �flagsr$ �setrN �write)r� r� r� r� rH r� r, r- r- r. � write_exports� s r� c c s$ t j� } z | V W d tj| � X d S )N)�tempfile�mkdtempr �rmtree)�tdr- r- r. �tempdir� s r� c c s. t j� }zt j| � d V W d t j|� X d S )N)rc �getcwd�chdir)r� �cwdr- r- r. r� � s r� � c c s. t j� }zt j| � d V W d t j|� X d S )N)�socket�getdefaulttimeout�setdefaulttimeout)�seconds�ctor- r- r. �socket_timeout� s r� c @ s e Zd Zdd� Zddd�ZdS )�cached_propertyc C s || _ d S )N)�func)�selfr� r- r- r. �__init__� s zcached_property.__init__Nc C s, |d kr | S | j |�}tj|| j j|� |S )N)r� �object� __setattr__�__name__)r� �obj�clsr� r- r- r. �__get__� s zcached_property.__get__)N)r� � __module__� __qualname__r� r� r- r- r- r. r� � s r� c C s� t jdkr| S | s| S | d dkr.td| ��| d dkrFtd| ��| jd�}xt j|krj|jt j� qRW |svt jS t jj|� S )a� Return 'pathname' as a name that will work on the native filesystem. The path is split on '/' and put back together again using the current directory separator. Needed because filenames in the setup script are always supplied in Unix style, and have to be converted to the local convention before we can actually use them in the filesystem. Raises ValueError on non-Unix-ish systems if 'pathname' either starts or ends with a slash. rb r z path '%s' cannot be absoluter z path '%s' cannot end with '/'���)rc re � ValueErrorr� �curdir�removerd r$ )�pathname�pathsr- r- r. � convert_path� s r� c @ s� e Zd Zd$dd�Zdd� Zdd� Zdd � Zd%d d �Zd&dd�Zdd� Z dd� Z dd� Z dd� Z dd� Z d'dd�Zd d � Zd d � Zd d!� Zd"d#� Zd S )(� FileOperatorFc C s || _ t� | _| j� d S )N)�dry_runr� �ensured� _init_record)r� r� r- r- r. r� � s zFileOperator.__init__c C s d| _ t� | _t� | _d S )NF)�recordr� � files_written� dirs_created)r� r- r- r. r� � s zFileOperator._init_recordc C s | j r| jj|� d S )N)r� r� �add)r� rd r- r- r. �record_as_written� s z FileOperator.record_as_writtenc C sH t jj|�s tdt jj|� ��t jj|�s0dS t j|�jt j|�jkS )a� Tell if the target is newer than the source. Returns true if 'source' exists and is more recently modified than 'target', or if 'source' exists and 'target' doesn't. Returns false if both exist and 'target' is the same age or younger than 'source'. Raise PackagingFileError if 'source' does not exist. Note that this test is not very accurate: files created in the same second will have the same "age". zfile '%r' does not existT)rc rd �existsr �abspath�stat�st_mtime)r� �source�targetr- r- r. �newer� s zFileOperator.newerTc C s� | j tjj|�� tjd||� | js�d}|rftjj|�rDd| }n"tjj|�rftjj |� rfd| }|rvt |d ��t j ||� | j |� dS )z8Copy a file respecting dry-run and force flags. zCopying %s to %sNz%s is a symlinkz%s is a non-regular filez which would be overwritten)� ensure_dirrc rd �dirname�logger�infor� �islinkr� �isfiler� r �copyfiler� )r� �infile�outfile�check�msgr- r- r. � copy_file s zFileOperator.copy_fileNc C s� t jj|� st�| jt jj|�� tjd||� | jsx|d krLt |d�}nt j |d|d�}zt j ||� W d |j � X | j|� d S )NzCopying stream %s to %s�wb�w)�encoding)rc rd �isdirrf r� r� r� r� r� �openr� r � copyfileobjr� r� )r� �instreamr� r� � outstreamr- r- r. � copy_stream s zFileOperator.copy_streamc C s\ | j tjj|�� | jsNtjj|�r.tj|� t|d��}|j|� W d Q R X | j |� d S )Nr� ) r� rc rd r� r� r� r� r� r� r� )r� rd r� �fr- r- r. �write_binary_file! s z FileOperator.write_binary_filec C s | j ||j|�� d S )N)r �encode)r� rd r� r� r- r- r. �write_text_file* s z FileOperator.write_text_filec C sr t jdks t jdkrnt jdkrnxN|D ]F}| jr<tjd|� q$t j|�j|B |@ }tjd||� t j||� q$W d S )N�posix�javazchanging mode of %szchanging mode of %s to %o) rc rN �_namer� r� r� r� �st_mode�chmod)r� �bits�mask�filesr� �moder- r- r. �set_mode- s zFileOperator.set_modec C s | j dd|�S )Nim i� )r )r, r� r- r- r. �<lambda>9 s zFileOperator.<lambda>c C s~ t jj|�}|| jkrzt jj|� rz| jj|� t jj|�\}}| j|� tj d| � | j sht j |� | j rz| j j|� d S )Nz Creating %s)rc rd r� r� r� r� r� r� r� r� r� �mkdirr� r� )r� rd r� r� r- r- r. r� ; s zFileOperator.ensure_dirc C s� t || �}tjd||� | js�|s0| j||�rX|s:d }n |j|�sHt�|t|�d � }i }|rvtt d�rvt j j |d< t j |||df|� | j |� |S )NzByte-compiling %s to %s�PycInvalidationMode�invalidation_modeT)r r� r� r� r� rT rf rg r| � py_compiler � CHECKED_HASH�compiler� ) r� rd �optimize�forcerr �hashed_invalidation�dpath�diagpath�compile_kwargsr- r- r. � byte_compileG s zFileOperator.byte_compilec C s� t jj|�r�t jj|�r`t jj|� r`tjd|� | jsBtj |� | j r�|| j kr�| j j |� nPt jj|�rrd}nd}tjd||� | js�t j |� | j r�|| j kr�| j j |� d S )Nz Removing directory tree at %s�link�filezRemoving %s %s)rc rd r� r� r� r� �debugr� r r� r� r� r� r� )r� rd r, r- r- r. �ensure_removedX s" zFileOperator.ensure_removedc C sH d}x>|sBt jj|�r&t j|t j�}P t jj|�}||kr<P |}qW |S )NF)rc rd r� �access�W_OKr� )r� rd r( �parentr- r- r. � is_writablem s zFileOperator.is_writablec C s" | j s t�| j| jf}| j� |S )zV Commit recorded changes, turn off recording, return changes. )r� rf r� r� r� )r� r( r- r- r. �commity s zFileOperator.commitc C s� | j s�x(t| j�D ]}tjj|�rtj|� qW t| jdd�}xN|D ]F}tj |�}|r�|dgksdt �tjj ||d �}tj |� tj |� qDW | j � d S )NT)�reverse� __pycache__r )r� �listr� rc rd r� r� �sortedr� �listdirrf r$ �rmdirr� )r� r� �dirsr� �flist�sdr- r- r. �rollback� s zFileOperator.rollback)F)T)N)FFNF)r� r� r� r� r� r� r� r� r� r r r �set_executable_moder� r r r" r# r- r- r- r- r. r� � s r� c C sb | t jkrt j| }nt| �}|d kr,|}n2|jd�}t||jd��}x|D ]}t||�}qLW |S )N�.r )r} �modules� __import__r� r~ rj )� module_name� dotted_path�modr( r+ r� r- r- r. �resolve� s r5 c @ s6 e Zd Zdd� Zedd� �Zdd� Zdd� Zej Z d S ) � ExportEntryc C s || _ || _|| _|| _d S )N)rN rr rp r� )r� rN rr rp r� r- r- r. r� � s zExportEntry.__init__c C s t | j| j�S )N)r5 rr rp )r� r- r- r. r� � s zExportEntry.valuec C s d| j | j| j| jf S )Nz<ExportEntry %s = %s:%s %s>)rN rr rp r� )r� r- r- r. �__repr__� s zExportEntry.__repr__c C sD t |t�sd}n0| j|jko>| j|jko>| j|jko>| j|jk}|S )NF)r� r6 rN rr rp r� )r� �otherr( r- r- r. �__eq__� s zExportEntry.__eq__N) r� r� r� r� r� r� r7 r9 r� �__hash__r- r- r- r. r6 � s r6 z�(?P<name>(\w|[-.+])+) \s*=\s*(?P<callable>(\w+)([:\.]\w+)*) \s*(\[\s*(?P<flags>[\w-]+(=\w+)?(,\s*\w+(=\w+)?)*)\s*\])? c C s� t j| �}|s0d }d| ks"d| kr�td| ��n�|j� }|d }|d }|jd�}|dkrf|d }}n"|dkrztd| ��|jd�\}}|d } | d kr�d| ks�d| kr�td| ��g } nd d � | jd �D �} t|||| �}|S ) Nr@ rA zInvalid specification '%s'rN �callable�:r r r� c S s g | ] }|j � �qS r- )rS )rK r� r- r- r. rM � s z$get_export_entry.<locals>.<listcomp>rB )�ENTRY_RE�searchr � groupdict�countr� r6 ) � specificationr' r( r� rN rd �colonsrr rp r� r- r- r. r� � s2 r� c C s� | dkr d} t jdkr.dt jkr.t jjd�}n t jjd�}t jj|�rft j|t j�}|s�t j d|� n<yt j |� d}W n( t k r� t j d |dd � d }Y nX |s�t j� }t j d |� t jj|| �S ) a� Return the default base location for distlib caches. If the directory does not exist, it is created. Use the suffix provided for the base directory, and default to '.distlib' if it isn't provided. On Windows, if LOCALAPPDATA is defined in the environment, then it is assumed to be a directory, and will be the parent directory of the result. On POSIX, and on Windows if LOCALAPPDATA is not defined, the user's home directory - using os.expanduser('~') - will be the parent directory of the result. The result is just the directory '.distlib' in the parent directory as determined above, or with the name specified with ``suffix``. Nz.distlib�nt� LOCALAPPDATAz $localappdata�~z(Directory exists but is not writable: %sTzUnable to create %s)�exc_infoFz#Default location unusable, using %s)rc rN �environrd � expandvars� expanduserr� r r r� �warning�makedirs�OSErrorr� r� r$ )rp r( �usabler- r- r. �get_cache_base� s& rN c C sB t jjt jj| ��\}}|r(|jdd�}|jt jd�}|| d S )a Convert an absolute path to a directory name for use in a cache. The algorithm used is: #. On Windows, any ``':'`` in the drive is replaced with ``'---'``. #. Any occurrence of ``os.sep`` is replaced with ``'--'``. #. ``'.cache'`` is appended. r< z---z--z.cache)rc rd � splitdriver� r! re )rd r� r� r- r- r. �path_to_cache_dir s rP c C s | j d�s| d S | S )Nrb )�endswith)r, r- r- r. � ensure_slash s rR c C s` d }}d| kr>| j dd�\}} d|kr.|}n|jdd�\}}|rJt|�}|rVt|�}||| fS )NrC r r< )�rsplitr� r )rX �username�passwordrr r- r- r. �parse_credentials$ s rV c C s t jd�} t j| � | S )N� )rc �umask)r( r- r- r. �get_process_umask3 s rY c C s> d}d }x$t | �D ]\}}t|t�sd}P qW |d k s:t�|S )NTF)� enumerater� r rf )�seqr( r] r, r- r- r. �is_string_sequence8 s r\ z3([a-z0-9_]+([.-][a-z_][a-z0-9_]*)*)-([a-z0-9_.+-]+)z -py(\d\.?\d?)c C s� d}d}t | �jdd�} tj| �}|r@|jd�}| d|j� � } |r�t| �t|�d kr�tjtj |�d | �}|r�|j � }| d|� | |d d� |f}|dkr�t j| �}|r�|jd�|jd�|f}|S )zw Extract name, version, python version from a filename (no extension) Return name, version, pyver or None N� �-r z\br� ) r r! �PYTHON_VERSIONr> r� �startrg �rer �escaper �PROJECT_NAME_AND_VERSION)�filename� project_namer( �pyverr' �nr- r- r. �split_filenameG s" rh z-(?P<name>[\w .-]+)\s*\(\s*(?P<ver>[^\s)]+)\)$c C s: t j| �}|std| ��|j� }|d j� j� |d fS )z� A utility method used to get name and version from a string. From e.g. a Provides-Dist value. :param p: A value in a form 'foo (1.0)' :return: The name and version as a tuple. z$Ill-formed name/version string: '%s'rN �ver)�NAME_VERSION_REr r r? rS r� )r� r' r� r- r- r. �parse_name_and_versionc s rk c C s� t � }t | pg �} t |pg �}d| kr8| jd� ||O }x�| D ]x}|dkrV|j|� q>|jd�r�|dd � }||kr�tjd| � ||kr�|j|� q>||kr�tjd| � |j|� q>W |S )N�*r^ r zundeclared extra: %s)r� r� r� rT r� rJ )� requested� availabler( �r�unwantedr- r- r. � get_extrasr s& rq c C s� i }yNt | �}|j� }|jd�}|jd�s8tjd|� ntjd�|�}tj |�}W n0 t k r� } ztj d| |� W Y d d }~X nX |S )Nz Content-Typezapplication/jsonz(Unexpected response for JSON request: %szutf-8z&Failed to get external data for %s: %s) r r� �getrT r� r r� r� r� r� r� � exception)rQ r( �resp�headers�ct�reader�er- r- r. �_get_external_data� s ry z'https://www.red-dove.com/pypi/projects/c C s* d| d j � | f }tt|�}t|�}|S )Nz%s/%s/project.jsonr )�upperr �_external_data_base_urlry )rN rQ r( r- r- r. �get_project_data� s r| c C s( d| d j � | |f }tt|�}t|�S )Nz%s/%s/package-%s.jsonr )rz r r{ ry )rN �versionrQ r- r- r. �get_package_data� s r~ c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �Cachez� A class implementing a cache for resources that need to live in the file system e.g. shared libraries. This class was moved from resources to here because it could be used by other modules, e.g. the wheel module. c C sP t jj|�st j|� t j|�jd@ dkr6tjd|� t jjt jj |��| _ dS )zu Initialise an instance. :param base: The base directory where the cache should be located. �? r z Directory '%s' is not privateN) rc rd r� rK r� r r� rJ r� �normpathro )r� ro r- r- r. r� � s zCache.__init__c C s t |�S )zN Converts a resource prefix to a directory name in the cache. )rP )r� rr r- r- r. � prefix_to_dir� s zCache.prefix_to_dirc C s� g }x�t j| j�D ]r}t jj| j|�}y>t jj|�s@t jj|�rLt j|� nt jj|�rbt j |� W q t k r� |j |� Y qX qW |S )z" Clear the cache. ) rc r( ro rd r$ r� r� r� r� r r� r� r" )r� � not_removed�fnr- r- r. �clear� s z Cache.clearN)r� r� r� �__doc__r� r� r� r- r- r- r. r � s r c @ s: e Zd ZdZdd� Zddd�Zdd� Zd d � Zd d � Zd S )� EventMixinz1 A very simple publish/subscribe system. c C s i | _ d S )N)� _subscribers)r� r- r- r. r� � s zEventMixin.__init__Tc C sD | j }||kr t|g�||< n"|| }|r6|j|� n |j|� dS )a` Add a subscriber for an event. :param event: The name of an event. :param subscriber: The subscriber to be added (and called when the event is published). :param append: Whether to append or prepend the subscriber to an existing subscriber list for the event. N)r� r r" � appendleft)r� �event� subscriberr" �subs�sqr- r- r. r� � s zEventMixin.addc C s, | j }||krtd| ��|| j|� dS )z� Remove a subscriber for an event. :param event: The name of an event. :param subscriber: The subscriber to be removed. zNo subscribers: %rN)r� r� r� )r� r� r� r� r- r- r. r� � s zEventMixin.removec C s t | jj|f ��S )z� Return an iterator for the subscribers for an event. :param event: The event to return subscribers for. )�iterr� rr )r� r� r- r- r. �get_subscribers s zEventMixin.get_subscribersc O sp g }xT| j |�D ]F}y||f|�|�}W n" tk rJ tjd� d}Y nX |j|� qW tjd||||� |S )a^ Publish a event and return a list of values returned by its subscribers. :param event: The event to publish. :param args: The positional arguments to pass to the event's subscribers. :param kwargs: The keyword arguments to pass to the event's subscribers. z"Exception during event publicationNz/publish %s: args = %s, kwargs = %s, result = %s)r� r� r� rs r" r )r� r� �args�kwargsr( r� r� r- r- r. �publish s zEventMixin.publishN)T) r� r� r� r� r� r� r� r� r� r- r- r- r. r� � s r� c @ s^ e Zd Zdd� Zdd� Zddd�Zdd � Zd d � Zd d � Zdd� Z e dd� �Z e dd� �Z dS )� Sequencerc C s i | _ i | _t� | _d S )N)�_preds�_succsr� �_nodes)r� r- r- r. r� " s zSequencer.__init__c C s | j j|� d S )N)r� r� )r� �noder- r- r. �add_node' s zSequencer.add_nodeFc C s� || j kr| j j|� |r�x&t| jj|f ��D ]}| j||� q.W x&t| jj|f ��D ]}| j||� qVW x&t| jj� �D ]\}}|sz| j|= qzW x&t| jj� �D ]\}}|s�| j|= q�W d S )N)r� r� r� r� rr r� r& r� )r� r� �edgesr� r, r� rH r- r- r. � remove_node* s zSequencer.remove_nodec C s< ||ks t �| jj|t� �j|� | jj|t� �j|� d S )N)rf r� � setdefaultr� r� r� )r� �pred�succr- r- r. r� : s z Sequencer.addc C s� ||ks t �y| j| }| j| }W n tk rD td| ��Y nX y|j|� |j|� W n$ tk r� td||f ��Y nX d S )Nz %r not a successor of anythingz%r not a successor of %r)rf r� r� �KeyErrorr� r� )r� r� r� �preds�succsr- r- r. r� ? s zSequencer.removec C s || j kp || jkp || jkS )N)r� r� r� )r� �stepr- r- r. �is_stepL s zSequencer.is_stepc C s� | j |�std| ��g }g }t� }|j|� xd|r�|jd�}||krd||kr�|j|� |j|� q0|j|� |j|� | jj|f �}|j |� q0W t |�S )Nz Unknown: %rr ) r� r� r� r" rj r� r� r� rr �extend�reversed)r� �finalr( �todo�seenr� r� r- r- r. � get_stepsP s" zSequencer.get_stepsc sV dg�g �i �i �g �| j � � ������fdd��x � D ]}|�kr:�|� q:W �S )Nr c s� �d �| < �d �| < �d d7 < �j | � y � | }W n tk rV g }Y nX xR|D ]J}|�kr��|� t�| �| ��| < q^|�kr^t�| �| ��| < q^W �| �| kr�g }x �j� }|j |� || kr�P q�W t|�}�j |� d S )Nr r )r" r� �minrj �tuple)r� � successors� successor�connected_component� component)�graph�index� index_counter�lowlinksr( �stack� strongconnectr- r. r� t s. z3Sequencer.strong_connections.<locals>.strongconnect)r� )r� r� r- )r� r� r� r� r( r� r� r. �strong_connectionsi s " z Sequencer.strong_connectionsc C sr dg}x8| j D ].}| j | }x |D ]}|jd||f � q"W qW x | jD ]}|jd| � qHW |jd� dj|�S )Nz digraph G {z %s -> %s;z %s;�}� )r� r" r� r$ )r� r( r� r� r� r� r- r- r. �dot� s z Sequencer.dotN)F) r� r� r� r� r� r� r� r� r� r� �propertyr� r� r- r- r- r. r� ! s 3r� �.tar.gz�.tar.bz2�.tar�.zip�.tgz�.tbz�.whlTc sX � �fdd�}t jj� �� t� ��d }|d kr�| jd�r>d}nH| jd�rRd}d }n4| jd�rfd }d }n | jd�rzd}d}n td| ��z�|dkr�t| d�}|r�|j� }xD|D ] }||� q�W n.tj | |�}|r�|j � }x|D ] }||� q�W |dk�r6t j d dk �r6x.|j � D ]"} t| jt��s| jjd�| _�qW |j� � W d |�rR|j� X d S )Nc sT t | t�s| jd�} tjjtjj� | ��}|j� � sD|� tjkrPt d| ��d S )Nzutf-8z path outside destination: %r) r� r �decoderc rd r� r$ rT re r� )rd r� )�dest_dir�plenr- r. � check_path� s z unarchive.<locals>.check_path�.zip�.whl�zip�.tar.gz�.tgz�tgzzr:gz�.tar.bz2�.tbz�tbzzr:bz2z.tar�tarro zUnknown format for %rr r� zutf-8)r� r� )r� r� )r� r� )rc rd r� rg rQ r� r �namelist�tarfiler� �getnamesr} r� � getmembersr� rN r r� � extractallr� ) �archive_filenamer� �formatr� r� �archiver �namesrN �tarinfor- )r� r� r. � unarchive� sH r� c C s� t j� }t| �}t|d��b}xZtj| �D ]L\}}}x@|D ]8}tjj||�}||d� } tjj| |�} |j|| � q8W q(W W dQ R X |S )z*zip a directory tree into a BytesIO objectr� N) �io�BytesIOrg r rc �walkrd r$ r� ) � directoryr( �dlen�zfrh r* r rN �full�relrq r- r- r. �zip_dir� s r� r �K�M�G�T�Pc @ sr e Zd ZdZddd�Zdd� Zdd � Zd d � Zd d � Ze dd� �Z e dd� �Z dd� Z e dd� �Z e dd� �ZdS )�Progress�UNKNOWNr �d c C s< |d ks||kst �| | _| _|| _d | _d| _d| _d S )Nr F)rf r� �cur�max�started�elapsed�done)r� �minval�maxvalr- r- r. r� � s zProgress.__init__c C sV | j |kst�| jd ks&|| jks&t�|| _tj� }| jd krF|| _n || j | _d S )N)r� rf r� r� �timer� r� )r� �curval�nowr- r- r. �update s zProgress.updatec C s |dks t �| j| j| � d S )Nr )rf r� r� )r� �incrr- r- r. � increment s zProgress.incrementc C s | j | j� | S )N)r� r� )r� r- r- r. r` s zProgress.startc C s | j d k r| j| j � d| _d S )NT)r� r� r� )r� r- r- r. �stop s z Progress.stopc C s | j d kr| jS | j S )N)r� �unknown)r� r- r- r. �maximum s zProgress.maximumc C sD | j r d}n4| jd kr d}n$d| j| j | j| j }d| }|S )Nz100 %z ?? %g Y@z%3d %%)r� r� r� r� )r� r( rH r- r- r. � percentage s zProgress.percentagec C s: |dkr| j d ks | j| jkr$d}ntjdtj|��}|S )Nr z??:??:??z%H:%M:%S)r� r� r� r� �strftime�gmtime)r� �durationr( r- r- r. �format_duration* s zProgress.format_durationc C s� | j rd}| j}n^d}| jd kr&d}nJ| jdks<| j| jkrBd}n.t| j| j �}|| j| j }|d | j }d|| j|�f S )N�DonezETA r r z%s: %sr� )r� r� r� r� r� �floatr� )r� rr r^ r- r- r. �ETA3 s z Progress.ETAc C sN | j dkrd}n| j| j | j }x tD ]}|dk r6P |d }q(W d||f S )Nr g i� g @�@z%d %sB/s)r� r� r� �UNITS)r� r( �unitr- r- r. �speedF s zProgress.speedN)r r� )r� r� r� r� r� r� r� r` r� r� r� r� r� r r r- r- r- r. r� � s r� z \{([^}]*)\}z[^/\\,{]\*\*|\*\*[^/\\,}]z^[^{]*\}|\{[^}]*$c C s< t j| �rd}t|| ��tj| �r4d}t|| ��t| �S )zAExtended globbing function that supports ** and {opt1,opt2,opt3}.z7invalid glob %r: recursive glob "**" must be used alonez2invalid glob %r: mismatching set marker '{' or '}')�_CHECK_RECURSIVE_GLOBr> r� �_CHECK_MISMATCH_SET�_iglob)� path_globr� r- r- r. r [ s r c c s t j| d�}t|�dkrpt|�dks,t|��|\}}}x�|jd�D ](}x"tdj|||f��D ] }|V q\W qBW n�d| kr�x�t| �D ] }|V q�W n�| jdd�\}}|dkr�d}|dkr�d}n|jd�}|jd �}xHtj |�D ]:\}}} tj j |�}x"ttj j||��D ] } | V �qW q�W d S ) Nr r� rB r z**r/ rl rb �\) � RICH_GLOBr� rg rf r r$ � std_iglobr% rc r� rd r� ) r �rich_path_globrr r� rp �itemrd �radical�dirr r� r- r- r. r f s* r )� HTTPSHandler�match_hostname�CertificateErrorc @ s e Zd ZdZdZdd� ZdS )�HTTPSConnectionNTc C sZ t j| j| jf| j�}t| dd�r0|| _| j� tt d�sp| j rHt j }nt j }t j || j| j|t j| j d�| _n�t jt j�}tt d�r�| jt jO _| jr�|j| j| j� i }| j r�t j |_|j| j d� tt dd�r�| j|d< |j |f|�| _| j o�| j�rVy$t| jj� | j� tjd | j� W n0 t k �rT | jj t j � | jj � � Y nX d S ) N� _tunnel_hostF� SSLContext)� cert_reqs� ssl_version�ca_certs� OP_NO_SSLv2)�cafile�HAS_SNI�server_hostnamezHost verified: %s) r� �create_connection�host�port�timeoutr~ �sock�_tunnelr| �sslr � CERT_REQUIRED� CERT_NONE� wrap_socket�key_file� cert_file�PROTOCOL_SSLv23r �optionsr �load_cert_chain� verify_mode�load_verify_locations� check_domainr � getpeercertr� r r �shutdown� SHUT_RDWRr� )r� r" r �contextr� r- r- r. �connect� s@ zHTTPSConnection.connect)r� r� r� r r/ r4 r- r- r- r. r � s r c @ s& e Zd Zd dd�Zdd� Zdd� ZdS ) r Tc C s t j| � || _|| _d S )N)�BaseHTTPSHandlerr� r r/ )r� r r/ r- r- r. r� � s zHTTPSHandler.__init__c O s$ t ||�}| jr | j|_| j|_|S )a This is called to create a connection instance. Normally you'd pass a connection class to do_open, but it doesn't actually check for a class, and just expects a callable. As long as we behave just as a constructor would have, we should be OK. If it ever changes so that we *must* pass a class, we'll create an UnsafeHTTPSConnection class which just sets check_domain to False in the class definition, and choose which one to pass to do_open. )r r r/ )r� r� r� r( r- r- r. � _conn_maker� s zHTTPSHandler._conn_makerc C sV y| j | j|�S tk rP } z&dt|j�kr>td|j ��n� W Y d d }~X nX d S )Nzcertificate verify failedz*Unable to verify server certificate for %s)�do_openr6 r �str�reasonr r )r� rY rx r- r- r. � https_open� s zHTTPSHandler.https_openN)T)r� r� r� r� r6 r: r- r- r- r. r � s r c @ s e Zd Zdd� ZdS )�HTTPSOnlyHandlerc C s t d| ��d S )NzAUnexpected HTTP request on what should be a secure connection: %s)r )r� rY r- r- r. � http_open� s zHTTPSOnlyHandler.http_openN)r� r� r� r< r- r- r- r. r; � s r; � � c @ s e Zd Zddd�ZdS )�HTTPr Nc K s& |dkr d }| j | j||f|�� d S )Nr )�_setup�_connection_class)r� r r r� r- r- r. r� � s z HTTP.__init__)r N)r� r� r� r� r- r- r- r. r? � s r? c @ s e Zd Zddd�ZdS )�HTTPSr Nc K s& |dkr d }| j | j||f|�� d S )Nr )r@ rA )r� r r r� r- r- r. r� � s zHTTPS.__init__)r N)r� r� r� r� r- r- r- r. rB � s rB c @ s e Zd Zddd�Zdd� ZdS )� Transportr c C s || _ tjj| |� d S )N)r! r rC r� )r� r! � use_datetimer- r- r. r� � s zTransport.__init__c C sb | j |�\}}}tdkr(t|| jd�}n6| j s>|| jd krT|| _|tj|�f| _| jd }|S )Nr= r> )r! r r )r= r> )� get_host_info� _ver_infor? r! � _connection�_extra_headersr �HTTPConnection)r� r �h�eh�x509r( r- r- r. �make_connection� s zTransport.make_connectionN)r )r� r� r� r� rM r- r- r- r. rC � s rC c @ s e Zd Zddd�Zdd� ZdS )� SafeTransportr c C s || _ tjj| |� d S )N)r! r rN r� )r� r! rD r- r- r. r� s zSafeTransport.__init__c C sz | j |�\}}}|si }| j|d< tdkr:t|d f|�}n<| j sP|| jd krl|| _|tj|d f|�f| _| jd }|S )Nr! r= r> r r )r= r> )rE r! rF rB rG rH r r )r� r rJ rK r� r( r- r- r. rM s z SafeTransport.make_connectionN)r )r� r� r� r� rM r- r- r- r. rN s rN c @ s e Zd Zdd� ZdS )� ServerProxyc K st |j dd � | _}|d k r^t|�\}}|jdd�}|dkr@t}nt}|||d� |d< }|| _tjj | |f|� d S )Nr! rD r �https)rD � transport) rj r! r rr rN rC rQ r rO r� ) r� r\ r� r! rW r_ rD �tclsr^ r- r- r. r� s zServerProxy.__init__N)r� r� r� r� r- r- r- r. rO s rO c K s6 t jd dk r|d7 }nd|d< d|d< t| |f|�S )Nr r� �br �newlinezutf-8r� )r} r� r� )r� r r� r- r- r. � _csv_open4 s rU c @ s4 e Zd Zed�ed�ed�d�Zdd� Zdd� Zd S ) �CSVBaserB �"r� )� delimiter� quotechar�lineterminatorc C s | S )Nr- )r� r- r- r. � __enter__F s zCSVBase.__enter__c G s | j j� d S )N)r� r� )r� rF r- r- r. �__exit__I s zCSVBase.__exit__N)r� r� r� r8 �defaultsr[ r\ r- r- r- r. rV ? s rV c @ s( e Zd Zdd� Zdd� Zdd� ZeZdS )� CSVReaderc K s\ d|kr4|d }t jd dkr,tjd�|�}|| _nt|d d�| _tj| jf| j�| _d S )Nr� r r� zutf-8rd ro ) r} r� r� r� r� rU �csvrw r] )r� r� r� r- r- r. r� N s zCSVReader.__init__c C s | S )Nr- )r� r- r- r. �__iter__Y s zCSVReader.__iter__c C sJ t | j�}tjd dk rFx,t|�D ] \}}t|t�s"|jd�||< q"W |S )Nr r� zutf-8)�nextrw r} r� rZ r� r r� )r� r( r] r r- r- r. ra \ s zCSVReader.nextN)r� r� r� r� r` ra �__next__r- r- r- r. r^ M s r^ c @ s e Zd Zdd� Zdd� ZdS )� CSVWriterc K s$ t |d�| _tj| jf| j�| _d S )Nr� )rU r� r_ �writerr] )r� r� r� r- r- r. r� g s zCSVWriter.__init__c C sR t jd dk rBg }x*|D ]"}t|t�r0|jd�}|j|� qW |}| jj|� d S )Nr r� zutf-8)r} r� r� r r r" rd �writerow)r� �rowro r r- r- r. re k s zCSVWriter.writerowN)r� r� r� r� re r- r- r- r. rc f s rc c sH e Zd Zeej�Zded< d � fdd� Zdd� Zdd � Zd d � Z � Z S ) � Configurator� inc_convert�incNc s" t t| �j|� |ptj� | _d S )N)�superrg r� rc r� ro )r� �configro )� __class__r- r. r� ~ s zConfigurator.__init__c s� ��fdd��� j d�}t|�s*�j|�}� j dd �}� j df �}|r\t�fdd�|D ��}� �fdd�� D �}t|�}|||�}|r�x$|j� D ]\}} t||�| �� q�W |S ) Nc sz t | ttf�r*t| �� fdd�| D ��}nLt | t�rld| krH�j| �}qvi }x(| D ]}� | | �||< qRW n �j| �}|S )Nc s g | ] }� |��qS r- r- )rK r] )�convertr- r. rM � s zBConfigurator.configure_custom.<locals>.convert.<locals>.<listcomp>z())r� r& r� �type�dict�configure_customrm )�or( r� )rm r� r- r. rm � s z.Configurator.configure_custom.<locals>.convertz()r/ z[]c s g | ] }� |��qS r- r- )rK rq )rm r- r. rM � s z1Configurator.configure_custom.<locals>.<listcomp>c s$ g | ] }t |�r|�� | �f�qS r- )r )rK r� )rk rm r- r. rM � s )rj r; r5 r� ro r� �setattr) r� rk r� �propsr� r� r� r( rg rH r- )rk rm r� r. rp � s z Configurator.configure_customc C s4 | j | }t|t�r0d|kr0| j|� | j |< }|S )Nz())rk r� ro rp )r� r� r( r- r- r. � __getitem__� s zConfigurator.__getitem__c C sF t jj|�s t jj| j|�}tj|ddd��}tj|�}W dQ R X |S )z*Default converter for the inc:// protocol.ro zutf-8)r� N) rc rd �isabsr$ ro r� r� r� r� )r� r� r� r( r- r- r. rh � s zConfigurator.inc_convert)N) r� r� r� ro r �value_convertersr� rp rt rh � __classcell__r- r- )rl r. rg y s rg c @ s* e Zd ZdZd dd�Zdd� Zdd � ZdS ) �SubprocessMixinzC Mixin for running subprocesses and capturing their output FNc C s || _ || _d S )N)�verbose�progress)r� ry rz r- r- r. r� � s zSubprocessMixin.__init__c C sn | j }| j}xT|j� }|s P |dk r0|||� q|sBtjjd� ntjj|jd�� tjj� qW |j� dS )z� Read lines from a subprocess' output stream and either pass to a progress callable (if specified) or write progress information to sys.stderr. Nr/ zutf-8) rz ry �readliner} �stderrr� r� �flushr� )r� r� r3 rz ry r, r- r- r. rw � s zSubprocessMixin.readerc K s� t j|ft jt jd�|��}tj| j|jdfd�}|j� tj| j|jdfd�}|j� |j � |j � |j � | j d k r�| j dd� n| j r�t jjd� |S )N)�stdoutr| r~ )r� r� r| zdone.�mainzdone. )� subprocess�Popen�PIPE� threading�Threadrw r~ r` r| �waitr$ rz ry r} r� )r� �cmdr� r� �t1�t2r- r- r. � run_command� s zSubprocessMixin.run_command)FN)r� r� r� r� r� rw r� r- r- r- r. rx � s rx c C s t jdd| �j� S )z,Normalize a python package name a la PEP 503z[-_.]+r^ )ra �subr� )rN r- r- r. �normalize_name� s r� )NN)r� )N)N)r� r� r� r� r� r� r� )NT)r r� r� r� r� r� )r= r> )�r� � collectionsr � contextlibr_ �globr r r� r� �loggingrc r ra r� r$ � ImportErrorr� r} r� r� r� r� �dummy_threadingr� r r �compatr r r r r r r r r r r r r r r r r r r r r � getLoggerr� r� r r rE rD r5 r< r9 rV r# r> ra ry r r� r� r� r� r� �contextmanagerr� r� r� r� r� r� r� r5 r6 �VERBOSEr= r� rN rP rR rV rY r\ �Irc r_ rh rj rk rq ry r{ r| r~ r r� r� �ARCHIVE_EXTENSIONSr� r� r r� r r r r r r5 r r r r; r� rF r? rB rC rN rO rU rV r^ rc rg rx r� r- r- r- r. �<module> s� \ Yy / 8 ) ,H 6] +) 7.