관리-도구
편집 파일: poolmanager.cpython-39.pyc
a ��Re3M � @ s6 d dl mZ d dlZd dlZd dlZddlmZ ddlmZm Z m Z ddl m Z m Z mZmZmZ ddlmZ ddlmZ dd lmZ dd lmZ dd lmZ dd lm Z g d �Z e� e �Z dZ!dZ"e�#de"�Z$dZ%e�#de%�Z&dd� Z'e�(e'e$�e�(e'e$�d�Z)ee d�Z*G dd� de�Z+G dd� de+�Z,dd� Z-dS ) � )�absolute_importN� )�RecentlyUsedContainer)�HTTPConnectionPool�HTTPSConnectionPool�port_by_scheme)�LocationValueError� MaxRetryError�ProxySchemeUnknown�ProxySchemeUnsupported�URLSchemeUnknown)�six)�urljoin)�RequestMethods)� connection_requires_http_tunnel)�Retry)� parse_url)� PoolManager� ProxyManager�proxy_from_url)�key_file� cert_file� cert_reqs�ca_certs� ssl_version� ca_cert_dir� ssl_context� key_password)� key_scheme�key_host�key_port� key_timeout� key_retries� key_strict� key_block�key_source_address� key_key_file�key_key_password� key_cert_file� key_cert_reqs� key_ca_certs�key_ssl_version�key_ca_cert_dir�key_ssl_context� key_maxsize� key_headers� key__proxy�key__proxy_headers�key__proxy_config�key_socket_options�key__socks_options�key_assert_hostname�key_assert_fingerprint�key_server_hostname�PoolKey)r �use_forwarding_for_https� ProxyConfigc C s� |� � }|d �� |d< |d �� |d< dD ],}||v r,|| dur,t|| �� �||< q,|�d�}|durxt|�|d< t|�� �D ]}|�|�|d| < q�| j D ]}||vr�d||< q�| f i |��S )a� Create a pool key out of a request context dictionary. According to RFC 3986, both the scheme and host are case-insensitive. Therefore, this function normalizes both before constructing the pool key for an HTTPS request. If you wish to change this behaviour, provide alternate callables to ``key_fn_by_scheme``. :param key_class: The class to use when constructing the key. This should be a namedtuple with the ``scheme`` and ``host`` keys at a minimum. :type key_class: namedtuple :param request_context: A dictionary-like object that contain the context for a request. :type request_context: dict :return: A namedtuple that can be used as a connection pool key. :rtype: PoolKey �scheme�host)�headers�_proxy_headers�_socks_optionsN�socket_options�key_) �copy�lower� frozenset�items�get�tuple�list�keys�pop�_fields)� key_class�request_context�context�key� socket_opts�field� rR ��/builddir/build/BUILDROOT/alt-python39-pip-21.3.1-2.el8.x86_64/opt/alt/python39/lib/python3.9/site-packages/pip/_vendor/urllib3/poolmanager.py�_default_key_normalizerN s rT ��http�httpsc @ s� e Zd ZdZdZdZd dd�Zdd� Zdd � Zd!d d �Z d d � Z d"dd�Z dd� Z d#dd�Z d$dd�Zdd� Zdd� Zdd � Zd%d d �ZdS )&r a$ Allows for arbitrary requests while transparently keeping track of necessary connection pools for you. :param num_pools: Number of connection pools to cache before discarding the least recently used pool. :param headers: Headers to include with all requests, unless other headers are given explicitly. :param \**connection_pool_kw: Additional parameters are used to create fresh :class:`urllib3.connectionpool.ConnectionPool` instances. Example:: >>> manager = PoolManager(num_pools=2) >>> r = manager.request('GET', 'http://google.com/') >>> r = manager.request('GET', 'http://google.com/mail') >>> r = manager.request('GET', 'http://yahoo.com/') >>> len(manager.pools) 2 N� c K s8 t �| |� || _t|dd� d�| _t| _t�� | _d S )Nc S s | � � S �N)�close)�prR rR rS �<lambda>� � z&PoolManager.__init__.<locals>.<lambda>)� dispose_func)r �__init__�connection_pool_kwr �pools�pool_classes_by_scheme�key_fn_by_schemerB )�self� num_poolsr= r` rR rR rS r_ � s zPoolManager.__init__c C s | S rY rR �rd rR rR rS � __enter__� s zPoolManager.__enter__c C s | � � dS )NF)�clear)rd �exc_type�exc_val�exc_tbrR rR rS �__exit__� s zPoolManager.__exit__c C sb | j | }|du r | j�� }dD ]}|�|d� q |dkrPtD ]}|�|d� q>|||fi |��S )a� Create a new :class:`urllib3.connectionpool.ConnectionPool` based on host, port, scheme, and any additional pool keyword arguments. If ``request_context`` is provided, it is provided as keyword arguments to the pool class used. This method is used to actually create the connection pools handed out by :meth:`connection_from_url` and companion methods. It is intended to be overridden for customization. N)r; r< �portrV )rb r` rB rJ � SSL_KEYWORDS)rd r; r< rm rM �pool_clsrO �kwrR rR rS � _new_pool� s zPoolManager._new_poolc C s | j �� dS )z� Empty our store of pools and direct them all to close. This will not affect in-flight connections, but they will not be re-used after completion. N)ra rh rf rR rR rS rh � s zPoolManager.clearrV c C sT |s t d��| �|�}|p d|d< |s:t�|d �� d�}||d< ||d< | �|�S )a� Get a :class:`urllib3.connectionpool.ConnectionPool` based on the host, port, and scheme. If ``port`` isn't given, it will be derived from the ``scheme`` using ``urllib3.connectionpool.port_by_scheme``. If ``pool_kwargs`` is provided, it is merged with the instance's ``connection_pool_kw`` variable and used to create the new connection pool, if one is needed. zNo host specified.rV r; �P rm r< )r �_merge_pool_kwargsr rF rC �connection_from_context)rd r< rm r; � pool_kwargsrM rR rR rS �connection_from_host� s z PoolManager.connection_from_hostc C s: |d � � }| j�|�}|s$t|��||�}| j||d�S )z� Get a :class:`urllib3.connectionpool.ConnectionPool` based on the request context. ``request_context`` must at least contain the ``scheme`` key and its value must be a key in ``key_fn_by_scheme`` instance variable. r; �rM )rC rc rF r �connection_from_pool_key)rd rM r; �pool_key_constructor�pool_keyrR rR rS rt � s z#PoolManager.connection_from_contextc C s� | j j�f | j �|�}|r,|W d � S |d }|d }|d }| j||||d�}|| j |< W d � n1 st0 Y |S )a Get a :class:`urllib3.connectionpool.ConnectionPool` based on the provided pool key. ``pool_key`` should be a namedtuple that only contains immutable objects. At a minimum it must have the ``scheme``, ``host``, and ``port`` fields. Nr; r< rm rw )ra �lockrF rq )rd rz rM �poolr; r< rm rR rR rS rx s (z$PoolManager.connection_from_pool_keyc C s t |�}| j|j|j|j|d�S )a� Similar to :func:`urllib3.connectionpool.connection_from_url`. If ``pool_kwargs`` is not provided and a new pool needs to be constructed, ``self.connection_pool_kw`` is used to initialize the :class:`urllib3.connectionpool.ConnectionPool`. If ``pool_kwargs`` is provided, it is used instead. Note that if a new pool does not need to be created for the request, the provided ``pool_kwargs`` are not used. )rm r; ru )r rv r< rm r; )rd �urlru �urR rR rS �connection_from_url s �z PoolManager.connection_from_urlc C sT | j �� }|rP|�� D ]8\}}|du rFz ||= W qN tyB Y qN0 q|||< q|S )a Merge a dictionary of override values for self.connection_pool_kw. This does not modify self.connection_pool_kw and returns a new dict. Any keys in the override dictionary with a value of ``None`` are removed from the merged dictionary. N)r` rB rE �KeyError)rd �override�base_pool_kwargsrO �valuerR rR rS rs . s z PoolManager._merge_pool_kwargsc C s" | j du rdS t| j | j|j� S )z� Indicates if the proxy requires the complete destination URL in the request. Normally this is only needed when not using an HTTP CONNECT tunnel. NF)�proxyr � proxy_configr; )rd � parsed_urlrR rR rS �!_proxy_requires_url_absolute_formB s �z-PoolManager._proxy_requires_url_absolute_formc C s@ | j du s|dkrdS | j jdkr&dS tjr<| jjs<td��dS )z� Validates that were not attempting to do TLS in TLS connections on Python2 or with unsupported SSL implementations. NrW zfContacting HTTPS destinations through HTTPS proxies 'via CONNECT tunnels' is not supported in Python 2)r� r; r �PY2r� r9 r )rd � url_schemerR rR rS �$_validate_proxy_scheme_url_selectionO s �z0PoolManager._validate_proxy_scheme_url_selectionTc K s� t |�}| �|j� | j|j|j|jd�}d|d< d|d< d|vrP| j�� |d< | �|�rp|j ||fi |��}n|j ||j fi |��}|o�|� � }|s�|S t ||�}|j dkr�d}|�d�} t| t�s�tj| |d �} | j�r"|�|��s"tt�|d ��} | D ]"} | �� | jv r�|d �| d � q�z| j||||d �} W n* t�yb | j�rZ|� � � | Y S 0 | |d< ||d< t � d ||� |� � | j ||fi |��S ) aN Same as :meth:`urllib3.HTTPConnectionPool.urlopen` with custom cross-host redirect logic and only sends the request-uri portion of the ``url``. The given ``url`` parameter must be absolute, such that an appropriate :class:`urllib3.connectionpool.ConnectionPool` can be chosen for it. )rm r; F�assert_same_host�redirectr= i/ �GET�retries)r� N)�response�_poolzRedirecting %s -> %s) r r� r; rv r< rm r= rB r� �urlopen� request_uri�get_redirect_locationr �statusrF � isinstancer �from_int�remove_headers_on_redirect� is_same_hostrH r �iterkeysrC rJ � incrementr �raise_on_redirect� drain_conn�log�info) rd �methodr} r� rp r~ �connr� �redirect_locationr� r= �headerrR rR rS r� ` sL � zPoolManager.urlopen)rX N)N)NrV N)N)N)T)�__name__� __module__� __qualname__�__doc__r� r� r_ rg rl rq rh rv rt rx r rs r� r� r� rR rR rR rS r � s r c sH e Zd ZdZd� fdd� Zd� fdd � Zdd d �Zd� fd d� Z� ZS )r a> Behaves just like :class:`PoolManager`, but sends all requests through the defined proxy, using the CONNECT method for HTTPS URLs. :param proxy_url: The URL of the proxy to be used. :param proxy_headers: A dictionary containing headers that will be sent to the proxy. In case of HTTP they are being sent with each request, while in the HTTPS/CONNECT case they are sent only once. Could be used for proxy authentication. :param proxy_ssl_context: The proxy SSL context is used to establish the TLS connection to the proxy when using HTTPS proxies. :param use_forwarding_for_https: (Defaults to False) If set to True will forward requests to the HTTPS proxy to be made on behalf of the client instead of creating a TLS tunnel via the CONNECT method. **Enabling this flag means that request and response headers and content will be visible from the HTTPS proxy** whereas tunneling keeps request and response headers and content private. IP address, target hostname, SNI, and port are always visible to an HTTPS proxy even when this flag is disabled. Example: >>> proxy = urllib3.ProxyManager('http://localhost:3128/') >>> r1 = proxy.request('GET', 'http://google.com/') >>> r2 = proxy.request('GET', 'http://httpbin.org/') >>> len(proxy.pools) 1 >>> r3 = proxy.request('GET', 'https://httpbin.org/') >>> r4 = proxy.request('GET', 'https://twitter.com/') >>> len(proxy.pools) 3 rX NFc s� t |t�r d|j|j|jf }t|�}|jdvr:t|j��|jsZt�|jd�} |j | d�}|| _ |pfi | _ || _ t ||�| _| j |d< | j |d< | j|d< tt| �j||fi |�� d S )Nz %s://%s:%irU rr )rm �_proxyr> � _proxy_config)r� r r; r< rm r r r rF �_replacer� � proxy_headers�proxy_ssl_contextr: r� �superr r_ ) rd � proxy_urlre r= r� r� r9 r` r� rm �� __class__rR rS r_ � s( � zProxyManager.__init__rV c sD |dkr t t| �j||||d�S t t| �j| jj| jj| jj|d�S )NrW )ru )r� r rv r� r< rm r; )rd r< rm r; ru r� rR rS rv � s � �z!ProxyManager.connection_from_hostc C s0 ddi}t |�j}|r ||d< |r,|�|� |S )z� Sets headers needed by proxies: specifically, the Accept and Host headers. Only sets headers not provided by the user. �Acceptz*/*�Host)r �netloc�update)rd r} r= �headers_r� rR rR rS �_set_proxy_headers� s z ProxyManager._set_proxy_headersTc sV t |�}t| j| j|j�s8|�d| j�}| �||�|d< tt | �j ||fd|i|��S )z@Same as HTTP(S)ConnectionPool.urlopen, ``url`` must be absolute.r= r� ) r r r� r� r; rF r= r� r� r r� )rd r� r} r� rp r~ r= r� rR rS r� s zProxyManager.urlopen)rX NNNF)NrV N)N)T) r� r� r� r� r_ rv r� r� � __classcell__rR rR r� rS r � s * �% r c K s t f d| i|��S )Nr� )r )r} rp rR rR rS r s r ).� __future__r � collections� functools�logging� _collectionsr �connectionpoolr r r � exceptionsr r r r r �packagesr Z packages.six.moves.urllib.parser �requestr Z util.proxyr Z util.retryr Zutil.urlr �__all__� getLoggerr� r� rn � _key_fields� namedtupler8 �_proxy_config_fieldsr: rT �partialrc rb r r r rR rR rR rS �<module> s: 6 � s