관리-도구
편집 파일: poolmanager.cpython-34.pyc
� �Re# � @ s d d l Z y d d l m Z Wn" e k rD d d l m Z Yn Xd d l m Z d d l m Z m Z d d l m Z d d l m Z d d l m Z d d d g Z i e d 6e d 6Z e j e � Z d Z Gd d � d e � Z Gd d � d e � Z d d � Z d S)� N)�urljoin� )�RecentlyUsedContainer)�HTTPConnectionPool�HTTPSConnectionPool)�port_by_scheme)�RequestMethods)� parse_url� PoolManager� ProxyManager�proxy_from_url�http�https�key_file� cert_file� cert_reqs�ca_certs� ssl_versionc @ ss e Z d Z d Z d Z d d d d � Z d d � Z d d � Z d d d d � Z d d � Z d d d � Z d S)r a& Allows for arbitrary requests while transparently keeping track of necessary connection pools for you. :param num_pools: Number of connection pools to cache before discarding the least recently used pool. :param headers: Headers to include with all requests, unless other headers are given explicitly. :param \**connection_pool_kw: Additional parameters are used to create fresh :class:`urllib3.connectionpool.ConnectionPool` instances. Example: :: >>> manager = PoolManager(num_pools=2) >>> r = manager.request('GET', 'http://google.com/') >>> r = manager.request('GET', 'http://google.com/mail') >>> r = manager.request('GET', 'http://yahoo.com/') >>> len(manager.pools) 2 N� c K s8 t j | | � | | _ t | d d d � �| _ d S)N� dispose_funcc S s | j � S)N)�close)�p� r �L/tmp/pip-ztkk0jow-build/pip/_vendor/requests/packages/urllib3/poolmanager.py�<lambda>E s z&PoolManager.__init__.<locals>.<lambda>)r �__init__�connection_pool_kwr �pools)�self� num_pools�headersr r r r r A s zPoolManager.__init__c C sb t | } | j } | d k rR | j j � } x! t D] } | j | d � q5 Wn | | | | � S)a Create a new :class:`ConnectionPool` based on host, port and scheme. This method is used to actually create the connection pools handed out by :meth:`connection_from_url` and companion methods. It is intended to be overridden for customization. r N)�pool_classes_by_schemer �copy� SSL_KEYWORDS�pop)r �scheme�host�port�pool_cls�kwargs�kwr r r � _new_poolG s zPoolManager._new_poolc C s | j j � d S)z� Empty our store of pools and direct them all to close. This will not affect in-flight connections, but they will not be re-used after completion. N)r �clear)r r r r r, X s zPoolManager.clearr c C s� | p d } | p! t j | d � } | | | f } | j j �C | j j | � } | r\ | S| j | | | � } | | j | <Wd QX| S)z� Get a :class:`ConnectionPool` based on the host, port, and scheme. If ``port`` isn't given, it will be derived from the ``scheme`` using ``urllib3.connectionpool.port_by_scheme``. r �P N)r �getr �lockr+ )r r& r' r% �pool_key�poolr r r �connection_from_hosta s z PoolManager.connection_from_hostc C s. t | � } | j | j d | j d | j �S)a* Similar to :func:`urllib3.connectionpool.connection_from_url` but doesn't pass any additional parameters to the :class:`urllib3.connectionpool.ConnectionPool` constructor. Additional parameters are taken from the :class:`.PoolManager` constructor. r' r% )r r2 r& r' r% )r �url�ur r r �connection_from_url{ s z PoolManager.connection_from_urlTc K s? t | � } | j | j d | j d | j �} d | d <d | d <d | k r` | j | d <n | j d k r� | j d k r� | j | | | � } n | j | | j | � } | o� | j � } | s� | St | | � } | j d k r� d } n t j d | | f � | j d d � d | d <| | d <| j | | | � S)a] Same as :meth:`urllib3.connectionpool.HTTPConnectionPool.urlopen` with custom cross-host redirect logic and only sends the request-uri portion of the ``url``. The given ``url`` parameter must be absolute, such that an appropriate :class:`urllib3.connectionpool.ConnectionPool` can be chosen for it. r' r% F�assert_same_host�redirectr Nr i/ �GETzRedirecting %s -> %s�retries� r )r r2 r& r' r% r �proxy�urlopen� request_uri�get_redirect_locationr �status�log�infor. ) r �methodr3 r7 r* r4 �conn�response�redirect_locationr r r r< � s& $ zPoolManager.urlopen) �__name__� __module__� __qualname__�__doc__r; r r+ r, r2 r5 r< r r r r r # s c sm e Z d Z d Z d d d � f d d � Z d d � f d d � Z d d d � Z d � f d d � Z � S)r aw Behaves just like :class:`PoolManager`, but sends all requests through the defined proxy, using the CONNECT method for HTTPS URLs. :param proxy_url: The URL of the proxy to be used. :param proxy_headers: A dictionary contaning headers that will be sent to the proxy. In case of HTTP they are being sent with each request, while in the HTTPS/CONNECT case they are sent only once. Could be used for proxy authentication. Example: >>> proxy = urllib3.ProxyManager('http://localhost:3128/') >>> r1 = proxy.request('GET', 'http://google.com/') >>> r2 = proxy.request('GET', 'http://httpbin.org/') >>> len(proxy.pools) 1 >>> r3 = proxy.request('GET', 'https://httpbin.org/') >>> r4 = proxy.request('GET', 'https://twitter.com/') >>> len(proxy.pools) 3 r Nc s� t | t � r. d | j | j | j f } n t | � } | j sm t j | j d � } | j d | � } n | | _ | p i | _ | j j d k s� t d | j j � � | j | d <| j | d <t t | � j | | | � d S) Nz %s://%s:%ir- r' r r z Not supported proxy scheme %s�_proxy�_proxy_headers)zhttpzhttps)� isinstancer r% r& r' r r r. �_replacer; � proxy_headers�AssertionError�superr r )r � proxy_urlr r rN r r; r' )� __class__r r r � s zProxyManager.__init__r c sV | d k r( t t | � j | | | � St t | � j | j j | j j | j j � S)Nr )rP r r2 r; r& r' r% )r r& r' r% )rR r r r2 � s z!ProxyManager.connection_from_hostc C sI i d d 6} t | � j } | r/ | | d <n | rE | j | � n | S)z� Sets headers needed by proxies: specifically, the Accept and Host headers. Only sets headers not provided by the user. z*/*�Accept�Host)r �netloc�update)r r3 r �headers_rU r r r �_set_proxy_headers� s z ProxyManager._set_proxy_headersTc sb t | � } | j d k rC | j | | j d | j � � | d <n t t | � j | | | | � S)z@Same as HTTP(S)ConnectionPool.urlopen, ``url`` must be absolute.r r )r r% rX r. r rP r r< )r rB r3 r7 r* r4 )rR r r r< � s zProxyManager.urlopen)rF rG rH rI r r2 rX r< r r )rR r r � s c K s t d | | � S)NrQ )r )r3 r* r r r r s )zkey_filez cert_filez cert_reqszca_certsz ssl_version)�logging� urllib.parser � ImportError�urlparse� _collectionsr �connectionpoolr r r �requestr �utilr �__all__r! � getLoggerrF r@ r# r r r r r r r �<module> s& �S