OwlCyberSecurity - MANAGER
Edit File: link.cpython-39.pyc
a )��e�H � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlm Z d dl m Z m Z m Z mZmZmZmZmZmZ d dlmZ d dlmZ d dlmZ d dlmZm Z m Z m Z d dl m Z d d l!m"Z"m#Z# e r�d d l$m%Z% e�&e'�Z(d Z)e d d �G dd� d��Z*e+e+d�dd�Z,e+e+d�dd�Z-e�.dej/�Z0e+e1e+d�dd�Z2e+e+d�dd�Z3G d d � d e �Z4G d d � d e�Z5e4e5d �d!d"�Z6e j7dd#�e4e4e1d$�d%d&��Z8dS )'� N)� dataclass) � TYPE_CHECKING�Any�Dict�List�Mapping� NamedTuple�Optional�Tuple�Union)� deprecated)�WHEEL_EXTENSION)�Hashes)�pairwise�redact_auth_from_url�split_auth_from_netloc�splitext)�KeyBasedCompareMixin)� path_to_url� url_to_path)� IndexContent)�sha512�sha384�sha256�sha224�sha1�md5T)�frozenc @ s� e Zd ZU dZeed< eed< e�djd� dd� e D ��d��Z d d �d d �Z e ejd d �eed d�dd���Zeeef d �dd�Zed �dd�Zee ed�dd�Zd S )�LinkHasha� Links to content may have embedded hash values. This class parses those. `name` must be any member of `_SUPPORTED_HASHES`. This class can be converted to and from `ArchiveInfo`. While ArchiveInfo intends to be JSON-serializable to conform to PEP 610, this class contains the logic for parsing a hash name and value for correctness, and then checking whether that hash conforms to a schema with `.is_hash_allowed()`.�name�valuez({choices})=(.*)�|c c s | ]}t �|�V qd S �N)�re�escape)�.0� hash_name� r' �Z/home/gouroczh/virtualenv/pat/3.9/lib/python3.9/site-packages/pip/_internal/models/link.py� <genexpr>A � zLinkHash.<genexpr>)�choicesN��returnc C s" | j �| j� d| j� ��s J �d S )N�=)�_hash_re�matchr r ��selfr' r' r( � __post_init__E s zLinkHash.__post_init__��maxsize��urlr- c C s0 | j �|�}|du rdS |�� \}}| ||d�S )zGSearch a string for a checksum algorithm name and encoded output value.N�r r )r/ �search�groups)�clsr7 r0 r r r' r' r( �split_hash_name_and_valueH s z"LinkHash.split_hash_name_and_valuec C s | j | jiS r" r8 r1 r' r' r( �as_dictR s zLinkHash.as_dictc C s t | j| jgi�S )z@Return a Hashes instance which checks only for the current hash.)r r r r1 r' r' r( � as_hashesU s zLinkHash.as_hashes��hashesr- c C s |du r dS |j | j| jd�S )zI Return True if the current hash is allowed by `hashes`. NF)� hex_digest)�is_hash_allowedr r �r2 r@ r' r' r( rB Y s zLinkHash.is_hash_allowed)�__name__� __module__� __qualname__�__doc__�str�__annotations__r# �compile�format�join�_SUPPORTED_HASHESr/ r3 � classmethod� functools� lru_cacher r< r r= r r> �boolrB r' r' r' r( r , s �� r )�partr- c C s t j�t j�| ��S )zP Clean a "part" of a URL path (i.e. after splitting on "@" characters). )�urllib�parse�quote�unquote�rR r' r' r( �_clean_url_path_partb s rX c C s t j�t j�| ��S )z� Clean the first part of a URL path that corresponds to a local filesystem path (i.e. the first part after splitting on "@" characters). )rS �request� pathname2url� url2pathnamerW r' r' r( �_clean_file_url_pathj s r\ z(@|%2F))�path� is_local_pathr- c C s^ |r t }nt}t�| �}g }tt�|dg��D ]$\}}|�||�� |�|�� � q.d� |�S )z* Clean the path portion of a URL. � ) r\ rX �_reserved_chars_re�splitr � itertools�chain�append�upperrL )r] r^ Z clean_func�partsZ cleaned_partsZto_clean�reservedr' r' r( �_clean_url_path{ s rh r6 c C s6 t j�| �}|j }t|j|d�}t j�|j|d��S )z� Make sure a link is fully quoted. For example, if ' ' occurs in the URL, it will be replaced with "%20", and without double-quoting other characters. )r^ )r] )rS rT �urlparse�netlocrh r] � urlunparse�_replace)r7 �resultr^ r] r' r' r( �_ensure_quoted_url� s rn c s� e Zd ZdZg d�ZdFeeeedf ee ee ee eee eef dd�� fdd� Z e e ee f eed d �d d ��Ze e eee f eeed d �d d��Zed�dd�Zed�dd�Zeed�dd��Zeed�dd��Zeed�dd��Zeed�dd��Zeed�d d ��Zeed�d d ��Zeeef d�d d!�Zeed�d"d#��Zeed�d$d%��Z e � d&�Z e � d'e j �Z!ee d�d(d)�Z"e � d*�Z#eee d�d+d,��Z$ed d�d-d.�Z%e&d�d/d0�Z'eee d�d1d2��Z(eee d�d3d4��Z)eed�d5d6��Z*eed�d7d8��Z+ed�d9d:�Z,eed�d;d<��Z-eed�d=d>��Z.eed�d?d@��Z/eed�dAdB��Z0ee& edC�dDdE�Z1� Z2S )G�Linkz:Represents a parsed link from a Package Index's simple URL) � _parsed_url�_url�_hashes� comes_from�requires_python� yanked_reason�dist_info_metadata�cache_link_parsing� egg_fragmentNTr )r7 rs rt ru rv rw r@ r- c s� |� d�rt|�}tj�|�| _|| _t�|�}|du r<i n|� � } |du rT| | _ ni |�| �| _ || _ |rp|nd| _ || _ || _t� j|td� || _| �� | _dS )aG :param url: url of the resource pointed to (href of the link) :param comes_from: instance of IndexContent where the link was found, or string. :param requires_python: String containing the `Requires-Python` metadata field, specified in PEP 345. This may be specified by a data-requires-python attribute in the HTML link tag, as described in PEP 503. :param yanked_reason: the reason the file has been yanked, if the file has been yanked, or None if the file hasn't been yanked. This is the value of the "data-yanked" attribute, if present, in a simple repository HTML link. If the file has been yanked but no reason was provided, this should be the empty string. See PEP 592 for more information and the specification. :param dist_info_metadata: the metadata attached to the file, or None if no such metadata is provided. This is the value of the "data-dist-info-metadata" attribute, if present, in a simple repository HTML link. This may be parsed into its own `Link` by `self.metadata_link()`. See PEP 658 for more information and the specification. :param cache_link_parsing: A flag that is used elsewhere to determine whether resources retrieved from this link should be cached. PyPI URLs should generally have this set to False, for example. :param hashes: A mapping of hash names to digests to allow us to determine the validity of a download. z\\N)�key�defining_class)� startswithr rS rT �urlsplitrp rq r r< r= rr rs rt ru rv �super�__init__ro rw � _egg_fragmentrx ) r2 r7 rs rt ru rv rw r@ � link_hashZhashes_from_link�� __class__r' r( r~ � s % z Link.__init__)� file_data�page_urlr- c C s� |� d�}|du rdS ttj�||��}|� d�}|� d�}|� d�}|� di �}|rft|t�sfd}n|snd}| ||||||d�S ) zZ Convert an pypi json document from a simple repository page into a Link. r7 Nzrequires-pythonZyankedzdist-info-metadatar@ r_ )rs rt ru r@ rv )�getrn rS rT �urljoin� isinstancerH ) r; r� r� Zfile_urlr7 � pyrequireru rv r@ r' r' r( � from_json� s( �zLink.from_json)�anchor_attribsr� �base_urlr- c C sT |� d�}|sdS ttj�||��}|� d�}|� d�}|� d�}| |||||d�S )z_ Convert an anchor element's attributes in a simple repository page to a Link. �hrefNzdata-requires-pythonz data-yankedzdata-dist-info-metadata)rs rt ru rv )r� rn rS rT r� ) r; r� r� r� r� r7 r� ru rv r' r' r( � from_element s �zLink.from_elementr, c C sH | j rd| j � d�}nd}| jr6d�t| j�| j|�S tt| j��S d S )Nz (requires-python:�)r_ z{} (from {}){})rt rs rK r rq rH )r2 Zrpr' r' r( �__str__+ s �z Link.__str__c C s d| � d�S )Nz<Link �>r' r1 r' r' r( �__repr__7 s z Link.__repr__c C s | j S r" )rq r1 r' r' r( r7 : s zLink.urlc C sR | j �d�}t�|�}|s,t| j�\}}|S tj�|�}|sNJ d| j �d���|S )N�/zURL z produced no filename) r] �rstrip� posixpath�basenamer rj rS rT rV rq )r2 r] r rj � user_passr' r' r( �filename> s z Link.filenamec C s t | j�S r" )r r7 r1 r' r' r( � file_pathL s zLink.file_pathc C s | j jS r" )rp �schemer1 r' r' r( r� P s z Link.schemec C s | j jS )z4 This can contain auth information. )rp rj r1 r' r' r( rj T s z Link.netlocc C s t j�| jj�S r" )rS rT rV rp r] r1 r' r' r( r] [ s z Link.pathc C s t t�| j�d���S )Nr� )r r� r� r] r� r1 r' r' r( r _ s z Link.splitextc C s | � � d S �N� )r r1 r' r' r( �extb s zLink.extc C s& | j \}}}}}tj�||||df�S )Nr_ )rp rS rT � urlunsplit)r2 r� rj r] �query�fragmentr' r' r( �url_without_fragmentf s zLink.url_without_fragmentz[#&]egg=([^&]*)z)^([A-Z0-9]|[A-Z0-9][A-Z0-9._-]*[A-Z0-9])$c C sF | j �| j�}|sd S |�d�}| j�|�sBt| � d�dddd� |S )Nr� z1 contains an egg fragment with a non-PEP 508 namez8to use the req @ url syntax, and remove the egg fragmentz25.0ia- )�reason� replacement�gone_in�issue)�_egg_fragment_rer9 rq �group�_project_name_rer0 r )r2 r0 � project_namer' r' r( r r s �zLink._egg_fragmentz[#&]subdirectory=([^&]*)c C s | j �| j�}|sd S |�d�S r� )�_subdirectory_fragment_rer9 rq r� )r2 r0 r' r' r( �subdirectory_fragment� s zLink.subdirectory_fragmentc C sV | j du rdS | j� d�}| j dkr2t�| j �}nd}|du rFt|�S t||�� d�S )z"Implementation of PEP 658 parsing.Nz .metadata�true�r@ )rv r� r r< ro r= )r2 Z metadata_urlr� r' r' r( � metadata_link� s zLink.metadata_linkc C s t dd� | j�� D ��S )Nc S s i | ]\}}||g�qS r' r' �r% �k�vr' r' r( � <dictcomp>� r* z"Link.as_hashes.<locals>.<dictcomp>)r rr �itemsr1 r' r' r( r> � s zLink.as_hashesc C s t t| j�� �d �S r" )�next�iterrr �valuesr1 r' r' r( �hash� s z Link.hashc C s t t| j�d �S r" )r� r� rr r1 r' r' r( r& � s zLink.hash_namec C s$ t �| j�dd�d �dd�d �S )N�#r� r �?)r� r� rq ra r1 r' r' r( �show_url� s z Link.show_urlc C s | j dkS )N�file)r� r1 r' r' r( �is_file� s z Link.is_filec C s | j otj�| j�S r" )r� �osr] �isdirr� r1 r' r' r( �is_existing_dir� s zLink.is_existing_dirc C s | j tkS r" )r� r r1 r' r' r( �is_wheel� s z Link.is_wheelc C s ddl m} | j|jv S )Nr )�vcs)Zpip._internal.vcsr� r� Z all_schemes)r2 r� r' r' r( �is_vcs� s z Link.is_vcsc C s | j d uS r" )ru r1 r' r' r( � is_yanked� s zLink.is_yankedc C s t | j�S r" )rQ rr r1 r' r' r( �has_hash� s z Link.has_hashr? c s( � du r dS t � fdd�| j�� D ��S )zS Return True if the link has a hash and it is allowed by `hashes`. NFc 3 s | ]\}}� � ||�V qd S r" )rB r� r� r' r( r) � r* z'Link.is_hash_allowed.<locals>.<genexpr>)�anyrr r� rC r' r� r( rB � s zLink.is_hash_allowed)NNNNTN)3rD rE rF rG � __slots__rH r r rQ r r~ rN r r r� r� r� r� �propertyr7 r� r� r� rj r] r r r� r� r# rJ r� � IGNORECASEr� r r� r� r� r r> r� r& r� r� r� r� r� r� r� rB � __classcell__r' r' r� r( ro � s� ��> �"� � ro c @ sJ e Zd ZU dZejjed< ee e e f ed< e ed< ee e f ed< dS )� _CleanResulta� Convert link for equivalency check. This is used in the resolver to check whether two URL-specified requirements likely point to the same distribution and can be considered equivalent. This equivalency logic avoids comparing URLs literally, which can be too strict (e.g. "a=1&b=2" vs "b=2&a=1") and produce conflicts unexpecting to users. Currently this does three things: 1. Drop the basic auth part. This is technically wrong since a server can serve different content based on auth, but if it does that, it is even impossible to guarantee two URLs without auth are equivalent, since the user can input different auth information when prompted. So the practical solution is to assume the auth doesn't affect the response. 2. Parse the query to avoid the ordering issue. Note that ordering under the same key in the query are NOT cleaned; i.e. "a=1&a=2" and "a=2&a=1" are still considered different. 3. Explicitly drop most of the fragment part, except ``subdirectory=`` and hash values, since it should have no impact the downloaded content. Note that this drops the "egg=" part historically used to denote the requested project (and extras), which is wrong in the strictest sense, but too many people are supplying it inconsistently to cause superfluous resolution conflicts, so we choose to also ignore them. �parsedr� � subdirectoryr@ N) rD rE rF rG rS rT � SplitResultrI r rH r r' r' r' r( r� � s r� )�linkr- c s� | j }|j�dd�d }|jdkr*|s*d}tj�|j�� d� v rLt� d| � z� d d }W n t t fyv d }Y n0 � fd d �t D �}t |j|d d d �tj�|j�||d�S )N�@r� ���r� � localhost�eggz Ignoring egg= fragment in %sr� r r_ c s" i | ]}|� v r|� | d �qS )r r' )r% r� �r� r' r( r� r* z _clean_link.<locals>.<dictcomp>)rj r� r� )r� r� r� r@ )rp rj �rsplitr� rS rT �parse_qsr� �logger�debug� IndexError�KeyErrorrM r� rl r� )r� r� rj r� r@ r' r� r( � _clean_link� s$ �r� r4 )�link1�link2r- c C s t | �t |�kS r" )r� )r� r� r' r' r( �links_equivalent s r� )9rO rb �loggingr� r� r# � urllib.parserS � dataclassesr �typingr r r r r r r r r � pip._internal.utils.deprecationr Z pip._internal.utils.filetypesr �pip._internal.utils.hashesr �pip._internal.utils.miscr r r r Zpip._internal.utils.modelsr �pip._internal.utils.urlsr r Z pip._internal.index.collectorr � getLoggerrD r� rM r rH rX r\ rJ r� r` rQ rh rn ro r� r� rP r� r' r' r' r( �<module> s@ , 5 2