OwlCyberSecurity - MANAGER
Edit File: req_file.cpython-39.pyc
a �F�fE � @ s< U d Z ddlZddlZddlZddlZddlZddlZddlmZ ddl m Z m Z m Z m Z mZmZmZmZmZmZ ddlmZ ddlmZmZ ddlmZ ddlm Z e r�dd l m Z dd l m Z d gZ!eee"e#f Z$e e#gee#ef f Z%e�&d ej'�Z(e�&d �Z)e�&d�Z*ej+ej,ej-ej.ej/ej0ej1ej2ej3ej4ej5ej6ej7ej8gZ9ee dej:f e;d< ej<ej=ej>gZ?ee dej:f e;d< ej>gZ@ee dej:f e;d< dd� e?D �ZAdd� e@D �ZBe�CeD�ZEG dd� d�ZFG dd� d�ZGdBe#ded eej eHeeFddf d �d d �ZIe#e$d �d d!�ZJdCeGeej eFd"�d#d$�ZKdDee#e"ed eej ed dd%�d&d'�ZLdEeGeej ed ed eeF d(�d)d*�ZMG d+d,� d,�ZNed e%d-�d.d/�ZOe#ee#e#f d0�d1d2�ZPG d3d4� d4eQ�ZRejSd5�d6d7�ZTe$e$d8�d9d:�ZUe$e$d8�d;d<�ZVe$e$d8�d=d>�ZWe#dee#e#f d?�d@dA�ZXdS )Fz Requirements file parsing � N)�Values) � TYPE_CHECKING�Any�Callable�Dict� Generator�Iterable�List�NoReturn�Optional�Tuple)� cmdoptions)�InstallationError�RequirementsFileParseError)� SearchScope)� auto_decode)� PackageFinder)� PipSession�parse_requirementsz^(http|https|file):z (^|\s+)#.*$z#(?P<var>\$\{(?P<name>[A-Z0-9_]+)\}).�SUPPORTED_OPTIONS�SUPPORTED_OPTIONS_REQ� SUPPORTED_OPTIONS_EDITABLE_REQc C s g | ]}t |� j��qS � ��str�dest��.0�or r �\/home/gouroczh/virtualenv/test/3.9/lib/python3.9/site-packages/pip/_internal/req/req_file.py� <listcomp>O � r c C s g | ]}t |� j��qS r r r r r r r P s c @ s8 e Zd Zdeeeeeeeef ee dd�dd�ZdS )�ParsedRequirementN)� requirement� is_editable� comes_from� constraint�options� line_source�returnc C s( || _ || _|| _|| _|| _|| _d S �N)r# r$ r% r' r& r( )�selfr# r$ r% r& r' r( r r r �__init__X s zParsedRequirement.__init__)NN) �__name__� __module__� __qualname__r �boolr r r r, r r r r r" W s ��r" c @ s$ e Zd Zeeeeedd�dd�ZdS )� ParsedLineN)�filename�lineno�args�optsr& r) c C sZ || _ || _|| _|| _|r0d| _d| _|| _n&|jrPd| _d| _|jd | _nd| _d S )NTFr )r2 r3 r5 r& �is_requirementr$ r# � editables)r+ r2 r3 r4 r5 r& r r r r, j s zParsedLine.__init__)r- r. r/ r �intr r0 r, r r r r r1 i s �r1 Fr r )r2 �session�finderr' r& r) c c sF t |�}t||�}|�| |�D ]"}t||||d�}|dur |V q dS )aq Parse a requirements file and yield ParsedRequirement instances. :param filename: Path or url of requirements file. :param session: PipSession instance. :param finder: Instance of pip.index.PackageFinder. :param options: cli options. :param constraint: If true, parsing a constraint file rather than requirements file. )r' r: r9 N)�get_line_parser�RequirementsFileParser�parse� handle_line) r2 r9 r: r' r& � line_parser�parserZ parsed_line� parsed_reqr r r r � s �)�contentr) c C s, t | �� dd�}t|�}t|�}t|�}|S )zxSplit, filter, and join lines, and return a line iterator :param content: the content of the requirements file � )�start)� enumerate� splitlines� join_lines�ignore_comments�expand_env_variables)rB � lines_enumr r r � preprocess� s rK )�liner' r) c C s� d� | jrdnd| j| j�}| js&J �| jr2t}nt}i }|D ],}|| jj v r>| jj | r>| jj | ||< q>d| j� d| j� �}t | j | j|| j||d�S )Nz{} {} (line {})z-cz-r�line � of )r# r$ r% r& r' r( ) �formatr& r2 r3 r6 r$ �#SUPPORTED_OPTIONS_EDITABLE_REQ_DEST�SUPPORTED_OPTIONS_REQ_DESTr5 �__dict__r" r# )rL r' Zline_comes_fromZsupported_destZ req_optionsr r( r r r �handle_requirement_line� s, � �rS )r5 r2 r3 r: r' r9 r) c sf | j rt�d||� � rH| jr&| j� _| jrH� j�� fdd�| jD �� |�rb|j}|j}|jj }| j du rtd}g }| j r�|s�| j g}| j r�|s�|�| j � | jr�| jd } t j �t j �|��} t j �| | �} t j �| �r�| } |�| � |r�|�|� t|||d�} | |_| j�r|�� | j�r*|�� |�rb| j�p:g D ]$} d|� d|� �}|j| |d � �q<d S ) Nz>%s line %s has --hash but no requirement, and will be ignored.c 3 s | ]}|� j vr|V qd S r* )�features_enabled)r �f�r' r r � <genexpr>� s z%handle_option_line.<locals>.<genexpr>Tr )� find_links� index_urls�no_indexrM rN )�source)�hashes�logger�warning�require_hashesrT �extendrX rY � search_scoperZ � index_url�extra_index_urls�os�path�dirname�abspath�join�exists�append�update_index_urlsr �pre�set_allow_all_prereleases� prefer_binary�set_prefer_binary� trusted_hosts�add_trusted_host)r5 r2 r3 r: r' r9 rX rY rZ �valueZreq_dirZrelative_to_reqs_filera �hostr[ r rV r �handle_option_line� s^ �� �rt )rL r' r: r9 r) c C s4 | j rt| |�}|S t| j| j| j|||� dS dS )a Handle a single parsed requirements line; This can result in creating/yielding requirements, or updating the finder. :param line: The parsed line to be processed. :param options: CLI options. :param finder: The finder - updated by non-requirement lines. :param session: The session - updated by non-requirement lines. Returns a ParsedRequirement object if the line is a requirement line, otherwise returns None. For lines that contain requirements, the only options that have an effect are from SUPPORTED_OPTIONS_REQ, and they are scoped to the requirement. Other options from SUPPORTED_OPTIONS may be present, but are ignored. For lines that do not contain requirements, the only options that have an effect are from SUPPORTED_OPTIONS. Options from SUPPORTED_OPTIONS_REQ may be present, but are ignored. These lines may contain multiple options (although our docs imply only one is supported), and all our parsed and affect the finder. N)r6 rS rt r5 r2 r3 )rL r' r: r9 rA r r r r> s �r> c @ sr e Zd Zdedd�dd�Zeeeeddf d�dd�Z eeeeddf d�d d �Z eeeeddf d�d d �Z dS ) r< r N)r9 r? r) c C s || _ || _d S r* )�_session� _line_parser)r+ r9 r? r r r r, @ s z RequirementsFileParser.__init__)r2 r& r) c c s | � ||�E dH dS )z*Parse a given file, yielding parsed lines.N)�_parse_and_recurse)r+ r2 r& r r r r= H s z RequirementsFileParser.parsec c s� | � ||�D ]�}|js�|jjs&|jjr�|jjr@|jjd }d}n|jjd }d}t�|�rjtj� ||�}n t�|�s�t j � t j � |�|�}| �||�E d H q |V q d S )Nr FT)� _parse_filer6 r5 � requirements� constraints� SCHEME_RE�search�urllibr= �urljoinrd re rh rf rw )r+ r2 r& rL �req_pathZnested_constraintr r r rw N s( �� �z)RequirementsFileParser._parse_and_recursec c s� t || j�\}}t|�}|D ]l\}}z| �|�\}} W n> tyt } z&d|� d| j� �} t| ��W Y d } ~ n d } ~ 0 0 t|||| |�V q d S )NzInvalid requirement: � )�get_file_contentru rK rv �OptionParsingError�msgr r1 ) r+ r2 r& �_rB rJ � line_numberrL �args_strr5 �er� r r r rx m s �z"RequirementsFileParser._parse_file) r- r. r/ � LineParserr, r r0 r r1 r= rw rx r r r r r< ? s � � � �r< )r: r) c s t tt tf d�� fdd� }|S )N�rL r) c s� t � }|�� }d |_� r � j|_t| �\}}zt�|�}W n4 tyn } z td|� ��|�W Y d }~n d }~0 0 |� ||�\}}||fS )NzCould not split options: ) � build_parser�get_default_valuesrb �format_control�break_args_options�shlex�split� ValueErrorr� � parse_args) rL r@ �defaultsr� Z options_strr' r� r5 r� �r: r r � parse_line� s &z#get_line_parser.<locals>.parse_line)r r r )r: r� r r� r r; � s r; r� c C sf | � d�}g }|dd� }|D ]2}|�d�s6|�d�r< qRq |�|� |�d� q d�|�d�|�fS )z�Break up the line into an args and options string. We only want to shlex (and then optparse) the options, not the args. args can contain markers which are corrupted by shlex. � N�-z--r )r� � startswithrj �poprh )rL �tokensr4 r' �tokenr r r r� � s r� c @ s e Zd Zedd�dd�ZdS )r� N)r� r) c C s || _ d S r* )r� �r+ r� r r r r, � s zOptionParsingError.__init__)r- r. r/ r r, r r r r r� � s r� )r) c C sJ t jdd�} tt }|D ]}|� }| �|� qttdd�dd�}|| _| S )z7 Return a parser for parsing requirement lines F)�add_help_optionr )r+ r� r) c S s t |��d S r* )r� r� r r r � parser_exit� s z!build_parser.<locals>.parser_exit)�optparse� OptionParserr r � add_optionr r �exit)r@ Zoption_factoriesZoption_factory�optionr� r r r r� � s r� )rJ r) c c s� d}g }| D ]�\}}|� d�r(t�|�rvt�|�r:d| }|rj|�|� |dusTJ �|d�|�fV g }q�||fV q |s~|}|�|�d�� q |r�|dus�J �|d�|�fV dS )z�Joins a line ending in '' with the previous line (except when following comments). The joined line takes on the index of the first line. N�\r� � )�endswith� COMMENT_RE�matchrj rh �strip)rJ Zprimary_line_number�new_liner� rL r r r rG � s$ rG c c s4 | D ]*\}}t �d|�}|�� }|r||fV qdS )z1 Strips comments and filter empty lines. r� N)r� �subr� )rJ r� rL r r r rH � s rH c c sL | D ]B\}}t �|�D ]$\}}t�|�}|s.q|�||�}q||fV qdS )a� Replace all environment variables that can be retrieved via `os.getenv`. The only allowed format for environment variables defined in the requirement file is `${MY_VARIABLE_1}` to ensure two things: 1. Strings that contain a `$` aren't accidentally (partially) expanded. 2. Ensure consistency across platforms for requirement files. These points are the result of a discussion on the `github pull request #3514 <https://github.com/pypa/pip/pull/3514>`_. Valid characters in variable names follow the `POSIX standard <http://pubs.opengroup.org/onlinepubs/9699919799/>`_ and are limited to uppercase letter, digits and the `_` (underscore). N)� ENV_VAR_RE�findallrd �getenv�replace)rJ r� rL �env_var�var_namerr r r r rI � s rI )�urlr9 r) c C s� t j�| �j}|dv r@ddlm} |�| �}||� |j|jfS z:t | d�� }t |� � �}W d � n1 sn0 Y W n2 t y� } zt d|� ���W Y d}~n d}~0 0 | |fS )a Gets the content of a file; it may be a filename, file: URL, or http: URL. Returns (location, content). Content is unicode. Respects # -*- coding: declarations on the retrieved files. :param url: File path or url. :param session: PipSession instance. )�http�https�filer )�raise_for_status�rbNz"Could not open requirements file: )r} r= �urlsplit�scheme�pip._internal.network.utilsr� �getr� �text�openr �read�OSErrorr )r� r9 r� r� �resprU rB �excr r r r� s .$r� )NNF)N)NNN)NNN)Y�__doc__�loggingr� rd �rer� � urllib.parser} r �typingr r r r r r r r r r �pip._internal.clir �pip._internal.exceptionsr r �!pip._internal.models.search_scoper Z pip._internal.utils.encodingr �"pip._internal.index.package_finderr � pip._internal.network.sessionr �__all__r8 r Z ReqFileLinesr� �compile�Ir{ r� r� rb �extra_index_urlrZ rz ry �editablerX � no_binary� only_binaryrn r_ rl � trusted_host�use_new_featurer �Option�__annotations__�global_options�hash�config_settingsr r rQ rP � getLoggerr- r] r" r1 r0 r rK rS rt r> r< r; r� � Exceptionr� r� r� rG rH rI r� r r r r �<module> s� 0 ���� � � �� & �� H �� ,F