OwlCyberSecurity - MANAGER
Edit File: _tokenizer.cpython-39.pyc
a �F�f� � @ s� U d dl mZ d dlZd dlZd dlmZ d dlmZmZ ddl m Z eG dd� d��Z G d d � d e �Z d d d ddde�dej�dddde�dej�e�e je j ejejB �dddddd d d �Zd ed < G d!d"� d"�ZdS )#� )� annotationsN)� dataclass)�Iterator�NoReturn� )� Specifierc @ s& e Zd ZU ded< ded< ded< dS )�Token�str�name�text�int�positionN)�__name__� __module__� __qualname__�__annotations__� r r �b/home/gouroczh/virtualenv/test/3.9/lib/python3.9/site-packages/pip/_vendor/packaging/_tokenizer.pyr s r c s: e Zd ZdZddddd�� fdd� Zdd�d d �Z� ZS ) �ParserSyntaxErrorz7The provided source text could not be parsed correctly.r ztuple[int, int]�None)�message�source�span�returnc s || _ || _|| _t� �� d S )N)r r r �super�__init__)�selfr r r �� __class__r r r s zParserSyntaxError.__init__�r c C s> d| j d d| j d | j d d }d�| j| j|g�S )N� r �~r �^z )r �joinr r )r �markerr r r �__str__" s *zParserSyntaxError.__str__)r r r �__doc__r r% � __classcell__r r r r r s r z\(z\)z\[z\]�;�,zk ( ('[^']*') | ("[^"]*") ) z(===|==|~=|!=|<=|>=|<|>)z \b(or|and)\bz\bin\bz\bnot\ba� \b( python_version |python_full_version |os[._]name |sys[._]platform |platform_(release|system) |platform[._](version|machine|python_implementation) |python_implementation |implementation_(name|version) |extra )\b z\@z[^ \t]+z \b[a-zA-Z0-9][a-zA-Z0-9._-]*\bz\.\*z \+[a-z0-9]+(?:[-_\.][a-z0-9]+)*z[ \t]+�$)�LEFT_PARENTHESIS�RIGHT_PARENTHESIS� LEFT_BRACKET� RIGHT_BRACKET� SEMICOLON�COMMA� QUOTED_STRING�OP�BOOLOP�IN�NOT�VARIABLE� SPECIFIER�AT�URL� IDENTIFIER�VERSION_PREFIX_TRAIL�VERSION_LOCAL_LABEL_TRAIL�WS�END� dict[str, str | re.Pattern[str]]� DEFAULT_RULESc @ s� e Zd ZdZdddd�dd�Zddd�d d �Zd d �dd d d�dd�Zdddd�dd�Zdd�dd�Zddd�ddddd �d d �Z e j dddd d �d!d"��Z dS )#� Tokenizerz�Context-sensitive token parsing. Provides methods to examine the input stream to check whether the next token matches. r r? r )r �rulesr c C s* || _ dd� |�� D �| _d | _d| _d S )Nc S s i | ]\}}|t �|��qS r )�re�compile)�.0r �patternr r r � <dictcomp>h s z&Tokenizer.__init__.<locals>.<dictcomp>r )r �itemsrB � next_tokenr )r r rB r r r r a s �zTokenizer.__init__)r r c C s | � |�r| �� dS )z8Move beyond provided token name, if at current position.N)�check�read)r r r r r �consumen s zTokenizer.consumeF)�peek�bool)r rM r c C sz | j du s J d|�d| j ����|| jv s8J d|����| j| }|�| j| j�}|du r^dS |svt||d | j�| _ dS )z�Check whether the next token has the provided name. By default, if the check succeeds, the token *must* be read before another check. If `peek` is set to `True`, the token is not loaded and would need to be checked again. NzCannot check for z, already have zUnknown token name: Fr T)rI rB �matchr r r )r r rM � expressionrO r r r rJ s s �� zTokenizer.checkr )r �expectedr c C s" | � |�s| �d|� ���| �� S )zsExpect a certain token name next, failing with a syntax error otherwise. The token is *not* read. z Expected )rJ �raise_syntax_errorrK )r r rQ r r r �expect� s zTokenizer.expectr c C s0 | j }|dusJ �| jt|j�7 _d| _ |S )z%Consume the next token and return it.N)rI r �lenr )r �tokenr r r rK � s zTokenizer.readN)� span_start�span_endz int | Noner )r rV rW r c C s8 |du r| j n||du r | j n|f}t|| j|d��dS )z.Raise ParserSyntaxError at the given position.N)r r )r r r )r r rV rW r r r r rR � s ��z Tokenizer.raise_syntax_errorzIterator[None])� open_token� close_token�aroundr c c sf | � |�r| j}| �� nd }d V |d u r0d S | � |�sZ| jd|� d|� d|� �|d� | �� d S )NzExpected matching z for z, after )rV )rJ r rK rR )r rX rY rZ Z open_positionr r r �enclosing_tokens� s �zTokenizer.enclosing_tokens) r r r r& r rL rJ rS rK rR � contextlib�contextmanagerr[ r r r r rA Z s �rA )� __future__r r\ rC Z dataclassesr �typingr r � specifiersr r � Exceptionr rD �VERBOSEZ_operator_regex_strZ_version_regex_str� IGNORECASEr@ r rA r r r r �<module> sN � � ��3