OwlCyberSecurity - MANAGER
Edit File: universaldetector.cpython-34.pyc
� �Re� � @ s� d d l m Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z d d l m Z d d l Z d Z d Z d Z d Z Gd d � d � Z d S) � )� constants� N)� Latin1Prober)�MBCSGroupProber)�SBCSGroupProber)�EscCharSetProberg�������?� c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S) �UniversalDetectorc C sD t j d � | _ t j d � | _ d | _ g | _ | j � d S)Ns [�-�]s (|~{))�re�compile�_highBitDetector� _escDetector�_mEscCharSetProber�_mCharSetProbers�reset)�self� r �R/tmp/pip-ztkk0jow-build/pip/_vendor/requests/packages/chardet/universaldetector.py�__init__- s zUniversalDetector.__init__c C s i d d 6d d 6| _ d | _ d | _ d | _ t | _ d | _ | j r] | j j � n x | j D] } | j � qg Wd S)N�encodingg � confidenceFT� ) �result�doneZ_mStart� _mGotData� ePureAscii� _mInputState� _mLastCharr r r )r �proberr r r r 4 s zUniversalDetector.resetc C sN | j r d St | � } | s# d S| j s�| d d � t j k r_ i d d 6d d 6| _ q�| d d � t j k r� i d d 6d d 6| _ q�| d d � t j k r� i d d 6d d 6| _ q�| d d � d k r� i d d 6d d 6| _ q�| d d � d k r%i d d 6d d 6| _ q�| d d � t j k rXi d d 6d d 6| _ q�| d d � t j k r�i d d 6d d 6| _ q�n d | _ | j d r�| j d d k r�d | _ d S| j t k r(| j j | � r�t | _ q(| j t k r(| j j | j | � r(t | _ q(n | d d � | _ | j t k r�| j sbt � | _ n | j j | � t j k rJi | j j � d 6| j j � d 6| _ d | _ qJn� | j t k rJ| j s�t � t � t � g | _ n x\ | j D]N } | j | � t j k r�i | j � d 6| j � d 6| _ d | _ Pq�q�Wn d S)N� zUTF-8r g �?r � zUTF-32LEzUTF-32BEs �� zX-ISO-10646-UCS-4-3412s ��zX-ISO-10646-UCS-4-2143r zUTF-16LEzUTF-16BETg r ���) r �lenr �codecs�BOMr � BOM_UTF32_LE� BOM_UTF32_BE�BOM_LE�BOM_BEr r r �search� eHighbyter r � eEscAsciir r �feedr ZeFoundIt�get_charset_name�get_confidencer r r r )r �aBufZaLenr r r r r, @ sh zUniversalDetector.feedc C s� | j r d S| j s6 t j r2 t j j d � n d Sd | _ | j t k rl i d d 6d d 6| _ | j S| j t k rd } d } d } xD | j D]9 } | s� q� n | j � } | | k r� | } | } q� q� W| r| t k ri | j � d 6| j � d 6| _ | j Sn t j r|t j j d � xM | j d j D]8 } | sOq=n t j j d | j � | j � f � q=Wn d S) Nzno data received! T�asciir g �?r g z"no probers hit minimum threshhold r z%s confidence = %s )r r r �_debug�sys�stderr�writer r r r* r r. �MINIMUM_THRESHOLDr- ZmProbers)r ZproberConfidenceZmaxProberConfidenceZ maxProberr r r r �close� sB zUniversalDetector.closeN)�__name__� __module__� __qualname__r r r, r6 r r r r r , s Fr )� r r2 r# Z latin1proberr Zmbcsgroupproberr Zsbcsgroupproberr Z escproberr r r5 r r+ r* r r r r r �<module> s