XylotrechusZ
3
�Pf�
� @ sH d dl mZ d dlmZmZ d dlmZ d dlmZ G dd� de�Z dS )� )�
CharSetProber)� ProbingState� MachineState)�CodingStateMachine)�
UTF8_SM_MODELc sT e Zd ZdZ� fdd�Z� fdd�Zedd� �Zedd � �Zd
d � Z d d
� Z
� Z S )�
UTF8Proberg �?c s* t t| �j� tt�| _d | _| j� d S )N)�superr �__init__r r � coding_sm�
_num_mb_chars�reset)�self)� __class__� � /usr/lib/python3.6/utf8prober.pyr & s
zUTF8Prober.__init__c s" t t| �j� | jj� d| _d S )N� )r r r r
r )r
)r r r r , s
zUTF8Prober.resetc C s dS )Nzutf-8r )r
r r r � charset_name1 s zUTF8Prober.charset_namec C s dS )N� r )r
r r r �language5 s zUTF8Prober.languagec C s� xj|D ]b}| j j|�}|tjkr,tj| _P q|tjkrBtj| _P q|tj kr| j j
� dkr| j d7 _ qW | j tj
kr�| j� | jkr�tj| _| j S )N� r )r
Z
next_stater ZERRORr ZNOT_MEZ_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenr �stateZ DETECTING�get_confidenceZSHORTCUT_THRESHOLD)r
Zbyte_str�cZ coding_stater r r �feed9 s
zUTF8Prober.feedc C s. d}| j dk r&|| j| j 9 }d| S |S d S )Ng�G�z��?� g �?)r �
ONE_CHAR_PROB)r
Zunliker r r r L s
zUTF8Prober.get_confidence) �__name__�
__module__� __qualname__r r r �propertyr r r r �
__classcell__r r )r r r # s r N)
Z
charsetproberr Zenumsr r Zcodingstatemachiner Zmbcssmr r r r r r �<module> s