a j@sdZddlZddlmZmZddlmZmZmZm Z ddl m Z gdZ GdddeZ Gd d d eZiZGd d d eZdS) z pygments.lexers.special ~~~~~~~~~~~~~~~~~~~~~~~ Special lexers. :copyright: Copyright 2006-present by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. N)Lexerline_re)TokenErrorTextGeneric)get_choice_opt) TextLexer OutputLexer RawTokenLexerc@sBeZdZdZdZdgZdgZdgZdZdZ dZ dd Z d d Z d S) r z3 "Null" lexer, doesn't highlight anything. z Text onlytextz*.txtz text/plaing{Gz?ccsdt|fVdSNr)rselfr r=E:\soccer\ml_env\Lib\site-packages\pygments/lexers/special.pyget_tokens_unprocessed"sz TextLexer.get_tokens_unprocessedcCstjS)N)r priority)r rrr analyse_text%szTextLexer.analyse_textN) __name__ __module__ __qualname____doc__namealiases filenames mimetypesurl version_addedrrrrrrrr sr c@s.eZdZdZdZdgZdZdZdZddZ d S) r zN Simple lexer that highlights everything as ``Token.Generic.Output``. z Text outputoutputr z2.10z output/outputccsdtj|fVdSr)rOutputrrrrr3sz"OutputLexer.get_tokens_unprocessedN) rrrrrrrr_examplerrrrrr )sr c@sBeZdZdZdZgZgZdgZdZdZ ddZ dd Z d d Z d S) r a Recreate a token stream formatted with the `RawTokenFormatter`. Additional options accepted: `compress` If set to ``"gz"`` or ``"bz2"``, decompress the token stream with the given compression algorithm before lexing (default: ``""``). zRaw token datazapplication/x-pygments-tokensz7https://pygments.org/docs/formatters/#RawTokenFormatterr cKs*t|dgdd|_tj|fi|dS)Ncompress)r nonegzbz2r )rr#r__init__)roptionsrrrr'KszRawTokenLexer.__init__ccs|jr|t|tr|d}z>|jdkr:ddl}||}n|jdkrVddl}||}Wn"tyzt| dfVYn0t|t r| d}| dd}| |D]\}}}||fVqdS)Nlatin1r%rr& ) r# isinstancestrencodegzip decompressr&OSErrorrdecodebytesstripr)rr r.r&itvrrr get_tokensPs"        zRawTokenLexer.get_tokensc csd}t|D]}z|dd\}}t|}|st}|ddd}|D]&}|rh|dspt dt ||}qT|t|<t |}t |tst dWn"tt fy|}t}Yn0|||fV|t|7}qdS)Nr .zmalformed token namez expected str)rfinditergrouprstripsplit _ttype_cachegetrisupper ValueErrorgetattrast literal_evalr+r, SyntaxErrorrlen) rr lengthmatchZttypestrvalttypeZttypesZttype_rrrres*       z$RawTokenLexer.get_tokens_unprocessedN) rrrrrrrrrrr'r7rrrrrr :s r )rrDZpygments.lexerrrZpygments.tokenrrrrZ pygments.utilr__all__r r r?r rrrrs