B bv @sdZddlZddlZddlmZddlmZmZmZm Z ddl m Z dddgZ Gd ddeZ Gd ddeZiZed ZGd ddeZdS) z pygments.lexers.special ~~~~~~~~~~~~~~~~~~~~~~~ Special lexers. :copyright: Copyright 2006-2022 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. N)Lexer)TokenErrorTextGeneric)get_choice_opt TextLexer OutputLexer RawTokenLexerc@s:eZdZdZdZdgZdgZdgZdZddZ d d Z d S) rz3 "Null" lexer, doesn't highlight anything. z Text onlytextz*.txtz text/plaing{Gz?ccsdt|fVdS)Nr)r)selfr r 6lib/python3.7/site-packages/pygments/lexers/special.pyget_tokens_unprocessed sz TextLexer.get_tokens_unprocessedcCstjS)N)rpriority)r r r r analyse_text#szTextLexer.analyse_textN) __name__ __module__ __qualname____doc__namealiases filenames mimetypesrrrr r r rrsc@s"eZdZdZdZdgZddZdS)r zj Simple lexer that highlights everything as ``Token.Generic.Output``. .. versionadded:: 2.10 z Text outputoutputccsdtj|fVdS)Nr)rZOutput)r r r r rr0sz"OutputLexer.get_tokens_unprocessedN)rrrrrrrr r r rr 'sz.*? c@s:eZdZdZdZgZgZdgZddZddZ dd Z d S) r a Recreate a token stream formatted with the `RawTokenFormatter`. Additional options accepted: `compress` If set to ``"gz"`` or ``"bz2"``, decompress the token stream with the given compression algorithm before lexing (default: ``""``). zRaw token datazapplication/x-pygments-tokenscKs*t|dddddgd|_tj|f|dS)NcompressZnonegzbz2)rrr__init__)r optionsr r rrHszRawTokenLexer.__init__ccs|jr~t|tr|d}y>|jdkr:ddl}||}n|jdkrVddl}||}Wn$tk r|t| dfVYnXt|t r| d}| dd}x"| |D]\}}}||fVqWdS)Nlatin1rrr ) r isinstancestrencodegzipZ decompressrOSErrorrdecodebytesstripr)r r r&ritvr r r get_tokensMs"       zRawTokenLexer.get_tokensc csd}xt|D]}y|dd\}}t|}|st}|ddd}x.|D]&}|rl|dstt dt ||}qXW|t|<t |}t |tst dWn$tt fk r|}t}YnX|||fV|t|7}qWdS)Nr .zmalformed token namez expected str)line_refinditergrouprstripsplit _ttype_cachegetrisupper ValueErrorgetattrastZ literal_evalr#r$ SyntaxErrorrlen) r r lengthmatchZttypestrvalZttypeZttypesZttype_r r rrbs*       z$RawTokenLexer.get_tokens_unprocessedN) rrrrrrrrrr.rr r r rr 9s )rr<reZpygments.lexerrZpygments.tokenrrrrZ pygments.utilr__all__rr r7compiler2r r r r r s