public class PowerQueryLexer extends TCustomLexer
Unlike every other TLexer<Vendor> in this repository this
class is NOT generated from a .l file and does NOT consume a
*_lex_table.txt DFA table. It exists only to satisfy the
TCustomLexer API contract; the actual M-language tokenization
runs in
PowerQueryTokenizer.
Naming: this file deliberately avoids the TLexer prefix so
the project's generated-file hook leaves it alone — see
.claude/hooks/protect-generated-files.sh. When (if) the full
YACC grammar is ever regenerated, the generated
TLexerPowerQuery.java can coexist and PowerQuerySqlParser
would flip over.
| Modifier and Type | Field and Description |
|---|---|
TSourceTokenList |
sourcetokens |
bconst, COLUMN0_COUNT, COLUMN1_FIRST_X, COLUMN2_FIRST_Y, COLUMN3_LAST_X, COLUMN4_LAST_Y, COLUMN5_FIRST_POS, COLUMN6_LAST_POS, defaultDelimiterStr, delimiterchar, dolqstart, insideSingleQuoteStr, insqlpluscmd, keyword_type_column, keyword_type_identifier, keyword_type_keyword, keyword_type_reserved, MAX_TOKEN_COLUMN_SIZE, MAX_TOKEN_SIZE, stringLiteralStartWithUnicodeSingleQuote, tmpDelimiter, TOKEN_TABLE, UNICODE_ENCODE_ID, xconst, yyinput| Constructor and Description |
|---|
PowerQueryLexer() |
| Modifier and Type | Method and Description |
|---|---|
boolean |
canBeColumnName(int tokencode) |
int |
getkeywordvalue(String keyword) |
int |
iskeyword(String str) |
getKeywordType, getSqlCharset, getStringByCode, isAtBeginOfLine, isKeyword, isSingleCharOperator, reset, resetTokenTable, setSqlCharset, setTokenTableValue, yylexwrappublic TSourceTokenList sourcetokens
public PowerQueryLexer()
public boolean canBeColumnName(int tokencode)
public int iskeyword(String str)
iskeyword in class TCustomLexerpublic int getkeywordvalue(String keyword)
getkeywordvalue in class TCustomLexer