Skip to content

Instantly share code, notes, and snippets.

@matter123
Created April 15, 2019 18:17
Show Gist options
  • Save matter123/63ad7294e30926ad254ccfe84bc932e4 to your computer and use it in GitHub Desktop.
Save matter123/63ad7294e30926ad254ccfe84bc932e4 to your computer and use it in GitHub Desktop.
===========================================
TOKENIZING LINE 8: | int a = 10;|
scanning for while rule
- -2: (^|\￿)(?!\s*([`~]{3,})\s*$)
@@scanNext 0: | int a = 10;\n|
matched: 4 / 7
token: | |
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
matched MatchRule#648 @ cpp.tmLanguage.json:1 - (?<!\w)(?:auto|void|char|short|int|signed|unsigned|long|float|double|bool|wchar_t)(?!\w)
token: |int|
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
* storage.type.primitive.cpp
@@scanNext 7: | a = 10;\n|
matched: 10 / 11
token: | a |
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
matched MatchRule#920 @ cpp.tmLanguage.json:1 - =
token: |=|
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
* keyword.operator.assignment.cpp
@@scanNext 11: | 10;\n|
matched: 12 / 14
token: | |
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
matched MatchRule#1235 @ cpp.tmLanguage.json:1 - \b\d+\b
token: |10|
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
* constant.numeric.cpp
@@scanNext 14: |;\n|
matched: 14 / 15
matched MatchRule#1317 @ cpp.tmLanguage.json:1 - ;
token: |;|
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
* punctuation.terminator.statement.cpp
@@scanNext 15: |\n|
no more matches.
token: |\n|
* text.html.markdown
* markup.fenced_code.block.markdown
* meta.embedded.block.cpp
* meta.block.class.cpp
* meta.body.class.cpp
@@LINE END RULE STACK CONTAINS 1 RULES:
* no rule description found for rule id: undefined
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment