Skip to content

Instantly share code, notes, and snippets.

@marcelogdeandrade
Created June 21, 2018 02:00
Show Gist options
  • Save marcelogdeandrade/0eb851ed52cc1a49df65e4ce2404d3b4 to your computer and use it in GitHub Desktop.
Save marcelogdeandrade/0eb851ed52cc1a49df65e4ce2404d3b4 to your computer and use it in GitHub Desktop.
from lexer import Lexer
text_input = """
print(4 + 4 - 2);
"""
lexer = Lexer().get_lexer()
tokens = lexer.lex(text_input)
for token in tokens:
print(token)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment