Skip to content

Instantly share code, notes, and snippets.

@copenhas
Created December 31, 2010 02:01
Show Gist options
  • Select an option

  • Save copenhas/760619 to your computer and use it in GitHub Desktop.

Select an option

Save copenhas/760619 to your computer and use it in GitHub Desktop.
[0-9]+ :
{token, {number, TokenLine, list_to_integer(TokenChars)}}.
[0-9]+\.[0-9]+ :
{token, {number, TokenLine, list_to_float(TokenChars)}}.
\+ : {token, {'+', TokenLine}}.
\- : {token, {'-', TokenLine}}.
/ : {token, {'/', TokenLine}}.
\* : {token, {'*', TokenLine}}.
\( : {token, {'(', TokenLine}}.
\) : {token, {')', TokenLine}}.
[\000-\s] : skip_token.
[\n] : {end_token, {'$end', TokenLine}}.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment