Skip to content

Instantly share code, notes, and snippets.

@willmurphyscode

willmurphyscode/nom_tokenizer.rs

Created January 19, 2018 12:34
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save willmurphyscode/8953568b302604d9356666e7fbedb1ce to your computer and use it in GitHub Desktop.
Save willmurphyscode/8953568b302604d9356666e7fbedb1ce to your computer and use it in GitHub Desktop.
Download ZIP
Raw
nom_tokenizer.rs
named!(left_paren<&[u8], Token>,
do_parse!(tag!("(") >> (Token::LeftParen))
);
named!(right_paren<&[u8], Token>,
do_parse!(tag!(")") >> (Token::RightParen))
);
named!(addition_sign<&[u8], Token>,
do_parse!(tag!("+") >> (Token::Operator(Opcode::Add)))
);
named!(subtraction_sign<&[u8], Token>,
do_parse!(tag!("-") >> (Token::Operator(Opcode::Subtract)))
);
// and several more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment