Skip to content

Instantly share code, notes, and snippets.

View geofmureithi's full-sized avatar

Njuguna Mureithi geofmureithi

View GitHub Profile
@geofmureithi
geofmureithi / lexer.rs
Created December 6, 2023 09:46 — forked from jdmichaud/lexer.rs
A simple tokenizer in rust
// rustc lexer.rs && curl -s https://norvig.com/big.txt | ./lexer
use std::io::{Read, Result, stdin};
#[derive(Debug)]
struct Token<'a> {
s: &'a str,
start_index: usize,
}