procrastonos/tokenize.cpp

Created January 23, 2014 10:04

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/procrastonos/8575999.js"></script>
Save procrastonos/8575999 to your computer and use it in GitHub Desktop.

Download ZIP

Tokenize a string with STL functions and save tokens to a vector.

Raw

tokenize.cpp

	string line = "Some text";

	istringstream iss(line);
	vector<string> tokens{istream_iterator<string>{iss}, istream_iterator<string>{}};

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment