Skip to content

Instantly share code, notes, and snippets.

@ZeroX-DG
Created October 25, 2020 05:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ZeroX-DG/7aa0fa75234a9a59d33d5298ccad615f to your computer and use it in GitHub Desktop.
Save ZeroX-DG/7aa0fa75234a9a59d33d5298ccad615f to your computer and use it in GitHub Desktop.
HTML tokenize states
#[derive(Clone, Debug)]
pub enum State {
Data,
CharacterReference,
TagOpen,
RCDATA,
RCDATALessThanSign,
RAWTEXT,
RAWTEXTLessThanSign,
ScriptData,
ScriptDataLessThanSign,
PLAINTEXT,
EndTagOpen,
TagName,
BogusComment,
BeforeAttributeName,
RCDATAEndTagOpen,
RCDATAEndTagName,
SelfClosingStartTag,
RAWTEXTEndTagOpen,
RAWTEXTEndTagName,
ScriptDataEndTagOpen,
ScriptDataEndTagName,
ScriptDataEscapeStart,
ScriptDataEscapeStartDash,
ScriptDataEscaped,
ScriptDataEscapedDash,
ScriptDataEscapedDashDash,
ScriptDataEscapedLessThanSign,
ScriptDataEscapedEndTagOpen,
ScriptDataEscapedEndTagName,
ScriptDataDoubleEscapeStart,
ScriptDataDoubleEscaped,
ScriptDataDoubleEscapedDash,
ScriptDataDoubleEscapedDashDash,
ScriptDataDoubleEscapedLessThanSign,
ScriptDataDoubleEscapeEnd,
AttributeName,
AfterAttributeName,
BeforeAttributeValue,
AttributeValueDoubleQuoted,
AttributeValueSingleQuoted,
AttributeValueUnQuoted,
AfterAttributeValueQuoted,
MarkupDeclarationOpen,
CommentStart,
CommentStartDash,
Comment,
CommentLessThanSign,
CommentLessThanSignBang,
CommentLessThanSignBangDash,
CommentLessThanSignBangDashDash,
CommentEndDash,
CommentEnd,
CommentEndBang,
DOCTYPE,
BeforeDOCTYPEName,
DOCTYPEName,
AfterDOCTYPEName,
AfterDOCTYPEPublicKeyword,
BeforeDOCTYPEPublicIdentifier,
DOCTYPEPublicIdentifierDoubleQuoted,
DOCTYPEPublicIdentifierSingleQuoted,
AfterDOCTYPEPublicIdentifier,
BetweenDOCTYPEPublicAndSystemIdentifiers,
AfterDOCTYPESystemKeyword,
BeforeDOCTYPESystemIdentifier,
DOCTYPESytemIdentifierSingleQuoted,
DOCTYPESytemIdentifierDoubleQuoted,
AfterDOCTYPESystemIdentifier,
BogusDOCTYPE,
CDATASection,
CDATASectionBracket,
CDATASectionEnd,
NamedCharacterReference,
AmbiguousAmpersand,
NumericCharacterReference,
HexadecimalCharacterReferenceStart,
DecimalCharacterReferenceStart,
HexadecimalCharacterReference,
DecimalCharacterReference,
NumericCharacterReferenceEnd,
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment