Skip to content

Instantly share code, notes, and snippets.

@cpragadeesh
Last active August 22, 2017 20:09
Show Gist options
  • Save cpragadeesh/fe74fc50f412b020a1569cc1f53f49c3 to your computer and use it in GitHub Desktop.
Save cpragadeesh/fe74fc50f412b020a1569cc1f53f49c3 to your computer and use it in GitHub Desktop.
# current error = 0.5285708144281
# current error = 0.52857081431571
.
.
.
# StochasticGradient: you have reached the maximum number of iterations
# training error = 0.52857081431571
SYMBOL OLD_SCORE NEW_SCORE
R_MIXED_CHARSET 5 4.65
FORGED_MUA_THEBAT_BOUN 2 2.40
FORGED_MUA_THEBAT_MSGID_UNKNOWN 3 2.89
MID_BARE_IP 2 1.74
FROM_EXCESS_BASE64 1.5 1.06
SUBJ_ALL_CAPS 3 2.67
FAKE_REPLY_C 6 5.79
TO_DOM_EQ_FROM_DOM 0 -0.17
R_BAD_CTE_7BIT 4 3.57
SUSPICIOUS_RECIPS 1.5 1.12
FORGED_OUTLOOK_HTML 5 4.87
MV_CASE 0.5 0.40
R_SUSPICIOUS_URL 5 5.13
BROKEN_HEADERS 10 10.41
FAKE_REPLY 1 0.13
SUBJECT_ENDS_EXCLAIM 0 -0.19
RATWARE_MS_HASH 2 2.78
RCPT_COUNT_GT_50 0 0.40
PREVIOUSLY_DELIVERED 0 -0.02
SUBJECT_HAS_EXCLAIM 0 -0.14
FROM_EQ_ENVFROM 0 1.66
INTRODUCTION 2 1.65
REPTO_QUOTE_YAHOO 2 1.55
R_UNDISC_RCPT 3 2.66
MIME_HTML_ONLY 0.2 0.06
FORGED_MUA_MAILLIST 0 0.17
TAGGED_RCPT 0 -0.01
URI_COUNT_ODD 1 1.16
HEADER_FORGED_MDN 2 2.13
MISSING_TO 2 2.09
FROM_EXCESS_QP 1.2 1.47
TO_DN_EQ_ADDR_SOME 0 -0.49
FROM_DN_EQ_ADDR 1 1.26
HAS_XAW 0 0.17
REPLYTO_ADDR_EQ_FROM 0 -0.40
HAS_ATTACHMENT 0 0.08
HAS_ORG_HEADER 0 -0.48
HTML_SHORT_LINK_IMG_1 2 2.33
REPLYTO_EQ_FROM 0 -0.32
RCVD_COUNT_FIVE 0 0.53
HAS_X_PRIO_ONE 0 0.82
PRECEDENCE_BULK 0 0.14
RCPT_COUNT_THREE 0 0.25
TO_EXCESS_BASE64 1.5 1.21
RCVD_COUNT_TWO 0 -0.47
MID_RHS_IP_LITERAL 0.5 0.16
ARC_NA 0 1.37
RCVD_COUNT_SEVEN 0 1.55
DATE_IN_FUTURE 4 4.36
RCPT_COUNT_SEVEN 0 0.21
FORGED_MUA_KMAIL_MSGID 3 3.14
MIME_BASE64_TEXT 0 -0.44
TO_EQ_FROM 0 0.46
MISSING_SUBJECT 2 1.54
INVALID_MSGID 1.7 1.98
MID_MISSING_BRACKETS 0.5 0.57
SUBJECT_NEEDS_ENCODING 1 0.89
FROM_NO_DN 0 1.55
MIME_GOOD -0.1 0.74
MIME_HEADER_CTYPE_ONLY 2 2.00
EXT_CSS 1 1.16
RCVD_COUNT_THREE 0 -0.11
RCPT_COUNT_TWO 0 -0.24
TO_DN_ALL 0 -0.39
HFILTER_HOSTNAME_4 2.5 2.14
HAS_REPLYTO 0 -0.04
INVALID_RCPT_8BIT 6 5.99
MID_RHS_MATCH_FROM 0 -0.39
MISSING_MIMEOLE 2 3.46
RCVD_ILLEGAL_CHARS 4 4.49
TAGGED_FROM 0 -0.38
HAS_X_PRIO_FIVE 0 -0.38
MID_CONTAINS_FROM 1 0.99
HTTP_TO_IP 1 1.21
CT_EXTRA_SEMI 1 0.84
REPLYTO_DN_EQ_FROM_DN 0 0.48
MISSING_MIME_VERSION 2 4.13
PHISHING 7 7.28
TO_EXCESS_QP 1.2 0.88
MID_RHS_WWW 0.5 0.93
URL_IN_SUBJECT 4 4.24
RCVD_COUNT_ONE 0 -0.34
SUBJECT_HAS_QUESTION 0 -0.48
FORGED_OUTLOOK_TAGS 2.1 2.19
FROM_HAS_DN 0 0.16
CTYPE_MIXED_BOGUS 0.1 0.01
R_SUSPICIOUS_IMAGES 5 5.46
RCPT_COUNT_TWELVE 0 0.43
SUBJECT_ENDS_SPACES 0.5 0.76
INVALID_FROM_8BIT 6 6.40
SUBJ_EXCESS_QP 1.2 1.67
FORGED_MUA_OUTLOOK 3 2.52
TO_DN_NONE 0 3.64
MIME_MA_MISSING_HTML 1 0.66
CTE_CASE 0.5 0.86
TO_MATCH_ENVRCPT_ALL 0 -0.18
RCPT_COUNT_FIVE 0 0.34
HAS_X_ANTIABUSE 0 -0.00
RCVD_COUNT_TWELVE 0 0.34
HTML_SHORT_LINK_IMG_3 0.5 0.38
ENVFROM_SERVICE_ACCT 1 1.05
MIME_MA_MISSING_TEXT 2 2.31
MID_RHS_NOT_FQDN 0.5 0.01
FROM_NEQ_ENVFROM 0 0.53
HAS_WP_URI 0 0.39
HTML_SHORT_LINK_IMG_2 1 0.62
HFILTER_URL_ONLY 2.2 2.28
MIME_UNKNOWN 0.1 0.57
MIME_BAD_ATTACHMENT 4 4.33
TO_DN_SOME 0 -0.88
RCPT_COUNT_ONE 0 2.45
HAS_XOIP 0 -0.44
R_PARTS_DIFFER 1 0.72
SUBJECT_HAS_CURRENCY 1 1.46
RCPT_COUNT_ZERO 0 0.27
FROM_NAME_EXCESS_SPACE 1 0.81
RCVD_NO_TLS_LAST 0 1.66
REPLYTO_DOM_EQ_FROM_DOM 0 0.38
REPLYTO_DOM_NEQ_FROM_DOM 0 -0.07
MAILLIST -0.2 -2.06
FROM_NAME_HAS_TITLE 1 1.25
R_MISSING_CHARSET 2.5 2.67
DATE_IN_PAST 1 2.93
R_DKIM_NA 0 -0.48
R_SPF_DNSFAIL 0 2.21
SUBJECT_ENDS_QUESTION 1 0.82
HAS_X_PRIO_THREE 0 0.45
BROKEN_CONTENT_TYPE 1.5 1.52
ONCE_RECEIVED 4 3.71
TO_DN_EQ_ADDR_ALL 0 -0.46
Class changes
MIME_GOOD -0.1 0.74
Pre-rescore test stats
Statistics at threshold: 15
F-score: 0.05
False positive rate: 0.00 %
False negative rate: 97.65 %
Overall accuracy: 44.67 %
Post-rescore test stats
Statistics at threshold: 15
F-score: 0.83
False positive rate: 18.46 %
False negative rate: 18.82 %
Overall accuracy: 81.33 %
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment