Skip to content

Instantly share code, notes, and snippets.

@textshell
Created November 16, 2015 22:36
Show Gist options
  • Save textshell/a3d63353ee5954efaeb0 to your computer and use it in GitHub Desktop.
Save textshell/a3d63353ee5954efaeb0 to your computer and use it in GitHub Desktop.
# Content scrapers with replaceable urls
^http://supportcode.xyz/question/(\d+)/
^http://thehelpcentre.xyz/question/(\d+)/
^http://findsupport.xyz/question/(\d+)/
^http://righthelp.xyz/question/(\d+)/
!http://www.stackoverflow.com/questions/$1
.background-color: #e0ffe0
.padding: 5px
.border: solid 1px red
# Content scrapers with seo urls that are searchable in orignal source
^http://www.iasptk.com/ubuntuwp/(.*)/
!http://askubuntu.com/search?q=$1
.background-color: #e0ffe0
.padding: 5px
.border: solid 1px red
^http://useranswer.com/answer/(.*)/
!http://stackexchange.com/search?q=$1
.background-color: #e0ffe0
.padding: 5px
.border: solid 1px red
# Content scrapers with unfortunate urls
^http://s\d+.codeinspot.com/q/
^http://www.codingtiger.com/
^http://www.postseek.com/
# sites of past content scrapers
^http://efreedom.com/
^http://jamesnsheri.com/(.*)
.padding: 5px
.background-color: #ffe0e0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment