lawvs/robots.txt

Last active January 19, 2018 02:48

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/lawvs/ce19d71c6d9072ad9a5c5c15688f1c12.js"></script>
Save lawvs/ce19d71c6d9072ad9a5c5c15688f1c12 to your computer and use it in GitHub Desktop.

Download ZIP

禁止所有爬虫收录

Raw

	User-agent: *
	Disallow: /

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment