Skip to content

Instantly share code, notes, and snippets.

@binux
Created December 11, 2014 14:14
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save binux/9f32caa02f4e135720fc to your computer and use it in GitHub Desktop.
Save binux/9f32caa02f4e135720fc to your computer and use it in GitHub Desktop.
pyspider TODO

v0.3.0

[x] as a package [x] run.py parameters [x] sortable projects list #12 [x] Postgresql Supported via SQLAlchemy (with the power of SQLAlchemy, pyspider also support Oracle, SQL Server, etc) [x] benchmarking [ ] pypi release version

v0.4.0

[ ] a visual scraping interface like portia [ ] python3 support

more

[ ] local mode, loading scripts from file. [ ] edit script with local vim via WebDAV [ ] in-browser debugger like Werkzeug

???

[ ] works as a framework (all components running in one process, no threads) [ ] shell mode like scrapy shell

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment