crccheck

What the Hell? -- A Journey Through the Nine Circles of Python Packing

Writing a setup.py

I am no Virgil, but having stumbled my way through Python packaging a few times already, I'm documenting the things I learn as I go here.

To help me learn, I took a survey of the top 15 Python packages on Github along with 12 other commonly referenced packages. I thought... if there are any best

crccheck

Task	Postgres	MySQL	sqlite
help	\?		.help
list databases	psql -l, \l	show databases;	.databases
list tables/views/seq	\d
list roles	\du
list tables	\dt		.tables
describe table	\d <table>		.schema
expanded output	\x	\G
list schemas	\dn

crccheck

crccheck

javascript:(function(){var a=location.href.split('/');a[0]='http:';a[2]=location.port?'www.texastribune.org':'localhost:8000';window.open(a.join('/'))})();

crccheck

Histogram of a natural number field NOTE: the x-axis ends up being ordinal instead of linear so it can look like 1 2 3 5 6 8 12 instead of 1 2 3 4 5 6 7 ...

| stats count AS attempts by url_path
| rex field=url_path mode=sed "s/.*/1/"
| stats sum(url_path) by attempts
| sort num(attempts)

crccheck

Grab a column out of a CSV with header, surround with quotes, and put commas between

echo $(csvcut -c UUID path_to.csv | tail -n +2 | awk '{ print """$0""" }') | tr ' ' ,

crccheck

Errors

Halt on all errors. Useful for debugging.

errors.tolerance=none
errors.log.include.messages=true
errors.log.enable=true

Keep going no matter what.

crccheck

https://www.joedog.org/siege-manual/

Do 1000 requests against a url

siege URL --benchmark --reps=100 --concurrent=10

crccheck

https://github.com/nock/nock#recording

Recording

This is a cool feature:

Guessing what the HTTP calls are is a mess, especially if you are introducing nock on your already-coded tests.

For these cases where you want to mock an existing live system you can record and playback the HTTP calls like this:

crccheck

// In another window, run
//
// $ nc -kl 4200
//
// -k       keepalive (BSD/OSX only)
// -l 4200  listen on port 4200
const requestP = require('request-promise-native');

const now = Date.now();
// never finishes