Skip to content

Instantly share code, notes, and snippets.

View pathbreak's full-sized avatar

Pathbreak Consulting pathbreak

12 followers · 0 following
View GitHub Profile
@pathbreak
pathbreak / README.md
Last active March 7, 2023 13:10
Pipe colorized jq JSON output to `more`

Pardon the SEO-optimized title but actually it doesn't look like more can handle it at all. Use less:

cat FILE.json | jq . -C | less -R

jq . -C :

  • '.' is the basic jq filter that pretty-prints JSON to stdout
@pathbreak
pathbreak / imageability_scores_expanded.txt
Last active April 14, 2021 06:02
Imagenet non-imageable scores http://image-net.org/imageability_scores.txt enhanced with lemmas for each synset
n10227266 5 junior
n09828403 5 baby_boomer,boomer
n10530150 5 rider
n10092794 5 first_lady
n10499857 5 queen
n10334009 5 motorcyclist
n10020890 5 doctor,doc,physician,MD,Dr.,medico
n10087434 5 fighter_pilot
n10605737 5 skinny-dipper
n09874725 5 bride
@pathbreak
pathbreak / lct-iot-cluster-plan.yaml
Last active December 2, 2021 20:03
An IoT cluster plan for LCT with Spark, PostgreSQL and Kafka in multiple regions
# An example linode cluster toolkit cluster plan for a large IoT data processing cluster
# consisting of Spark streaming data clusters, Kafka message queue nodes
# in different regions,
# and PostgreSQL clusters for storage.
#
name: 'iot-cruncher'
regions:
- region: 'us-east-1a'
@pathbreak
pathbreak / lct-ha-wordpress-plan.yaml
Last active December 2, 2021 20:02
HA Wordpress Cluster Plan for LCT
# An example linode cluster toolkit cluster plan for a high availability
# Wordpress content management system being used for high traffic
# ecommerce.
# Consists of 2 regions for disaster recovery, each with nodebalancers, web servers,
# memcached clusters and MySQL clusters.
name: 'ha-wordpress'
# A regionplan is a template for an entire region.
# The template can then be applied to multiple regions for
@pathbreak
pathbreak / hdfs-datanode-plans.csv
Last active February 15, 2017 06:51
HDFS DataNode Plans
CPU RAM (GB) Storage (GB) Network out (Gbps)
Linode 48GB 12 cores 48 768 4
Linode 64GB 16 cores 64 1152 6
Linode 80GB 20 cores 80 1536 8
Linode 120GB 20 cores 120 1920 10
@pathbreak
pathbreak / S3 TCO.csv
Created February 7, 2017 20:11
S3 TCO
Outgoing TB/month: 0 10 25 50 100 Same as min Linode transfer pool 120 TB Same as min Linode transfer pool 496 TB
Total cost for 10TB capacity: $ 302 1345 2781 5174 9117 10694 31959
@pathbreak
pathbreak / Ceph TCO.csv
Created February 7, 2017 20:08
Ceph TCO
Instance plan: 1920GB 1536GB 1152GB 768GB 384GB
Total cost for 10TB capacity: $ 5810 4530 4850 4850 5020
Max free outgoing data: TB/month 120 140 200 300 496
@pathbreak
pathbreak / Ceph OSD node CPU RAM.csv
Created February 7, 2017 19:48
Ceph OSD node CPU RAM
CPU RAM (GB)
Linode 64GB 16 cores 64
Linode 80GB 20 cores 80
Linode 120GB 20 cores 120
@pathbreak
pathbreak / Ceph OSD plans.csv
Last active February 8, 2017 05:06
Ceph OSD node plans
Max GB Object storage GB / node # of nodes for 30 TB $ per node per month Total $ Unit $ / GB Free outgoing transfer / node (TB) Free pooled outgoing transfer (TB) Max outgoing & internal bandwidth (Gbps)
Linode 64GB 1152 1047 30 480 14400 $0.47 20 600 6
Linode 80GB 1536 1431 22 640 14080 $0.46 20 440 8
Linode 120GB 1920 1815 17 960 16320 $0.53 20 340 10
@pathbreak
pathbreak / gluster-sizing-no-replication.csv
Last active February 1, 2017 11:12
Gluster sizing
Max GB Usable GB / node # of nodes for 10 TB $ per node per month Total $ Unit $ / GB Free outgoing transfer / node (TB) Free pooled outgoing transfer (TB) Max outgoing & internal bandwidth (Mbps)
Linode 2GB 24 19 539 10 5390 $0.53 2 1078 125
Linode 4GB 48 43 239 20 4780 $0.47 3 717 250
Linode 8GB 96 91 113 40 4520 $0.44 4 452 500
Linode 12GB 192 187 55 80 4400 $0.43 8 440 1000
Linode 24GB 384 379 28 160 4480 $0.44 16 448 2000
Linode 48GB 768 763 14 320 4480 $0.44 20 280 4000
Linode 64GB 1152 1147 9 480 4320 $0.42 20 180 6000
Linode 80GB 1536 1531 7 640 4480 $0.44 20 140 8000
Linode 120GB 1920 1915 6 960 5760 $0.56 20 120 10000