toddkaufmann

Last edited by Todd Kaufmann 3 years ago
= Proposed job scheduler change to support smaller chunksize, greater resilience =

== Idea: instead of looping over instances, loop over the set of jobs ==

for example, 1000 commands, 10 instances --> 100 jobs (0..99), where job N is commands N10 .. N10+9.

Jobs have three states:

done

toddkaufmann

#!/bin/bash

PYTHON27="/usr/bin/python2.7"
VENV_ROOT="/data/venv"

apt-get update
apt-get -y install python-software-properties
add-apt-repository ppa:fkrull/deadsnakes
apt-get update

toddkaufmann

* etckeeper
it's so sasy just do it
TODO:  how to sync / centralize / push to other server ?
(at least backup/sync the .git folder and you should be safe)

#VCS="git"
VCS="bzr"

# Above was the default in etckeeper.conf;
# changing from default bzr:  use the lines below 

toddkaufmann

Latency Comparison Numbers
--------------------------
L1 cache reference                            0.5 ns
Branch mispredict                             5   ns
L2 cache reference                            7   ns             14x L1 cache
Mutex lock/unlock                            25   ns
Main memory reference                       100   ns             20x L2 cache, 200x L1 cache
Compress 1K bytes with Zippy              3,000   ns
Send 1K bytes over 1 Gbps network        10,000   ns    0.01 ms
Read 4K randomly from SSD*              150,000   ns    0.15 ms