Skip to content

Instantly share code, notes, and snippets.

The pipeline is a sequence of configurable 'transformers'. They essentially take in a file and pass one or more files to the next stage.

For example the current pipeline might look like this:

  • Index (finds changed files on the filesystem and passes them through
    • Encrypt
      • Cache
      • Upload
    • Database (stores item metadata in the database)

But if someone wants to, for example, add thumbnails for every image on the remote end, they can do this:

@bobobo1618
bobobo1618 / nginx.conf
Created March 25, 2014 01:32
Stripped NGINX Conf
user www-data www-data;
worker_processes 2;
worker_rlimit_nofile 8192;
events {
worker_connections 8000;
accept_mutex off;
<script type="text/javascript" src="//ajax.googleapis.com/ajax/static/modules/gviz/1.0/chart.js"> {"dataSourceUrl":"//docs.google.com/spreadsheet/tq?key=0AgDCXIAGa0OddGNrSjdYSmNCSnlid3ZOeHpXUTN1TUE&transpose=0&headers=1&merge=COLS&range=1!A2%3AA54%2C2!B1%3AB55%2C4!B1%3AB54%2C3!B1%3AB54%2C5!B1%3AB54%2C1!B1%3AB54&rtyp=GID&pub=1","options":{"displayAnnotations":true,"vAxes":[{"title":"Download (B/s)","useFormatFromData":true,"minValue":null,"viewWindow":{"max":null,"min":null},"logScale":false,"maxValue":null},{"useFormatFromData":true,"minValue":null,"viewWindow":{"max":null,"min":null},"logScale":false,"maxValue":null}],"titleTextStyle":{"bold":true,"color":"#000","fontSize":16},"booleanRole":"certainty","title":"Download speeds over time","legend":"right","focusTarget":"series","wmode":"opaque","hAxis":{"title":"Time","useFormatFromData":true,"slantedTextAngle":30,"slantedText":true,"minValue":null,"viewWindow":{"max":null,"min":null},"maxValue":null},"tooltip":{"trigger":"none"},"width":1427,"height":636,"an
Traceback (most recent call last):
File "/opt/ve/shipyard/local/lib/python2.7/site-packages/tastypie/resources.py", line 217, in wrapper
response = callback(request, *args, **kwargs)
File "/opt/ve/shipyard/local/lib/python2.7/site-packages/tastypie/resources.py", line 459, in dispatch_list
return self.dispatch('list', request, **kwargs)
File "/opt/ve/shipyard/local/lib/python2.7/site-packages/tastypie/resources.py", line 491, in dispatch
response = method(request, **kwargs)
package entities;
import com.haxepunk.Entity;
import com.haxepunk.graphics.Image;
import com.haxepunk.utils.Input;
import com.haxepunk.utils.Key;
import nape.phys.BodyType;
package entities;
import com.haxepunk.Entity;
import com.haxepunk.graphics.Image;
import com.haxepunk.utils.Input;
import com.haxepunk.utils.Key;
import nape.phys.BodyType;
scene, {src:"demo/bgcity01.jpg"},
actor, {id:"Vina", sprite:["v-city", "demo/vina02.png"]},
actor, {id:"Vina", remove:"v-forest"},
text, {append:false, value:"Six months later..."},
box, {pos:"bottom", back:"dim", show:false},
overlay, {show:false, effect:"fade"},
audio, {bgs:"demo/streets01"},
audio, {se:"demo/streets02", delay:7},
text, "That's when I finally caught up with her in the City. (Editor's note: Aren't we using too much generic names \
here like Town, Forest, Moon, City?)",
from django.db import models
from django.contrib.contenttypes.models import ContentType
from django.contrib.contenttypes import generic
# Create your models here.
class Barcode(models.Model):
""" A barcode can be thought of a real world generic foreign key that points to an object somewhere in the DB """
Traceback (most recent call last):
File "<console>", line 1, in <module>
File "/home/lucas/Dev/Kogan/Support-Parts-Inventory/virtualenv/lib/python2.7/site-packages/django/db/models/base.py", line 546, in save
force_update=force_update, update_fields=update_fields)
File "/home/lucas/Dev/Kogan/Support-Parts-Inventory/virtualenv/lib/python2.7/site-packages/django/db/models/base.py", line 650, in save_base
result = manager._insert([self], fields=fields, return_id=update_pk, using=using, raw=raw)
File "/home/lucas/Dev/Kogan/Support-Parts-Inventory/virtualenv/lib/python2.7/site-packages/django/db/models/manager.py", line 215, in _insert
return insert_query(self.model, objs, fields, **kwargs)
File "/home/lucas/Dev/Kogan/Support-Parts-Inventory/virtualenv/lib/python2.7/site-packages/django/db/models/query.py", line 1661, in insert_query
return query.get_compiler(using=using).execute_sql(return_id)
2013-06-19 12:53:33 =ERROR REPORT====
** Generic server disksup terminating
** Last message in was {'EXIT',#Port<0.1684>,normal}
** When Server state == [{data,[{"OS",{unix,linux}},{"Timeout",1800000},{"Threshold",80},{"DiskData",[{"/",30832636,18},{"/dev",503200,0},{"/run",511296,1},{"/dev/shm",511296,0},{"/sys/fs/cgroup",511296,0},{"/tmp",511296,0}]}]}]
** Reason for termination ==
** {port_died,normal}
2013-06-19 12:53:35 =CRASH REPORT====
crasher:
initial call: disksup:init/1
pid: <0.84.0>