Skip to content

Instantly share code, notes, and snippets.

@shevron
shevron / docker-compose-dev.yaml
Created April 9, 2019 06:18
Docker compose file defining external CKAN dependencies
# Docker compose for external services, assuming main ckan services are run
# outside of Docker
version: "3"
volumes:
pg_data:
services:
@shevron
shevron / azure-uploader.py
Created October 6, 2020 12:01
Demo of using Azure Blob Storage API for simple multipart upload flow
"""Test Azure Multipart Uploads
"""
import base64
import logging
import os
from itertools import count
from typing import BinaryIO, Generator, Tuple
import click
from azure.core.exceptions import ResourceNotFoundError
@shevron
shevron / make-test-csv.py
Last active November 20, 2020 07:10
Generate an arbitrary CSV file of about given size in Python
"""Use to generate a large CSV file for testing purposes. Will write CSV data to STDOUT
Usage: python make-test-csv.py 512000000 # Make a ~512mb CSV file
"""
import csv
import sys
from itertools import count
def make_csv_row(counter, row_width, zero_fill=8):