Skip to content

Instantly share code, notes, and snippets.

View jsignell's full-sized avatar

Julia Signell jsignell

View GitHub Profile

Benefits of Cirrus

Cirrus is a STAC-based geospatial processing pipeline built using a serverless and scalable architecture. ref

Serverless

  • Save time by not managing architecture directly

Scalable

  • Do small workloads daily, but when you need to process some whole new datasets that works too

Benefits of STAC

SpatioTemporal Asset Catalog (STAC) is a community-built specification that aims to standardize how people find and interact with geospatial data.

Below are some of the most valuable features of STAC.

Catalog

If your data is not findable it does not exist. You need to be able to find where it is and know what it is in order to use it. Cataloging data means that:

Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@jsignell
jsignell / UploadFile.py
Created February 25, 2021 14:32
Simple file upload worker plugin for dask.
import os
from distributed import WorkerPlugin
class UploadFile(WorkerPlugin):
"""A WorkerPlugin to upload a local file to workers.
Parameters
----------
filepath: str
A path to the file to upload
@jsignell
jsignell / pre-commit-ci.yml
Last active May 8, 2024 20:22
Github Action to run pre-commit on files changed between target branch and base branch
name: pre-commit-ci
on:
pull_request:
branches:
- main
jobs:
pre-commit-ci:
name: Lint changed backend files
runs-on: ubuntu-latest
steps:
@jsignell
jsignell / Dask-maintenance.md
Last active May 29, 2020 13:37
How to watch dask

I have been experimenting with tooling around how to keep track of dask issues and wanted to write down what I've been trying.

Watch the repositories

Subscribe to all the repositories in the dask org. Then if you go to https://github.com/notifications, you'll be notified when things change

Get org-level lists of issues/PRs

Look for:

// Single-object route
Route: /api/{plural of object}/{id}
example: /api/people/8
Allowable methods: GET, PATCH, DELETE
// successful response
{
"id": 8,
"name": "Alex",
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.