troyharvey

Automatically load .env files

I use .env environment variable files in every project. Docker Compose supports .env files. And now direnv supports them too. direnv is a cli tool that detects a .envrc or .env file and runs source .env automatically for you when you cd into a project directory.

1. Install Homebrew.

2. Install direnv.

    brew install direnv
   

3. Follow these instructions to add the direnv hook to your shell.

troyharvey

1. Generate a jsonl file with all the Podcast User Agents.

    node agents.js
   

2. Use the BigQuery console to create a table and load the podcast-user-agents.jsonl file into the new table.

troyharvey

Using GitHub Actions to run dbt

This example shows you how to use GitHub Actions to run dbt against BigQuery.

1. Follow the instructions on getdbt.com for installing and initializing a dbt project.

2. Copy this action (dbt.yml) into the workflows directory.

    mkdir .github
    mkdir .github/workflows
   

cp ~/Downloads/dbt.yml .github/workflows/

troyharvey

<?php

namespace App\Console\Commands;

use DB;
use Illuminate\Encryption\Encrypter;
use Illuminate\Support\Str;
use Illuminate\Console\Command;

class ReEncryptData extends Command

troyharvey

My git Workflow

This is just one way of using git/GitHub. But I have been using this same basic flow for 10 years and I rarely have trouble.

1. Checkout the main branch

    git checkout main
   

2. Pull the most recent version of main from GitHub

troyharvey

class CreateRedshiftTableFromSchemaOperator(BaseOperator):
    """
    Create Redshift Table from schema file.

    :param redshift_conn_id                         Airflow Redshift Connection ID
    :type  redshift_conn_id                         string
    :param schema                                   Redshift schema
    :type  schema                                   string
    :param table                                    Redshift table
    :type  table                                    string

troyharvey

Cayley is an open-source graph inspired by the graph database behind Freebase and Google's Knowledge Graph. Gephi is an open-source graph visualization tool. The Graph Streaming plugin for Gephi allows you to visualize a Cayley graph or a stream of real-time changes to a Cayley graph.

1. Install Cayley

    brew install cayley
   

2. Start Cayley with the Movie Data sample

troyharvey

/**
 * Convert Google Cloud Storage object url into an object with bucket and file path.
 */
function fromStorageUrl(url) {
  var tokens = RegExp('https://storage.googleapis.com/(.+?)/(.+)','g').exec(url);
  if (tokens === null) throw "Invalid Google Cloud Storage url.";
  
  return {
    'bucket': tokens[1],
    'file': tokens[2]

troyharvey

# Update Jan 2024
# Deploying Cloud Functions is much simpler than it was 6 years ago.
# I'm leaving the gist in it's original 2018 state for now,
# but skip the the recent comments below for a simpler solution.

variables:
  GCP_ZONE: us-central1-a

stages:
  - npm-install

troyharvey

gear

• pack
• hammock
• hammock straps
• hammock rain fly
• sleeping pad
• sleeping bag

cooking

• trail stove