harlow

Golang Workers / Job Queue

A running example of the code from:

• http://marcio.io/2015/07/handling-1-million-requests-per-minute-with-golang
• http://nesv.github.io/golang/2014/02/25/worker-queues-in-go.html

This gist creates a working example from blog post, and a alternate example using simple worker pool.

TLDR: if you want simple and controlled concurrency use a worker pool.

harlow

type MyStruct struct {
    N int
}
n := MyStruct{ 1 }

// get 
immutable := reflect.ValueOf(n)
val := immutable.FieldByName("N").Int()
fmt.Printf("N=%d\n", val) // prints 1

harlow

# app/models/user.rb
class User < ActiveRecord::Base
  validates :zip_code, presence: true, zip_code: true
end

harlow

package main

import (
	"fmt"
	"sync"
	"time"
)

const concurrency = 3

harlow

package cache

import (
	"crypto/sha256"
	"encoding/json"
	"fmt"
	"os"
	"sync"
	"time"
)

harlow

aaron,erin,ron,ronnie
abel,ab,abe,eb,ebbie
abiel,ab
abigail,abby,gail,gail,nabby
abner,ab
abraham,ab,abe
abram,ab
adaline,ada,addy,delia,dell,lena
adelaide,addy,adele,dell,della,heidi
adeline,ada,addy,delia,dell,lena

harlow

# AWS
provider "aws" {
  region   = "us-west-2"
  profile  = "myAWSProfile"
}

# IAM

## IAM Role
resource "aws_iam_role" "iam_for_lambda" {

harlow

Nashville Hot Chicken

Prework

Salt and pepper brine the Chicken pieces for 24 hrs

Breading Station

Combine the following until the egg streaks are gone

harlow

Make it real

Ideas are cheap. Make a prototype, sketch a CLI session, draw a wireframe. Discuss around concrete examples, not hand-waving abstractions. Don't say you did something, provide a URL that proves it.

Ship it

Nothing is real until it's being used by a real user. This doesn't mean you make a prototype in the morning and blog about it in the evening. It means you find one person you believe your product will help and try to get them to use it.

Do it with style

harlow

package main

import (
	"github.com/apex/go-apex"
	"github.com/apex/go-apex/kinesis"
	"github.com/aws/aws-sdk-go/aws"
	"github.com/aws/aws-sdk-go/aws/session"
	"github.com/aws/aws-sdk-go/service/firehose"
)