Skip to content

Instantly share code, notes, and snippets.

Avatar
:octocat:
Coding time

Vinicius Souza vsouza

:octocat:
Coding time
View GitHub Profile
@vsouza
vsouza / term_context.go
Created Sep 28, 2020 — forked from matryer/term_context.go
Making Ctrl+C termination cancel the context.Context
View term_context.go
func main() {
ctx := context.Background()
// trap Ctrl+C and call cancel on the context
ctx, cancel := context.WithCancel(ctx)
c := make(chan os.Signal, 1)
signal.Notify(c, os.Interrupt)
defer func() {
signal.Stop(c)
@vsouza
vsouza / installing_cassandra.md
Created Jul 30, 2020 — forked from hkhamm/installing_cassandra.md
Installing Cassandra on Mac OS X
View installing_cassandra.md

Installing Cassandra on Mac OS X

Install Homebrew

Homebrew is a great little package manager for OS X. If you haven't already, installing it is pretty easy:

ruby -e "$(curl -fsSL https://raw.github.com/Homebrew/homebrew/go/install)"
@vsouza
vsouza / main.go
Created May 27, 2018 — forked from cespare/main.go
Example of testing Go HTTP servers using httptest.Server.
View main.go
package main
import (
"log"
"myserver"
"net/http"
)
const addr = "localhost:12345"
@vsouza
vsouza / gist:cc16d0af73ebb1ac4e175ce61f908a04
Created Jan 2, 2018 — forked from digitaljhelms/gist:4287848
Git/GitHub branching standards & conventions
View gist:cc16d0af73ebb1ac4e175ce61f908a04

Branching

Quick Legend

Instance Branch Description, Instructions, Notes
View start_streamming_spark.py
spark_streaming_context.start()
spark_streaming_context.awaitTermination()
spark_streaming_context.stop()
View spark_to_redshift.py
def toRedshift(time, rdd):
try:
sqlContext = getSqlContextInstance(rdd.context)
schema = StructType([
StructField('user_id', StringType(), True),
StructField('device_id', StringType(), True),
StructField('steps', IntegerType(), True),
StructField('battery_level', IntegerType(), True),
StructField('calories_spent', IntegerType(), True),
View s3_spark_output.py
spark_context.saveAsTextFile("s3n://parents/activity_log/01010101.txt")
View spark_context.py
spark_context = SparkContext(appName=kinesis_app_name)
spark_streaming_context = StreamingContext(spark_context, spark_batch_interval)
sql_context = SQLContext(spark_context)
kinesis_stream = KinesisUtils.createStream(
spark_streaming_context, kinesis_app_name, kinesis_stream, kinesis_endpoint,
aws_region, kinesis_initial_position, kinesis_checkpoint_interval)
py_rdd = kinesis_stream.map(lambda x: json.loads(x))
View kinesis_consumer.py
from __future__ import print_function
from pyspark import SparkContext
from pyspark.streaming import StreamingContext
from pyspark.streaming.kinesis import KinesisUtils, InitialPositionInStream
import datetime
import json
from pyspark.sql import SQLContext, Row
from pyspark.sql.types import *
aws_region = 'us-east-1'
@vsouza
vsouza / request.swift
Last active May 31, 2016
Simple HTTP request. Swift backend implementation
View request.swift
import HTTP
import File
import HTTPSClient
import JSON
var url: String?
do {
let client = try! Client(uri: "https://api.github.com:443")
var response = try client.get("/repos/vsouza/awesome-ios/git/trees/HEAD")
let buffer = try response.body.becomeBuffer()