Skip to content

Instantly share code, notes, and snippets.

View vsouza's full-sized avatar
:octocat:
Coding time

Vinicius Souza vsouza

:octocat:
Coding time
1.5k followers · 336 following
View GitHub Profile
@vsouza
vsouza / main.go
Created April 13, 2023 19:34
Mocking HTTP Request inside methods in Golang
package main
import (
"io"
"log"
"net/http"
)
type httpClient interface {
Get(string) (*http.Response, error)
@vsouza
vsouza / term_context.go
Created September 28, 2020 22:18 — forked from matryer/term_context.go
Making Ctrl+C termination cancel the context.Context
func main() {
ctx := context.Background()
// trap Ctrl+C and call cancel on the context
ctx, cancel := context.WithCancel(ctx)
c := make(chan os.Signal, 1)
signal.Notify(c, os.Interrupt)
defer func() {
signal.Stop(c)
@vsouza
vsouza / installing_cassandra.md
Created July 30, 2020 20:53 — forked from hkhamm/installing_cassandra.md
Installing Cassandra on Mac OS X

Installing Cassandra on Mac OS X

Install Homebrew

Homebrew is a great little package manager for OS X. If you haven't already, installing it is pretty easy:

ruby -e "$(curl -fsSL https://raw.github.com/Homebrew/homebrew/go/install)"
@vsouza
vsouza / main.go
Created May 27, 2018 22:58 — forked from cespare/main.go
Example of testing Go HTTP servers using httptest.Server.
package main
import (
"log"
"myserver"
"net/http"
)
const addr = "localhost:12345"
@vsouza
vsouza / gist:cc16d0af73ebb1ac4e175ce61f908a04
Created January 2, 2018 16:15 — forked from digitaljhelms/gist:4287848
Git/GitHub branching standards & conventions

Branching

Quick Legend

Description, Instructions, Notes
Instance Branch
@vsouza
vsouza / start_streamming_spark.py
Created October 5, 2016 02:52
spark_streaming_context.start()
spark_streaming_context.awaitTermination()
spark_streaming_context.stop()
@vsouza
vsouza / spark_to_redshift.py
Created October 5, 2016 02:50
def toRedshift(time, rdd):
try:
sqlContext = getSqlContextInstance(rdd.context)
schema = StructType([
StructField('user_id', StringType(), True),
StructField('device_id', StringType(), True),
StructField('steps', IntegerType(), True),
StructField('battery_level', IntegerType(), True),
StructField('calories_spent', IntegerType(), True),
@vsouza
vsouza / s3_spark_output.py
Created October 5, 2016 02:46
spark_context.saveAsTextFile("s3n://parents/activity_log/01010101.txt")
@vsouza
vsouza / spark_context.py
Created October 5, 2016 02:34
spark_context = SparkContext(appName=kinesis_app_name)
spark_streaming_context = StreamingContext(spark_context, spark_batch_interval)
sql_context = SQLContext(spark_context)
kinesis_stream = KinesisUtils.createStream(
spark_streaming_context, kinesis_app_name, kinesis_stream, kinesis_endpoint,
aws_region, kinesis_initial_position, kinesis_checkpoint_interval)
py_rdd = kinesis_stream.map(lambda x: json.loads(x))
@vsouza
vsouza / kinesis_consumer.py
Last active October 5, 2016 03:04
from __future__ import print_function
from pyspark import SparkContext
from pyspark.streaming import StreamingContext
from pyspark.streaming.kinesis import KinesisUtils, InitialPositionInStream
import datetime
import json
from pyspark.sql import SQLContext, Row
from pyspark.sql.types import *
aws_region = 'us-east-1'