Skip to content

Instantly share code, notes, and snippets.

View wagnerjgoncalves's full-sized avatar
⚓
Happy

Wagner Gonçalves wagnerjgoncalves

⚓
Happy
23 followers · 21 following
View GitHub Profile
@wagnerjgoncalves
wagnerjgoncalves / week_1.md
Created April 27, 2016 23:36
Introduction Big Data

What's in Big Data Applications and Systems?

Introduction

So we will start by introducing you to where big data comes from and what kinds of things you can do with it.

We'll also provide an overview of some of the key characteristics of big data and a short summary of the data science process to get value out of big data.

@wagnerjgoncalves
wagnerjgoncalves / example_dataframe_api.py
Last active February 8, 2024 11:49
Pyspark using SparkSession example
# -*- coding: utf-8 -*-
"""
Example of Python Data Frame with SparkSession.
"""
from pyspark.conf import SparkConf
from pyspark.sql import SparkSession
from pyspark.sql.functions import *
from pyspark.sql.types import *
@wagnerjgoncalves
wagnerjgoncalves / introduction.md
Last active August 21, 2023 06:56
Notes from Growing Rails Applications in Practice

Growing Rails Applications in Practice

  • How to use discipline, consistency and code organization to make your code grow more gently.

  • As you cycle through patterns, your application is becoming a patchwork of different coding techniques.

    All those new techniques actually help, or if you are just adding layers of inderection.

  • Large applications are large so what we can do is organize a codebase in a way that "scales logarithmically".

@wagnerjgoncalves
wagnerjgoncalves / jenkins.md
Last active April 19, 2023 07:27
Shell Script to install Jenkins at Ubuntu
@wagnerjgoncalves
wagnerjgoncalves / description.md
Last active November 8, 2022 16:38
Versionamento Semântico

Versionamento

Com a finalidade de ter uma maior visibilidade das entregas realizadas, facilidade na comunicação entre times e planejamento do produto a longo prazo iremos adotar Versionamento Semântico.

Nós iremos seguir a especificação Semântica de Versionamento do Tom Preston-Werner criador do Gravatars e co-fundador do GitHub.

Introdução

Dado um número de versão MAJOR.MINOR.PATCH, incremente a:

@wagnerjgoncalves
wagnerjgoncalves / week_1.md
Last active July 22, 2019 07:52
Hadoop Platform and Application

Hadoop Basics

Hadoop Ecosystem

Hadoop Stack Basics

What is Haddop (2005)

Is an open-source software framework for storage and large scale processing of data-sets on cluster of commodity hardware.

@wagnerjgoncalves
wagnerjgoncalves / python_pipenv_jupyter
Created September 6, 2018 15:54
Python + pipenv + jupyter
mkdir python_pipenv_jupyter
cd python_pipenv_jupyter/
pipenv --three
pipenv install pandas numpy
pipenv install jupyter
pipenv run python -m ipykernel install --user --name python_pipenv_jupyter_env --display-name "python_pipenv_jupyter_env"
pipenv run jupyter notebook --ip=192.168.1.12
@wagnerjgoncalves
wagnerjgoncalves / example_rdd_api.py
Last active August 31, 2018 13:24
Pyspark using SparkContext example
# -*- coding: utf-8 -*-
"""
Example of Python RDD with SparkContext
"""
import csv
from pyspark import SparkContext
from pyspark.conf import SparkConf
from collections import OrderedDict
@wagnerjgoncalves
wagnerjgoncalves / rails_status_codes_symbols.md
Last active April 18, 2017 15:03

List of Rails Status Code Symbols

1xx Informational

100	Continue	           :continue
101	Switching Protocols	:switching_protocols
102	Processing	         :processing
@wagnerjgoncalves
wagnerjgoncalves / vaga_front_end.md
Last active February 7, 2017 16:46
Vagas Tuneduc

Vaga de Front-End (Júnior/Pleno)

A Tuneduc

Dados empoderam as pessoas para tomarem melhores decisões em Educação. Pode ser um pai atrás de informação para escolher a escola dos filhos, um aluno que descobre sua nota no Enem com meses de antecedência ou uma escola que sabe exatamente o que trabalhar em sala de aula para potencializar a aprendizagem. É nisso que a Tuneduc acredita.

Aqui, engenheiros, designers, economistas, educadores e outros apaixonados por educação analisam dados e constroem plataformas digitais. São soluções que estão no dia a dia de mais de 600 escolas, em algumas das maiores redes públicas do país e no celular de 300 mil alunos.

O que buscamos