jaehyeon-kim

1️⃣ The FinnHub Streaming Data Pipeline

• https://github.com/RSKriegs/finnhub-streaming-data-pipeline
• 💬 The project is a streaming data pipeline based on Finnhub.io API/websocket real-time trading data.
• 💻 Kafka, Spark, Cassandra, Kubernetes, Grafana

2️⃣ Streamify

• https://github.com/ankurchavda/streamify
• 💬 The project will stream events generated from a fake music streaming service (like Spotify) and create a data pipeline that consumes the real-time data
• 💻 Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP

jaehyeon-kim

#!/bin/bash

# Secure OpenVPN server installer for Debian, Ubuntu, CentOS, Amazon Linux 2, Fedora and Arch Linux
# https://github.com/angristan/openvpn-install

function isRoot () {
	if [ "$EUID" -ne 0 ]; then
		return 1
	fi
}

jaehyeon-kim

# This file is:  ~/.ssh/config

# You may have other (non-CodeCommit) SSH credentials stored in this
# config file – in addition to the CodeCommit settings shown below.

# NOTE: Make sure to run [ chmod 600 ~/.ssh/config ] after creating this file!

# Credentials for Account1
Host awscc-account1                                 # 'awscc-account1' is a name you pick
  Hostname git-codecommit.us-east-1.amazonaws.com   # This points to CodeCommit in the 'US East' region

jaehyeon-kim

library(magrittr)
library(dplyr)

sep <- function(s, delim=',') {
    strsplit(s, delim) %>% 
        unlist() %>% 
        unique() %>% 
        paste(collapse=',')
}

jaehyeon-kim

library(shiny)

myRadioButtons <- function (inputId, label=NULL, choices = NULL, selected = NULL, inline = FALSE, 
                            width = NULL, choiceNames = NULL, choiceValues = NULL) 
{
    args <- shiny:::normalizeChoicesArgs(choices, choiceNames, choiceValues)
    selected <- shiny:::restoreInput(id = inputId, default = selected)
    selected <- if (is.null(selected)) 
        args$choiceValues[[1]]
    else as.character(selected)

jaehyeon-kim

library(magrittr)
library(dplyr)
library(highcharter)
library(shiny)

path <- 'C:/workspace/waterfall/waterfall.csv'
get_waterfall <- function(path) {
    colors <- c("#d35400", "#2980b9", "#2ecc71", "#f1c40f", "#2c3e50", "#7f8c8d")
    path <- 'C:/workspace/waterfall/waterfall.csv'
    df <- read.csv(path, stringsAsFactors = FALSE)

jaehyeon-kim

library(lubridate)
library(rvest)
library(readr)
library(stringr)
library(data.table)
library(dplyr)
library(arules)

############################################################
################# basic utility function ###################

jaehyeon-kim

README is empty

jaehyeon-kim

README is empty

jaehyeon-kim

**** Web Server (UI)
ShinyProxy
https://github.com/openanalytics/shinyproxy
https://github.com/openanalytics/shinyproxy-demo
http://www.shinyproxy.io/

Modularizing Shiny app code - http://shiny.rstudio.com/articles/modules.html

http://stackoverflow.com/questions/25306519/shiny-saving-url-state-subpages-and-tabs