Skip to content

Instantly share code, notes, and snippets.

@oeegee
oeegee / macOS_thunderbolt3_enable.md
Created March 10, 2020 06:57
How to enable windows's thunderbolt3 device on macOS

How to enable windows's thunderbolt3 device on macOS

This solution is how to succeed in macOS Catalina 10.15.3 (19D76).

Dell TB16 Dock on Macbook Pro Thunderbolt does not work (macOS = 10.15.x)

Nice meet you and this page is @tomjyoutwit's update version!! (https://superuser.com/a/1354399/1147451)

Please follow this manual process carefully. It worked for me but i'm yet to get the display(s) working, but you may have more luck using the other display outputs on the dock.

@oeegee
oeegee / Zeppelin Open Source 기여 방법
Last active February 5, 2024 21:27
Zeppelin Open Source 기여 방법
부록 A Zeppelin Open Source 기여 방법
나에게 필요한 기능 구현 또는 버그를 개선하고 싶다면 - jira 확인
[이슈검색 하기]
오래전에 fork 해두었다면, 여기 참조 http://www.notforme.kr/archives/1631
+ jira 이슈 고르기 (쉬운 것부터)
기능개발 또는 버그픽스
@oeegee
oeegee / DotProduct.scala
Created January 31, 2018 15:49 — forked from samklr/DotProduct.scala
DotProduct matrix in scala and on spark
def dotProduct(vector: Array[Int], matrix: Array[Array[Int]]): Array[Int] = {
// ignore dimensionality checks for simplicity of example
(0 to (matrix(0).size - 1)).toArray.map( colIdx => {
val colVec: Array[Int] = matrix.map( rowVec => rowVec(colIdx) )
val elemWiseProd: Array[Int] = (vector zip colVec).map( entryTuple => entryTuple._1 * entryTuple._2 )
elemWiseProd.sum
} )
}
@oeegee
oeegee / MovieSimilarities.scala
Created January 31, 2018 05:01 — forked from MLnick/MovieSimilarities.scala
Movie Similarities with Spark
import spark.SparkContext
import SparkContext._
/**
* A port of [[http://blog.echen.me/2012/02/09/movie-recommendations-and-more-via-mapreduce-and-scalding/]]
* to Spark.
* Uses movie ratings data from MovieLens 100k dataset found at [[http://www.grouplens.org/node/73]]
*/
object MovieSimilarities {
@oeegee
oeegee / Redis Cluster 설치 (3 Master 3 Slave)
Created November 22, 2017 12:47
Redis Cluster 설치 (3 Master/3 Slave)
개발서버에 Redis 를 구성해보자
Redis Cluster가 나온지 어언 1년이 넘었다.
이제 사용할만하다는 소문이 들린다.
구성 참조 : https://www.linode.com/docs/applications/big-data/how-to-install-and-configure-a-redis-cluster-on-ubuntu-1604
(Ubuntu 버전이지만, 그래도 괜찮아~)
http://redisgate.com/redis/configuration/persistence.php (한국어)
http://intro2libsys.com/focused-redis-topics/day-one/intro-redis-cluster
@oeegee
oeegee / install-docker-postgres-xl.md
Last active November 6, 2017 14:29
윈도우즈기반 도커에 postgres-xl 설치하기

윈도우즈기반 도커에 postgres-xl 설치하기

* 빅데이터용 RDBMS가 필요해!

추천시스템을 제공하기위해서 대규모 데이터를 핸들링하기 위한 RDBMS가 필요했습니다. (이 글을 보시는 분들께,,, 가급적 Parquet 또는 다른 하둡 에코를 이용하시는게 정신건강에 이롭습니다.)

찾아본 솔루션은 다음과 같습니다.

  • Cockroach DB : Raft 합의알고리즘채택으로 가장 많이 기대하고 사용해 봤으나, 1천만 건 테이블 Join 시 killed. 적은 건수는 잘 됨. (go로 개발되었는데, 메모리 할당할 때 문제가 생기는 듯...)
  • Pivotal Greenplum : Postgres 버전이 낮음. v8.3 (버전관리 안하고있는듯...)
  • Citusdata : 꼭 상용 솔루션을 써야만 될것 같은 느낌적인 느낌! Postgresql V10 지원. (개인적으로는 가장 나이스해 보입니다.)
#!/bin/bash
# Minimum TODOs on a per job basis:
# 1. define name, application jar path, main class, queue and log4j-yarn.properties path
# 2. remove properties not applicable to your Spark version (Spark 1.x vs. Spark 2.x)
# 3. tweak num_executors, executor_memory (+ overhead), and backpressure settings
# the two most important settings:
num_executors=6
executor_memory=3g
#!/bin/sh
BOOT2DOCKER_CERTS_DIR=/var/lib/boot2docker/certs
CERTS_DIR=/etc/ssl/certs
CAFILE=${CERTS_DIR}/ca-certificates.crt
for cert in $(/bin/ls -1 ${BOOT2DOCKER_CERTS_DIR}); do
SRC_CERT_FILE=${BOOT2DOCKER_CERTS_DIR}/${cert}
CERT_FILE=${CERTS_DIR}/${cert}
HASH_FILE=${CERTS_DIR}/$(/usr/local/bin/openssl x509 -noout -hash -in ${SRC_CERT_FILE} 2>/dev/null)
@oeegee
oeegee / openshift-testmongo.txt
Last active December 20, 2015 19:29
OpenShift/testmongo 생성 JBoss User Group - WildFly 스터디 (최성훈님 강의 참조)
[rhc client tool 설치]
https://www.openshift.com/developers/rhc-client-tools-install
[ssh public key 생성]
http://git-scm.com/book/ko/Git-%EC%84%9C%EB%B2%84-SSH-%EA%B3%B5%EA%B0%9C%ED%82%A4-%EB%A7%8C%EB%93%A4%EA%B8%B0
https://www.openshift.com/developers/remote-access#keys
[Application 생성/설치]
https://github.com/openshift/jbossas-mongoDB-quickstart