Skip to content

Instantly share code, notes, and snippets.

View evenX86's full-sized avatar
💭
I may be slow to respond.

xuyifei evenX86

💭
I may be slow to respond.
View GitHub Profile
@evenX86
evenX86 / .gitconfig
Created April 1, 2018 12:29 — forked from pksunkara/config
Sample of git config file (Example .gitconfig)
[user]
name = Pavan Kumar Sunkara
email = pavan.sss1991@gmail.com
username = pksunkara
[core]
editor = vim
whitespace = fix,-indent-with-non-tab,trailing-space,cr-at-eol
excludesfile = ~/.gitignore
[sendemail]
smtpencryption = tls
@evenX86
evenX86 / spark-submit.sh
Created October 12, 2016 03:03
spark-submit on yarn-cluster
#!/bin/bash
yesdate=`date -d yesterday +%Y%m%d`
#yesdate=20160928
/home/hadoop/spark/bin/spark-submit
--files "/home/hadoop/hadoop/etc/hadoop/core-site.xml,/home/hadoop/hadoop/etc/hadoop/hdfs-site.xml"
--master yarn --deploy-mode cluster
--jars /home/hadoop/job/mysql-connector-java-5.1.38.jar
--driver-class-path /home/hadoop/job/mysql-connector-java-5.1.38.jar
--class com.xx.xx.XXClass
--driver-memory 8g
@evenX86
evenX86 / redis_key_sizes.sh
Last active March 16, 2018 05:55 — forked from epicserve/redis_key_sizes.sh
A simple script to print the size of all your Redis keys.
#!/usr/bin/env bash
# This script prints out all of your Redis keys and their size in a human readable format
# Copyright 2013 Brent O'Connor
# License: http://www.apache.org/licenses/LICENSE-2.0
human_size() {
awk -v sum="$1" ' BEGIN {hum[1024^3]="Gb"; hum[1024^2]="Mb"; hum[1024]="Kb"; for (x=1024^3; x>=1024; x/=1024) { if (sum>=x) { printf "%.2f %s\n",sum/x,hum[x]; break; } } if (sum<1024) print "1kb"; } '
}
@evenX86
evenX86 / TestSync.java
Last active October 9, 2016 09:57
test synchronized static function and normal
class Sync {
public synchronized void x() throws InterruptedException {
System.out.println("x.......................start");
Thread.sleep(1000);
System.out.println("x.......................end");
}
public static synchronized void staticX() throws InterruptedException {
System.out.println("staticX.......................start");
Thread.sleep(1000);
@evenX86
evenX86 / AggArrayJava.java
Last active March 16, 2018 05:48
spark udaf to sum array by java
package udaf;
import org.apache.spark.sql.Row;
import org.apache.spark.sql.expressions.MutableAggregationBuffer;
import org.apache.spark.sql.expressions.UserDefinedAggregateFunction;
import org.apache.spark.sql.types.DataType;
import org.apache.spark.sql.types.DataTypes;
import org.apache.spark.sql.types.StructField;
import org.apache.spark.sql.types.StructType;
@evenX86
evenX86 / ruby.2.1.0-setup.sh
Created July 8, 2016 08:40 — forked from mustafaturan/ruby.2.6.3-setup.sh
ruby 2.1.0 setup for centos 6.x
#!/usr/bin/env bash
# repository
cd /tmp
wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
rpm -Uvh epel-release-6-8.noarch.rpm
# system update
yum -y update
yum -y groupinstall "Development Tools"
yum -y install libxslt-devel libyaml-devel libxml2-devel gdbm-devel libffi-devel zlib-devel openssl-devel libyaml-devel readline-devel curl-devel openssl-devel pcre-devel git memcached-devel valgrind-devel mysql-devel ImageMagick-devel ImageMagick
@evenX86
evenX86 / Java8DateTimeExamples.java
Created May 17, 2016 09:01 — forked from mscharhag/Java8DateTimeExamples.java
Examples for using the Java 8 Date and Time API (JSR 310)
import java.time.*;
import java.time.format.DateTimeFormatter;
import java.time.format.FormatStyle;
import java.time.temporal.ChronoUnit;
import java.time.temporal.TemporalAdjusters;
import java.util.*;
import static java.time.temporal.TemporalAdjusters.*;
public class Java8DateTimeExamples {