Skip to content

Instantly share code, notes, and snippets.

@winse
winse / BaseExcelExportHandler.java
Created March 14, 2014 16:05
将数据库的层级结构导出为excel
package com.gdcn.bpaf.urms.web.handle;
import java.io.Closeable;
import java.io.IOException;
import java.io.OutputStream;
import java.text.DateFormat;
import java.text.SimpleDateFormat;
import java.util.Calendar;
import java.util.Date;
@winse
winse / run-on-hadoop
Last active August 29, 2015 13:57
Ant实现run-on-hadoop的功能。先打包jar,然后把jar路径赋值给mapred.jar。
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<project basedir="." default="run" name="run-on-hadoop">
<property environment="env"/>
<property name="fs.default.name" value="hdfs://192.168.0.205:9000" />
<property name="mapred.job.tracker" value="h205:9001" />
<property name="HADOOP_HOME" value="C:/cygwin/home/Winseliu/hadoop-1.0.0" />
@winse
winse / excel.deleteSameAsRowFirstCell.vb
Last active August 29, 2015 14:01
excel行数据处理,去掉行内与第一列数据相同的单元格
Sub 处理行内去掉与第一列相同的数据()
' 整个过程使用:
'
' 1. 选中需要转换的数据区域
' 2. 点击宏
'
Dim sel As Variant
Set sel = Selection
@winse
winse / PurePrime.java
Created May 31, 2014 09:56
求单纯质因数的合数
package com.github.winse;
import java.util.Arrays;
import java.util.BitSet;
import java.util.LinkedList;
import java.util.List;
/**
*
* 单纯质因数的合数
@winse
winse / filesystem-cache-find-bug.btrace.java
Last active August 29, 2015 14:02
查找hive-0.12.0的filesystem问题的btrace的类。[HIVE-4501](https://issues.apache.org/jira/browse/HIVE-4501)
package com.github.winse.btrace;
/* BTrace Script Template */
import static com.sun.btrace.BTraceUtils.jstack;
import static com.sun.btrace.BTraceUtils.name;
import static com.sun.btrace.BTraceUtils.print;
import static com.sun.btrace.BTraceUtils.printArray;
import static com.sun.btrace.BTraceUtils.println;
import static com.sun.btrace.BTraceUtils.probeClass;
import static com.sun.btrace.BTraceUtils.probeMethod;
@winse
winse / ha.active.sh
Created June 18, 2014 10:58
hadoop-ha一台master挂了后,强制active另一台机
[hadoop@hadoop-master1 ~]$ hdfs haadmin -transitionToActive --forcemanual nn1
You have specified the forcemanual flag. This flag is dangerous, as it can induce a split-brain scenario that WILL CORRUPT your HDFS namespace, possibly irrecoverably.
It is recommended not to use this flag, but instead to shut down the cluster and disable automatic failover if you prefer to manually manage your HA state.
You may abort safely by answering 'n' or hitting ^C now.
Are you sure you want to continue? (Y or N) Y
14/06/18 10:43:18 WARN ha.HAAdmin: Proceeding with manual HA state management even though
automatic failover is enabled for NameNode at hadoop-master1/192.168.32.11:8020
@winse
winse / tar.test.sh
Created June 20, 2014 05:28
tar解压(过滤)部分文件: --exclude=XXX, XXX
[hadoop@localhost tmp]$ tar zcvf test.tar.gz .
./
./c/
./c/1/
./c/1/2/
./b/
./b/1/
./b/1/2/
./a/
./a/1/
@winse
winse / tar.remote.sh
Last active August 29, 2015 14:02
一气呵成把tar文件上传到服务器,同时在服务器解压,同时过滤部分文件
winse@Lenovo-PC /cygdrive/e/local/opt
$ ssh hadoop@cluster ' cat | tar zxf - --exclude=sources --exclude=doc --exclude=*.cmd ' < ./hadoop-2.2.0.tar.gz
winse@Lenovo-PC /cygdrive/e/local/opt
$ ssh root@cluster ' cat | tar zxf - ' < ./jdk-7u60-linux-i586.gz
@winse
winse / ambari.public.log.sh
Last active August 29, 2015 14:02
Centos-x86使用public源安装ambari,server安装没问题,但是找不到agent!
winse@Lenovo-PC ~
$ ssh root@cluster
Last login: Sat Jun 21 20:54:19 2014 from 192.168.154.1
[root@localhost ~]# cd /etc/yum.repos.d/
[root@localhost yum.repos.d]# wget http://public-repo-1.hortonworks.com/ambari/c entos6/1.x/updates/1.6.0/ambari.repo
--2014-06-21 21:36:44-- http://public-repo-1.hortonworks.com/ambari/centos6/1.x /updates/1.6.0/ambari.repo
Resolving public-repo-1.hortonworks.com... 54.230.234.103, 54.230.234.83, 54.230.234.203, ...
Connecting to public-repo-1.hortonworks.com|54.230.234.103|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1074 (1.0K) [binary/octet-stream]
@winse
winse / X64-build-hadoop.shell.sh
Last active August 29, 2015 14:02
CentOS-X64编译hadoop-2.2.0
# root用户操作
apache-maven-3.0.4
jdk1.7.0_60
apache-ant-1.9.2
vim /etc/profile
source /etc/profile
## 节约点下载的时间,直接共享使用主机的maven数据