Skip to content

Instantly share code, notes, and snippets.

View avaranovich's full-sized avatar

Andrei Varanovich avaranovich

12 followers · 2 following
View GitHub Profile
@avaranovich
avaranovich / error
Created November 29, 2017 11:03
---------------------------------------------------------------------------
Py4JJavaError Traceback (most recent call last)
<command-634889928058462> in <module>()
17 #display(df.limit(5))
18
---> 19 toCSV = filter(None, list(map(xml_to_dict, xml.collect())))
20 keys = toCSV[0].keys()
21 #print(keys)
/databricks/spark/python/pyspark/rdd.py in collect(self)
@avaranovich
avaranovich / test-job.yaml
Created January 15, 2017 16:01
apiVersion: batch/v2alpha1
kind: CronJob
metadata:
name: hello
spec:
schedule: "*/1 * * * *"
jobTemplate:
spec:
template:
spec:
@avaranovich
avaranovich / kubernetesmastercustomdata.yml
Last active January 15, 2017 15:56
#cloud-config
# { { { variable } } }
packages:
- etcd
- jq
- traceroute
runcmd:
@avaranovich
avaranovich / seup.sh
Created June 16, 2016 07:43
bash ; source var.sh ; source start.sh ; source create.sh
@avaranovich
avaranovich / playframework
Created April 21, 2014 17:10 — forked from domdorn/playframework
# Upstart script for a play application that binds to an unprivileged user.
# put this into a file like /etc/init/playframework
# you can then start/stop it using either initctl or start/stop/restart
# e.g.
# start playframework
# http://dominikdorn.com
description "Description of your app"
author "Dominik Dorn <dominik@studyguru.eu>"
version "1.0"
@avaranovich
avaranovich / install-akka.sh
Last active August 29, 2015 14:00
sudo echo 'AKKA_HOME=/usr/local/akka/akka-2.3.2' > /etc/profile.d/akka.sh
sudo echo 'export AKKA_HOME' >> /etc/profile.d/akka.sh
sudo mkdir -p /usr/local/akka
sudo unzip akka-2.3.2 -d /usr/local/akka/
sudo rm -f akka-2.3.2.zip
sudo chown -R root:root /usr/local/akka
sudo update-alternatives --install "/usr/bin/akka" "akka" "/usr/local/akka/akka-2.3.2/bin/akka" 1
@avaranovich
avaranovich / rails4
Last active December 24, 2015 08:09
source 'https://rubygems.org'
gem "rails", "~> 4.0.0"
gem 'rake', '~> 10.1.0'
# Bundle edge Rails instead:
# gem 'rails', :git => 'git://github.com/rails/rails.git'
gem 'json'
@avaranovich
avaranovich / libhdfs compile error
Created May 4, 2013 10:54
compile-c++-libhdfs:
[exec] /bin/sh ./libtool --tag=CC --mode=compile gcc -DPACKAGE_NAME=\"libhdfs\" -DPACKAGE_TARNAME=\"libhdfs\" -DPACKAGE_VERSION=\"0.1.0\" -DPACKAGE_STRING=\"libhdfs\ 0.1.0\" -DPACKAGE_BUGREPORT=\"omalley@apache.org\" -DPACKAGE_URL=\"\" -DPACKAGE=\"libhdfs\" -DVERSION=\"0.1.0\" -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_MEMORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DHAVE_DLFCN_H=1 -DLT_OBJDIR=\".libs/\" -DHAVE_STRDUP=1 -DHAVE_STRERROR=1 -DHAVE_STRTOUL=1 -DHAVE_FCNTL_H=1 -DHAVE__BOOL=1 -I. -I/Users/avaranovich/projects/hadoop/src/c++/libhdfs -g -O2 -DOS_DARWIN -DDSO_DYLD -DCPU=\"i386\" -m64 -I/System/Library/Frameworks/JavaVM.framework/Versions/A/Headers -Wall -Wstrict-prototypes -MT hdfsJniHelper.lo -MD -MP -MF .deps/hdfsJniHelper.Tpo -c -o hdfsJniHelper.lo /Users/avaranovich/projects/hadoop/src/c++/libhdfs/hdfsJniHelper.c
[exec] libtool: compile: gcc -DPACKAGE_NAME=\"libhdfs
@avaranovich
avaranovich / hadoop.sh
Last active December 16, 2015 22:39
Download and Build Hadoop distribution for MacOs
wget http://archive.cloudera.com/cdh/3/hadoop-0.20.2-cdh3u6.tar.gz
tar -xzvf hadoop-0.20.2-cdh3u6.tar.gz
mv hadoop-0.20.2-cdh3u6 hadoop
cd hadoop; ant compile -Dcompile.c++=true -Dlibhdfs=true
@avaranovich
avaranovich / gist:5318202
Last active April 7, 2022 06:00
Install VMWare Tools on Ubuntu
sudo apt-get -y update
sudo apt-get -y upgrade
sudo mkdir -p /media/cdrom
sudo mount /dev/cdrom /media/cdrom
cd /media/cdrom
sudo cp VM*.tar.gz /tmp
sudo apt-get -y install linux-headers-server build-essential
cd /tmp
tar -xzvf VM*.tar.gz