Skip to content

Instantly share code, notes, and snippets.

View Sathiyarajan's full-sized avatar
:octocat:
I may be slow to respond.

sathyadev Sathiyarajan

:octocat:
I may be slow to respond.
View GitHub Profile
@airawat
airawat / 00-OozieWorkflowSqoopAction
Last active January 20, 2024 07:08
Oozie workflow application with sqoop action Pipes data from Hive table to mysql database table Oozie 3.3.0; Sqoop (1.4.2) with Mysql (5.1.69 )
This gist includes components of a simple workflow application (oozie 3.3.0) that
pipes data in a Hive table to mysql;
The sample application includes:
--------------------------------
1. Oozie actions: sqoop action
2. Oozie workflow controls: start, end, and kill.
3. Workflow components: job.properties and workflow.xml
4. Sample data
5. Prep tasks in Hive
@perrygeo
perrygeo / TODO
Last active December 31, 2022 21:24
Ansible playbook for a full dev environment
TODO
implement security measures
git config
config files
full sublimetext config
set up openvpn
rdesktop and network drive to terra
set up evolution
RStudio
@tsiege
tsiege / The Technical Interview Cheat Sheet.md
Last active April 20, 2024 16:52
This is my technical interview cheat sheet. Feel free to fork it or do whatever you want with it. PLEASE let me know if there are any errors or if anything crucial is missing. I will add more links soon.

ANNOUNCEMENT

I have moved this over to the Tech Interview Cheat Sheet Repo and has been expanded and even has code challenges you can run and practice against!






\

@gsitgithub
gsitgithub / find-currupt-jars.txt
Created November 7, 2016 05:07
maven: Find corrupted jar files
run this in .m2 files
it lists all the corrupted jar files in the repository
find /home/me/.m2/repository/ -name "*jar" | xargs -L 1 zip -T | grep error | grep invalid
To resolve them , delete them first and re run the build or run
# Install R + RStudio on Ubuntu 16.04
sudo apt-key adv –keyserver keyserver.ubuntu.com –recv-keys E084DAB9
# Ubuntu 12.04: precise
# Ubuntu 14.04: trusty
# Ubuntu 16.04: xenial
# Basic format of next line deb https://<my.favorite.cran.mirror>/bin/linux/ubuntu <enter your ubuntu version>/
sudo add-apt-repository 'deb https://ftp.ussg.iu.edu/CRAN/bin/linux/ubuntu xenial/'
sudo apt-get update
@anthonyclarka2
anthonyclarka2 / Vagrantfile
Created August 28, 2017 16:13
Vagrantfile that sets up multiple CentOS 7 VMs and connects them all to a single host-only network
# -*- mode: ruby -*-
# vi: set ft=ruby :
#
# Vagrantfile to create a CentOS 7 master and 3 nodes
#
# These VMs can be useful for prototyping new systems such
# as monitoring, mail, configuration management, load balancing
# etc etc.
#
# You will need a Puppet directory structure inside the
@edsiper
edsiper / kubernetes_commands.md
Last active April 4, 2024 03:27
Kubernetes Useful Commands
@Sathiyarajan
Sathiyarajan / Spark SQL with Scala using mySQL (JDBC) data source
Created February 2, 2018 10:53 — forked from tmcgrath/Spark SQL with Scala using mySQL (JDBC) data source
Using Spark Console, connect and query a mySQL database. This is applicable to any database with JDBC driver though
todd-mcgraths-macbook-pro:spark-1.4.1-bin-hadoop2.4 toddmcgrath$ bin/spark-shell --jars mysql-connector-java-5.1.38-bin.jar
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.4.1
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_66)
Type in expressions to have them evaluated.
@merikan
merikan / Jenkinsfile
Last active April 27, 2024 03:58
Some Jenkinsfile examples
Some Jenkinsfile examples
@gonzaloplaza
gonzaloplaza / minikube_ubuntu_installation.md
Last active February 17, 2022 06:14
Minikube installation on Ubuntu 16.04 LTS

Minikube Installation on Ubuntu 16.04 LTS

Overview:

  1. Install hypervisor (Virtualbox)
  2. Get and install Kubectl (repositories)
  3. Get and install Minikube last version
  4. Start and Test Minikube local cluster and expose demo service

Install VirtualBox hypervisor