Skip to content

Instantly share code, notes, and snippets.

View Sathiyarajan's full-sized avatar
:octocat:
I may be slow to respond.

sathyadev Sathiyarajan

:octocat:
I may be slow to respond.
View GitHub Profile
@Sathiyarajan
Sathiyarajan / Spark SQL with Scala using mySQL (JDBC) data source
Created February 2, 2018 10:53 — forked from tmcgrath/Spark SQL with Scala using mySQL (JDBC) data source
Using Spark Console, connect and query a mySQL database. This is applicable to any database with JDBC driver though
todd-mcgraths-macbook-pro:spark-1.4.1-bin-hadoop2.4 toddmcgrath$ bin/spark-shell --jars mysql-connector-java-5.1.38-bin.jar
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.4.1
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_66)
Type in expressions to have them evaluated.
@anthonyclarka2
anthonyclarka2 / Vagrantfile
Created August 28, 2017 16:13
Vagrantfile that sets up multiple CentOS 7 VMs and connects them all to a single host-only network
# -*- mode: ruby -*-
# vi: set ft=ruby :
#
# Vagrantfile to create a CentOS 7 master and 3 nodes
#
# These VMs can be useful for prototyping new systems such
# as monitoring, mail, configuration management, load balancing
# etc etc.
#
# You will need a Puppet directory structure inside the
# 1 : Instructions
# Connect to the MySQL database on the itversity labs using sqoop and import all of the data from the orders table into HDFS
# Data Description
# A MySQL instance is running on a remote node ms.itversity.com in the instance. You will find a table that contains 68883 rows of orders data
# MySQL database information:
@gonzaloplaza
gonzaloplaza / minikube_ubuntu_installation.md
Last active February 17, 2022 06:14
Minikube installation on Ubuntu 16.04 LTS

Minikube Installation on Ubuntu 16.04 LTS

Overview:

  1. Install hypervisor (Virtualbox)
  2. Get and install Kubectl (repositories)
  3. Get and install Minikube last version
  4. Start and Test Minikube local cluster and expose demo service

Install VirtualBox hypervisor

# Install R + RStudio on Ubuntu 16.04
sudo apt-key adv –keyserver keyserver.ubuntu.com –recv-keys E084DAB9
# Ubuntu 12.04: precise
# Ubuntu 14.04: trusty
# Ubuntu 16.04: xenial
# Basic format of next line deb https://<my.favorite.cran.mirror>/bin/linux/ubuntu <enter your ubuntu version>/
sudo add-apt-repository 'deb https://ftp.ussg.iu.edu/CRAN/bin/linux/ubuntu xenial/'
sudo apt-get update
@gsitgithub
gsitgithub / find-currupt-jars.txt
Created November 7, 2016 05:07
maven: Find corrupted jar files
run this in .m2 files
it lists all the corrupted jar files in the repository
find /home/me/.m2/repository/ -name "*jar" | xargs -L 1 zip -T | grep error | grep invalid
To resolve them , delete them first and re run the build or run
@perrygeo
perrygeo / TODO
Last active December 31, 2022 21:24
Ansible playbook for a full dev environment
TODO
implement security measures
git config
config files
full sublimetext config
set up openvpn
rdesktop and network drive to terra
set up evolution
RStudio
@abdallahokasha
abdallahokasha / Install_robo3t_Ubuntu.md
Last active September 24, 2023 14:54
Install Robo3t on Ubuntu18.04 and make a desktop icon for it

Install Robo3t On Ubuntu 18.04

Download the package form Robo3t or using wget
wget https://download.robomongo.org/1.2.1/linux/robo3t-1.2.1-linux-x86_64-3e50a65.tar.gz
Extract here using

tar -xvzf robo3t-1.2.1-linux-x86_64-3e50a65.tar.gz

@airawat
airawat / 00-OozieWorkflowSqoopAction
Last active January 20, 2024 07:08
Oozie workflow application with sqoop action Pipes data from Hive table to mysql database table Oozie 3.3.0; Sqoop (1.4.2) with Mysql (5.1.69 )
This gist includes components of a simple workflow application (oozie 3.3.0) that
pipes data in a Hive table to mysql;
The sample application includes:
--------------------------------
1. Oozie actions: sqoop action
2. Oozie workflow controls: start, end, and kill.
3. Workflow components: job.properties and workflow.xml
4. Sample data
5. Prep tasks in Hive
@edsiper
edsiper / kubernetes_commands.md
Last active April 4, 2024 03:27
Kubernetes Useful Commands