Skip to content

Instantly share code, notes, and snippets.

View sathiyarajanm's full-sized avatar

sathiyarajanm

View GitHub Profile
@bradtraversy
bradtraversy / docker-help.md
Last active May 4, 2024 14:32
Docker Commands, Help & Tips

Docker Commands, Help & Tips

Show commands & management commands

$ docker

Docker version info

@brandonsoto
brandonsoto / Vagrantfile
Created February 28, 2017 04:47
RHEL7.3 vagrantfile
# -*- mode: ruby -*-
# vi: set ft=ruby :
required_plugins = %w(vagrant-share vagrant-registration)
plugins_to_install = required_plugins.select { |plugin| not Vagrant.has_plugin? plugin }
if not plugins_to_install.empty?
puts "Installing plugins: #{plugins_to_install.join(' ')}"
if system "vagrant plugin install #{plugins_to_install.join(' ')}"
exec "vagrant #{ARGV.join(' ')}"

Overview

Hive is designed to enable easy data summarization and ad-hoc analysis of large volumes of data. It uses a query language called Hive-QL which is similar to SQL.

In this tutorial, we will explore the following:

  1. Load a data file into a Hive table
  2. Create a table using RCFormat
  3. Query tables
  4. Managed tables vs external tables
@v5tech
v5tech / Sqoop-RDBMS-to-Hadoop.md
Last active May 25, 2020 17:44
Sqoop - Data transfer tool from RDBMS to Hadoop Box

TO IMPORT & EXPORT DATA FROM RDBMS (MYSQL,ORACLE, etc) INTO HDFS / HIVE / HBASE

Pre-requisite

Apache Hadoop

Apache Sqoop (compatible with Hadoop version)

Apache Hive (optional)

@donigian
donigian / gist:3835055
Created October 4, 2012 17:16
Hadoop File System Commands
Hadoop File System Commands
Syntax Overview
The basic syntax of HDFS commands is as follows:
$ hadoop fs -command [extra arguments]
For example:
$ hadoop fs -ls