Skip to content

Instantly share code, notes, and snippets.

View kzhangkzhang's full-sized avatar

Kevin Zhang kzhangkzhang

View GitHub Profile
@kzhangkzhang
kzhangkzhang / BIGDATA_HIVE_hiverc.md
Last active November 3, 2018 01:26
Example HiveRC File to configure Hive Preference

What is HiveRC file?

It is a file that is executed when you launch the hive shell - making it an ideal place for adding any hive configuration/customization you want set, on start of the hive shell. This could be:

  • Setting column headers to be visible in query results
  • Making the current database name part of the hive prompt
  • Adding any jars or files
  • Registering UDFs

When you should consider to create and use HiveRC file?

@kzhangkzhang
kzhangkzhang / BIGDATA_HIVE_setting.md
Last active November 6, 2018 03:24
common Hive setting cheat sheet

Common Hiving Setting group by category

Dynamic Partition

Enable/Disable dynmaic partition inserts

  • hive.exec.dyanamic.partition=true

    ==> whether or not to allow dynamic partitions in DML/DDL

@kzhangkzhang
kzhangkzhang / BIGDATA_HIVE_CLI.md
Last active November 3, 2018 03:12
Hive Common Line Cheat Sheet

This document the common usage of the HIVE command line

Run Query

hive -e 'SELECT a.col from tabl1 a'

Run Query in Silent mode

@kzhangkzhang
kzhangkzhang / BIGDATA_HIVE_Syntax.md
Last active April 13, 2024 03:27
Hive Syntax Cheat Sheet

Big Data Cheat Sheet

Support\Big Data\BigData_CheatSheet.md

HDFS

-- list files in HDFS
hadoop fs -ls <PATH_OF_DIRECTORY>
@kzhangkzhang
kzhangkzhang / BIGDATA_Pig.md
Last active October 9, 2019 13:36
Cheat Sheet for Big Data Pig Programming & Pig Latin

Apache Pig Cheatsheet

Example Script

Example 1: Load data file into HDFS

Example source: Take Ctl of Your BigData with Hue in Cloudera CDH (Xavier Morera, PluralSight)

mytags = LOAD 'stackexchange/tags-no-header.csv' USING PigStorage(',') as (Id,TagName,CountTags:int,ExcerptPostId,WikiPostId);
@kzhangkzhang
kzhangkzhang / BIGDATA_Python_ETL.md
Last active October 10, 2019 17:47
Python script example for Big Data ETL

Python for Big Data ETL

Example 1 - transfer XML data file to CSV data file

  • Python version: 2.x, 3.x

  • Sample input data: Tags.xml

    <?xml version="1.0" encoding="utf-8"?>
@kzhangkzhang
kzhangkzhang / WEB_Javascript_A.md
Last active February 22, 2024 20:49
Cheat sheet for modern (ES6) Javascript, part A

Modern JavaScript Cheat Sheet - Part A

Support\Web_Cloud\WEB_Javascript_A.md

Constant

  • Constant must be initialized and value can't be changed (for primitive type)
  • By convention, constant variable shuold be UPPERCASE
@kzhangkzhang
kzhangkzhang / WEB_Javascript_B.md
Last active February 22, 2024 20:50
Modern Javascript (ES6) cheat sheet part B

Modern JavaScript Cheat Sheet - Part B

Support\Web_Cloud\WEB_Javascript_B.md

Classes and Modules

Class Basics

- using CamelCase convention for naming class
  • first letter is UPPERCASE

Oracle APEX Cheat Sheet

Support\APEX\APEX_CheatSheet.md

ORDS

How to check APEX version?

http://myapexserver.mycompany.com:8087/i/apex_version.txt -- result Application

Markdown Cheat Sheet

WebDev\KevinPractice\Youtube\TraversyMedia\026_Markdown_CrashCourse

Heading 1