Skip to content

Instantly share code, notes, and snippets.


Ranjit ranjitiyer

View GitHub Profile
View emr-steps
Hadoop Streaming step
"jobFlowId": "j-1JKGNMYXT59DP",
"steps": [
"name": "EMRHadoopLogPushingTest",
"actionOnFailure": "CANCEL_AND_WAIT",
"hadoopJarStep": {
"jar": "command-runner.jar",
# submit a step to run a command on a cluster
AWS_PROFILE=integ-preprod aws emr add-steps \
--cluster-id j-32M91WVU0V1OR \
--steps Name="Create table",ActionOnFailure=CONTINUE,Jar=command-runner.jar,Args=[beeline,-u,jdbc:hive2://,-n,admin,-p,admin,-e,"create table d417f3333(id INT, value STRING);"] --region us-east-1 --endpoint --no-verify
db = 'test.db'
table = 'Table'
releaseLabel = "releaseLabel"
applicationString = "applicationString"
account = "account"
creationDate = "creationDate"
def create_table(overwrite: bool):
if overwrite and table_exists(table):
t is response of gmtime() or localtime()
time.clock_gettime(clk_id) > float
time.clock_gettime_ns(clk_id) > float
# Returns the response in this format
View book.json
"id": 56,
"title": "Secret Garden",
"description": "Mary Lennox is a spoiled, middle-class, self-centred child who has been recently orphaned. She is accepted into the quiet and remote country house of an uncle, who has almost completely withdrawn into himself after the death of his wife. Mary gradually becomes drawn into the hidden side of the house: why does she hear the crying of a unseen child? Why is there an overgrown, walled garden, its door long locked? (Summary by Peter)",
"num_sections": 27,
"sections": {
"1": {
"number": 1,
"name": "01 - There Is No One Left",
"url": ""
ranjitiyer / gist:a46fdbf854a015c20ee37104c442322b
Created Jun 21, 2018
Find important files in a project by looking at historic commits
View gist:a46fdbf854a015c20ee37104c442322b
git log --oneline | awk '{print $1}' | xargs git show | grep "diff" | awk '{print $3}' | sort | uniq -c | sort -nr | more
View gist:bcda4fb8f9e15ffea28f22b5083ec634
git log --oneline --graph --decorate --all
View gist:4fdfaa1ec3a6a4c6cc969218be902da9
export PS1="\@ \w $(if [[ -e .gitignore ]]; then git branch | head -n 1 | awk '{print $2}'; fi) > "
Prints time in am/pm, the current working directory and the checked out gitbranch if pwd is a git repo
01:39 PM ~/work/emr/sparkmagic jupyter >
View gist:a58baf13f0807e7a8480ce3ae877d1e4
[[Title >>]]
Review Vanguard requirements
{{toc numbered="true" /}}
* item
** subitem
ranjitiyer / sh
Created Apr 11, 2018
Linux Administration
View sh
# Source
# Display Linux system information
uname -a
# Display kernel release information
uname -r