Skip to content

Instantly share code, notes, and snippets.

🎯
Focusing

Ranjit ranjitiyer

🎯
Focusing
Block or report user

Report or block ranjitiyer

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
View emr-steps
Hadoop Streaming step
{
"jobFlowId": "j-1JKGNMYXT59DP",
"steps": [
{
"name": "EMRHadoopLogPushingTest",
"actionOnFailure": "CANCEL_AND_WAIT",
"hadoopJarStep": {
"jar": "command-runner.jar",
View emrsteps.sh
# submit a step to run a command on a cluster
AWS_PROFILE=integ-preprod aws emr add-steps \
--cluster-id j-32M91WVU0V1OR \
--steps Name="Create table",ActionOnFailure=CONTINUE,Jar=command-runner.jar,Args=[beeline,-u,jdbc:hive2://ec2-52-91-119-206.compute-1.amazonaws.com:10000,-n,admin,-p,admin,-e,"create table d417f3333(id INT, value STRING);"] --region us-east-1 --endpoint https://emr-preprod-us-east-1.amazon.com --no-verify
View sqllite-example.py
db = 'test.db'
table = 'Table'
releaseLabel = "releaseLabel"
applicationString = "applicationString"
account = "account"
creationDate = "creationDate"
def create_table(overwrite: bool):
if overwrite and table_exists(table):
View pydates.py
time.asctime([t])
t is response of gmtime() or localtime()
time.clock()
time.clock_gettime(clk_id) > float
time.clock_gettime_ns(clk_id) > float
# Returns the response in this format
View book.json
{
"id": 56,
"title": "Secret Garden",
"description": "Mary Lennox is a spoiled, middle-class, self-centred child who has been recently orphaned. She is accepted into the quiet and remote country house of an uncle, who has almost completely withdrawn into himself after the death of his wife. Mary gradually becomes drawn into the hidden side of the house: why does she hear the crying of a unseen child? Why is there an overgrown, walled garden, its door long locked? (Summary by Peter)",
"num_sections": 27,
"sections": {
"1": {
"number": 1,
"name": "01 - There Is No One Left",
"url": "https://ia600204.us.archive.org/15/items/secret_garden_version2_librivox/secretgarden_01_burnett_64kb.mp3"
@ranjitiyer
ranjitiyer / gist:a46fdbf854a015c20ee37104c442322b
Created Jun 21, 2018
Find important files in a project by looking at historic commits
View gist:a46fdbf854a015c20ee37104c442322b
git log --oneline | awk '{print $1}' | xargs git show | grep "diff" | awk '{print $3}' | sort | uniq -c | sort -nr | more
View gist:bcda4fb8f9e15ffea28f22b5083ec634
git log --oneline --graph --decorate --all
View gist:4fdfaa1ec3a6a4c6cc969218be902da9
export PS1="\@ \w $(if [[ -e .gitignore ]]; then git branch | head -n 1 | awk '{print $2}'; fi) > "
Prints time in am/pm, the current working directory and the checked out gitbranch if pwd is a git repo
01:39 PM ~/work/emr/sparkmagic jupyter >
View gist:a58baf13f0807e7a8480ce3ae877d1e4
[[Title >>https://aws.amazon.com/blogs/big-data/running-jupyter-notebook-and-jupyterhub-on-amazon-emr]]
Review Vanguard requirements
========
{{toc numbered="true" /}}
**bold**
* item
** subitem
@ranjitiyer
ranjitiyer / sh
Created Apr 11, 2018
Linux Administration
View sh
#
# Source https://www.linuxtrainingacademy.com/linux-commands-cheat-sheet/
#
– SYSTEM INFORMATION
# Display Linux system information
uname -a
# Display kernel release information
uname -r
You can’t perform that action at this time.