ranjitiyer

 git log --oneline | awk '{print $1}' | xargs git show | grep "diff" | awk '{print $3}' | sort | uniq -c | sort -nr | more

ranjitiyer

{
  "id": 56,
  "title": "Secret Garden",
  "description": "Mary Lennox is a spoiled, middle-class, self-centred child who has been recently orphaned. She is accepted into the quiet and remote country house of an uncle, who has almost completely withdrawn into himself after the death of his wife. Mary gradually becomes drawn into the hidden side of the house: why does she hear the crying of a unseen child? Why is there an overgrown, walled garden, its door long locked? (Summary by Peter)",
  "num_sections": 27,
  "sections": {
    "1": {
      "number": 1,
      "name": "01 - There Is No One Left",
      "url": "https://ia600204.us.archive.org/15/items/secret_garden_version2_librivox/secretgarden_01_burnett_64kb.mp3"

ranjitiyer

time.asctime([t])
t is response of gmtime() or localtime()

time.clock()

time.clock_gettime(clk_id) > float

time.clock_gettime_ns(clk_id) > float

# Returns the response in this format

ranjitiyer

db = 'test.db'
table = 'Table'

releaseLabel = "releaseLabel"
applicationString = "applicationString"
account = "account"
creationDate = "creationDate"

def create_table(overwrite: bool):
  if overwrite and table_exists(table):

ranjitiyer

# submit a step to run a command on a cluster
AWS_PROFILE=integ-preprod aws emr add-steps \
--cluster-id j-32M91WVU0V1OR \
--steps Name="Create table",ActionOnFailure=CONTINUE,Jar=command-runner.jar,Args=[beeline,-u,jdbc:hive2://ec2-52-91-119-206.compute-1.amazonaws.com:10000,-n,admin,-p,admin,-e,"create table d417f3333(id INT, value STRING);"] --region us-east-1 --endpoint https://emr-preprod-us-east-1.amazon.com --no-verify

ranjitiyer

Hadoop Streaming step

{
  "jobFlowId": "j-1JKGNMYXT59DP",
  "steps": [
    {
      "name": "EMRHadoopLogPushingTest",
      "actionOnFailure": "CANCEL_AND_WAIT",
      "hadoopJarStep": {
        "jar": "command-runner.jar",

ranjitiyer

> help
** command list **
connectors                -- list available connectors and transports in this VM

run [class [args]]        -- start execution of application's main class

threads [threadgroup]     -- list threads
thread <thread id>        -- set default thread
suspend [thread id(s)]    -- suspend threads (default: all)
resume [thread id(s)]     -- resume threads (default: all)