Skip to content

Instantly share code, notes, and snippets.

View Jammink2's full-sized avatar

John Hammink Jammink2

View GitHub Profile
@Jammink2
Jammink2 / gist:172b5ffa320ee4a050e22b4ab92f2b9a
Last active April 12, 2016 23:18
Guess the format of the incoming Salesforce data:
td connector:guess accounts.yml -o account_output.yml
@Jammink2
Jammink2 / gist:9c7a33acb19510360bb0873c63b9e1ed
Last active April 12, 2016 23:19
Load your (SF) data into Treasure Data
td connector:issue account_output.yml --database sfdc --table account --time-column createddate
@Jammink2
Jammink2 / bc_desc_from_SF.sql
Created April 8, 2016 22:17
Billingcity, Description, from SF data
select billingcity, description from account limit 100
@Jammink2
Jammink2 / gist:a2b789503f332d0495f3a754d202eb21
Last active April 12, 2016 23:16
Count Number of Records Elasticsearch
curl --ipv4 -XGET <external_IP_Address_for Elasticsearch_EC2_instance>:9200/_count
@Jammink2
Jammink2 / gist:c091c6584bf399e89d8b03eddc132726
Created April 8, 2016 22:29
Query all your records Elasticsearch
curl --ipv4 -XGET <external_EC2_IP>:9200/_search -d '{
"query": {
"match_all": {}
}
}
'
@Jammink2
Jammink2 / gist:895029536e2f6fe9eb652542ba6d5d9d
Created April 8, 2016 22:31
Query within a single index Elasticsearch
curl -X GET 'http://<external_EC2_IP>:9200/descriptions_by_city'
td db:create <database_name>
td table:create <database_name> <table_name>
URL: http://in.treasuredata.com/postback/v3/event/<database_name>/<table_name>
Payload Type: Json
Wrap Request in Array: No
Unflatten: yes
Headers:
Content-Type: application/json
X-TD-Write-Key: <your_Treasure_Data_Write_API_Key>
td query -d googledocs "select gsx_userid, gsx_lastname, gsx_streetname, gsx_city, gsx_zip from sheet"
td job:show <JOB_ID_NUMBER>