Skip to content

Instantly share code, notes, and snippets.

View hazzadous's full-sized avatar

Harry Waye hazzadous

View GitHub Profile
```
$ pytest ee/clickhouse/queries/test/test_paths.py -k test_path_by_grouping_replacement_multiple --log-cli-level=DEBUG -s | gawk '{ print strftime("[%Y-%m-%d %H:%M:%S]"), $0 }'
[2021-11-01 18:10:43] ============================= test session starts ==============================
[2021-11-01 18:10:43] platform darwin -- Python 3.9.4, pytest-6.2.2, py-1.10.0, pluggy-0.13.1
[2021-11-01 18:10:43] django: settings: posthog.settings (from ini)
[2021-11-01 18:10:43] rootdir: /Users/harry/src/posthog/posthog, configfile: pytest.ini
[2021-11-01 18:10:43] plugins: cov-2.12.1, celery-4.4.2, xdist-2.4.0, django-4.1.0, forked-1.3.0, mock-3.5.1
[2021-11-01 18:10:43] collected 40 items / 39 deselected / 1 selected
[2021-11-01 18:10:43]

Keybase proof

I hereby claim:

  • I am hazzadous on github.
  • I am hazzadous (https://keybase.io/hazzadous) on keybase.
  • I have a public key ASD348VvuhasZsyxh6Vc4WAfRiIklBVDi2gBshgIqXGAHwo

To claim this, I am signing this object:

{:timestamp=>"2014-03-25T19:46:46.709000+0100", :message=>"output received", :event=>{"message"=>"**** - admin [25/Mar/2014:19:46:46 +0100] \"GET /_nodes/stats?all=true HTTP/1.1\" 200 97555 \"https://****/_plugin/head/\" \"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/33.0.1750.152 Safari/537.36\"", "@version"=>"1", "@timestamp"=>"2014-03-25T18:46:46.694Z", "type"=>"nginx_access", "host"=>"****", "path"=>"/var/log/nginx/access.log", "clientip"=>"****", "ident"=>"-", "auth"=>"admin", "timestamp"=>"25/Mar/2014:19:46:46 +0100", "verb"=>"GET", "request"=>"/_nodes/stats?all=true", "httpversion"=>"1.1", "response"=>"200", "bytes"=>"97555", "referrer"=>"\"https://****/_plugin/head/\"", "agent"=>"\"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/33.0.1750.152 Safari/537.36\""}, :level=>:debug, :file=>"(eval)", :line=>"34"}
input {
file {
type => "nginx_access"
path => ["/var/log/nginx/**"]
exclude => ["*.gz", "error.*"]
discover_interval => 10
}
}
filter {
vagrant@precise64:~$ # index the information for user with id 2, specifically, its followers
vagrant@precise64:~$ curl -XPUT localhost:9200/users/user/2 -d '{
> "followers" : ["1", "3"]
> }'
{"_index":"users","_type":"user","_id":"2","_version":1,"created":true}vagrant@precise64:~$
vagrant@precise64:~$ # index a tweet, from user with id 2
vagrant@precise64:~$ curl -XPUT localhost:9200/tweets/tweet/1 -d '{
> "user" : "2"
> }'
{"_index":"tweets","_type":"tweet","_id":"1","_version":1,"created":true}vagrant@precise64:~$
# Set up index with mappings
curl -XPOST localhost:9200/a -d '{
"settings": {
"index": {
"analysis": {
"analyzer": {
"zh_combo":{"type":"combo","deduplication":"true","sub_analyzers":["zh_analyzer","default"]},
"zh_analyzer":{"type":"custom","filter":["icu_folding","icu_normalizer","smartcn_word"],"tokenizer":"smartcn_sentence"}
}
}
# Set up index with mappings
curl -XPOST localhost:9200/a -d '{
"mappings": {
"document": {
"_analyzer": {"path": "analyzer"},
"properties": {
"analyzer": {
"type": "string",
"index": "not_analyzed"
},
# Set up index with mappings
curl -XPOST localhost:9200/a -d '{
"mappings": {
"document": {
"properties": {
"text": {
"type": "string",
"term_vector": "with_positions_offsets"
}
}
@task
def es_rolling_restart():
"""
Restarts a single node and waits for it to become green again.
Host discovery is left as an exercise to the reader. For the moment I think we just specify on the command line
"""
ES_BASE = 'https://es-dell.arachnys.com'
# Check it's green before doing anything nasty
resp = requests.get('%s/_cluster/health' % ES_BASE, auth=(ES_USERNAME, ES_PASSWORD))
[2012-11-24 14:48:56,827][INFO ][node ] [Dmitri Bukharin] {0.19.8}[4884]: initializing ...
[2012-11-24 14:48:56,835][INFO ][plugins ] [Dmitri Bukharin] loaded [], sites []
[2012-11-24 14:48:58,868][DEBUG][monitor.network ] [Dmitri Bukharin] Using probe [org.elasticsearch.monitor.network.SigarNetworkProbe@681622f6] with refresh_interval [5s]
[2012-11-24 14:48:58,874][DEBUG][monitor.network ] [Dmitri Bukharin] net_info
host [precise64]
eth1 display_name [eth1]
address [/fe80:0:0:0:a00:27ff:feb0:564a%3] [/33.33.33.20]
mtu [1500] multicast [true] ptp [false] loopback [false] up [true] virtual [false]
eth0 display_name [eth0]
address [/fe80:0:0:0:a00:27ff:fefe:aaaf%2] [/1.1.1.1] [/10.0.2.15]