Skip to content

Instantly share code, notes, and snippets.

View guillermo-menjivar's full-sized avatar

gmo guillermo-menjivar

9 followers · 67 following
  • internet
View GitHub Profile
@guillermo-menjivar
guillermo-menjivar / main.py
Created January 16, 2018 07:11
update commit
125 if len(ips_to_update) > 0:
126
127 while len(uuids_to_update) > 0:
128 print 'updating', len(uuids_to_update[:1000])
129 update_records(analytic['id'], uuids_to_update[:1000])
130 del uuids_to_update[:1000]
@guillermo-menjivar
guillermo-menjivar / gist:36a4fd7a90e694735ee64594d2393123
Created January 16, 2018 06:58
mine
Ordered by: cumulative time
ncalls tottime percall cumtime percall filename:lineno(function)
1 0.001 0.001 9.264 9.264 analyticsd.py:3(<module>)
1 0.006 0.006 9.099 9.099 analyticsd.py:93(main)
12 8.969 0.747 8.969 0.747 {method 'execute' of 'psycopg2.extensions.cursor' objects}
4 0.059 0.015 3.674 0.919 analyticsd.py:72(update_records)
@guillermo-menjivar
guillermo-menjivar / .py
Last active January 16, 2018 06:42
take-20123121
def hack_convert(records):
template = "select * from analytics where tag in ({CODE})"
root = "(VALUES "
for rec in records:
root = root + "('"+rec+"'::uuid),"
# this removes the last comma
@guillermo-menjivar
guillermo-menjivar / updated
Created January 16, 2018 05:37
ncalls tottime percall cumtime percall filename:lineno(function)
1 0.001 0.001 0.850 0.850 analyticsd.py:3(<module>)
1 0.000 0.000 0.683 0.683 analyticsd.py:90(main)
2 0.682 0.341 0.682 0.341 {method 'execute' of 'psycopg2.extensions.cursor' objects}
1 0.000 0.000 0.639 0.639 analyticsd.py:46(get_previous_records)
1 0.000 0.000 0.085 0.085 manicthief.py:3(<module>)
1 0.000 0.000 0.074 0.074 __init__.py:2(<module>)
1 0.000 0.000 0.068 0.068 _packer.py:1(<module>)
1 0.001 0.001 0.068 0.068 _packer.py:1(__bootstrap__)
@guillermo-menjivar
guillermo-menjivar / profiler
Last active January 16, 2018 04:26
dered by: cumulative time
ncalls tottime percall cumtime percall filename:lineno(function)
1 0.001 0.001 87.313 87.313 analyticsd.py:3(<module>)
1 0.029 0.029 87.149 87.149 analyticsd.py:77(main)
12 87.058 7.255 87.058 7.255 {method 'execute' of 'psycopg2.extensions.cursor' objects}
4 0.000 0.000 81.506 20.377 analyticsd.py:60(update_records)
4 0.000 0.000 2.911 0.728 analyticsd.py:27(get_new_records)
4 0.000 0.000 2.648 0.662 analyticsd.py:45(get_previous_records)
1 0.000 0.000 0.085 0.085 manicthief.py:3(<module>)
@guillermo-menjivar
guillermo-menjivar / kafka-cheat-sheet.md
Created January 12, 2018 15:17 — forked from sahilsk/kafka-cheat-sheet.md
Apache Kafka Cheat Sheet

Kafka Cheat Sheet

Display Topic Information

$ kafka-topics.sh --describe --zookeeper localhost:2181 --topic beacon
Topic:beacon	PartitionCount:6	ReplicationFactor:1	Configs:
	Topic: beacon	Partition: 0	Leader: 1	Replicas: 1	Isr: 1
	Topic: beacon	Partition: 1	Leader: 1	Replicas: 1	Isr: 1
@guillermo-menjivar
guillermo-menjivar / kafka installation and systemd
Created December 25, 2017 01:46 — forked from vipmax/kafka install systemd.md
cd /opt
wget http://apache-mirror.rbc.ru/pub/apache/kafka/0.10.1.0/kafka_2.11-0.10.1.0.tgz
tar xvzf kafka_2.11-0.10.1.0.tgz
ln -s kafka_2.11-0.10.1.0/ kafka
vi /etc/systemd/system/kafka-zookeeper.service
[Unit]
Description=Apache Zookeeper server (Kafka)
Documentation=http://zookeeper.apache.org