Example: How to use HyperLogLog from pdsa Python library

hyperloglog-example.py

import json

from psda.cardinality.hyperloglog import HyperLogLog

hll = HyperLogLog(precision=10)  # 2^{10} = 1024 counters

with open('visitors.txt') as f:
    for line in f:
        ip = json.loads(line)['ip']
        hll.add(ip)
        
num_of_unique_visitors = hll.count()
print('Unique visitors', num_of_unique_visitors)

size_in_bytes = hll.size()
print('Size in bytes', size_in_bytes)
    

pdsa is a python library that can be found at https://github.com/gakhov/pdsa