Skip to content

Instantly share code, notes, and snippets.

@alekseyl
Last active May 28, 2018 09:04
Show Gist options
  • Save alekseyl/07be456e52c2a47ceb8e4d11156ea674 to your computer and use it in GitHub Desktop.
Save alekseyl/07be456e52c2a47ceb8e4d11156ea674 to your computer and use it in GitHub Desktop.
comparision of redis memory optimization, for https://medium.com/@leshchuk/zipem-all-61076c7da4c
# Columns:
# redis - clear memory usage of 100K values in Mb,
# gz - gz compressed value, smaz = smaz compressed value,
# key zip = zipping key crumbs to cingle char,
# me_ - memory_efficient_ hash optimization
#integers, html pieces, plain english text pieces
+----------+--------+--------+--------+---------+--------+----------+------------+
| type | redis | gz | smaz | key zip | me_* | kz+me+gz | kz+me+smaz |
+----------+--------+--------+--------+---------+--------+----------+------------+
| ints | 11.57 | 13.21 | 8.63 | 8.63 | 0.99 | 0.95 | 0.95 |
+----------+--------+--------+--------+---------+--------+----------+------------+
| html100 | 20.81 | 20.22 | 19.8 | 17.76 | 10.72 | 9.38 | 9.15 |
| html500 | 59.55 | 40.44 | 54.11 | 56.52 | 48.87 | 28.91 | 41.48 |
| html1000 | 107.78 | 59.29 | 97.5 | 104.72 | 97.66 | 45.77 | 81.52 |
| html4000 | 398.3 | 154.17 | 361.69 | 395.25 | 395.99 | 133.29 | 332.83 |
+----------+--------+--------+--------+---------+--------+----------+------------+
| txt100 | 20.8 | 20.38 | 17.44 | 17.75 | 10.72 | 10.56 | 7.62 |
| txt500 | 58.95 | 41.94 | 42.02 | 55.93 | 48.83 | 30.51 | 30.51 |
| txt1000 | 107.78 | 70.99 | 72.36 | 104.76 | 97.66 | 53.4 | 58.04 |
| txt4000 | 400.75 | 202.4 | 254.26 | 397.69 | 383.01 | 175.47 | 228.9 |
+----------+--------+--------+--------+---------+--------+----------+------------+
# Active record object serialization
+----------+-------+--------------+-------------------+------------------------+
| type | redis | to_json + gz | to_json + me + gz | me + custom_compressor |
+----------+-------+--------------+-------------------+------------------------+
| ext_tags | 45.0 | 33.78 | 22.82 | 16.66 |
| users | 52.0 | 38.12 | 25.93 | 16.78 |
+----------+-------+--------------+-------------------+------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment