Skip to content

Instantly share code, notes, and snippets.

@nvllsvm
Created November 15, 2022 20:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save nvllsvm/457b8801bcfd703cb4f3bce1d01b0ab4 to your computer and use it in GitHub Desktop.
Save nvllsvm/457b8801bcfd703cb4f3bce1d01b0ab4 to your computer and use it in GitHub Desktop.
sqlitedict + zstandard compression (w/ immediatey disk writes)
import sqlitedict
import zstandard
def zstd_sqlitedict(*args, **kwargs):
return sqlitedict.SqliteDict(
*args,
decode=lambda obj: sqlitedict.decode(zstandard.decompress(obj)),
encode=lambda obj: zstandard.compress(bytes(sqlitedict.encode(obj))),
autocommit=True,
**kwargs)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment