Skip to content

Instantly share code, notes, and snippets.

@edenhill
Created November 17, 2016 20:23
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save edenhill/f617caa8ed671a0f960ead56556e0c5c to your computer and use it in GitHub Desktop.
Save edenhill/f617caa8ed671a0f960ead56556e0c5c to your computer and use it in GitHub Desktop.
offset store.
If your processing rate is high this might not be optimal since you'll be committing for each message, even if using async commits there's some degree of performance penalty.
So another alternative is to keep `enable.auto.commit` set to True (default) but disable the automatic offset store.
So what is the offset store?
Each time a message is passed from the client to your application its offset is stored for future commit, the next intervalled commit will then use this stored offset. If the stored offset did not change from the last commit nothing happens.
So by setting `enable.auto.offset.store` to False you keep the convenient intervalled auto commit behaviour but you control what offsets are actually eligible for commit.
@hrchu
Copy link

hrchu commented May 4, 2018

Is there any reference?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment