Skip to content

Instantly share code, notes, and snippets.

@yuvalif
Last active September 13, 2023 14:14
Show Gist options
  • Save yuvalif/15af72d2abf9493cc83f56b94ae5f9cb to your computer and use it in GitHub Desktop.
Save yuvalif/15af72d2abf9493cc83f56b94ae5f9cb to your computer and use it in GitHub Desktop.

notification retries

  • limit number of reties (ephemeral)
  • notification TTL (persistent)
  • spacing the retries (ephemeral)
  • global config via options

phase 1

  • per topic config via REST
  • notification TTL migration
  • documentation
  • integration tests
  • retry migration

use cls FIFO

  • replace cls 2pc queue with cls FIFO
  • support maximum size for cls FIFO
  • implement simple reserve/commit mechanism (that allows for one FIFO node overshoot)
  • migration
  • support topic stats (approximate) for topic with cls FIFO
  • unit tests
  • integration tests should agnostic of underlying queue
  • performance tests

topic stats

  • via radosgw-admin
  • number of pending reservations
  • number of entries
  • size in bytes
  • integration tests
  • fix to the phase 0 PR

phase 1

  • via labeled perf counters
  • end2end demo through prometheus and grafana
@yuvalif
Copy link
Author

yuvalif commented Sep 7, 2023

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment