Skip to content

Instantly share code, notes, and snippets.

@Hkazanci93
Created October 19, 2021 10:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Hkazanci93/f19cf6067be140fe2fe5fed599e66e09 to your computer and use it in GitHub Desktop.
Save Hkazanci93/f19cf6067be140fe2fe5fed599e66e09 to your computer and use it in GitHub Desktop.
Pre-processing task that uses RedisGears
gb = GB('KeysReader')
gb.filter(filter_language)
gb.flatmap(parse_paragraphs)
gb.map(spellcheck_sentences)
gb.foreach(save_sentences)
gb.count()
gb.register('paragraphs:*',keyTypes=['string','hash'], mode="async_local")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment