Skip to content

Instantly share code, notes, and snippets.

@elijahbenizzy
Last active August 17, 2023 20:47
Show Gist options
  • Save elijahbenizzy/d9ccceb36ee9c4e8b7c00bb75b935eca to your computer and use it in GitHub Desktop.
Save elijahbenizzy/d9ccceb36ee9c4e8b7c00bb75b935eca to your computer and use it in GitHub Desktop.
import functions
from hamilton.execution import executors
dr = (
driver.Builder()
.enable_dynamic_execution(allow_experimental_mode=True)
# these are the deafults -- use the SynchronousLocalTaskExecutor
# for remote if you want to iterate on a small dataset
.with_remote_executor(executors.MultiThreadingExecutor(max_tasks=5))
.with_local_executor(executors.SynchronousLocalTaskExecutor())
.with_modules(functions)
.build()
)
dr.execute(["all_contents"])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment