Skip to content

Instantly share code, notes, and snippets.

@Nicolas-Vandeput
Created July 18, 2021 11:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Nicolas-Vandeput/98b6ca2eef489b184fe37aae2a472688 to your computer and use it in GitHub Desktop.
Save Nicolas-Vandeput/98b6ca2eef489b184fe37aae2a472688 to your computer and use it in GitHub Desktop.
def loop(file_number):
return pd.read_pickle(f"Dummy {file_number}.pickle")
df = Parallel(n_jobs=-1, verbose=0, prefer="threads")(delayed(loop)(file_number) for file_number in range(10))
df = pd.concat(df, ignore_index=True)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment