Skip to content

Instantly share code, notes, and snippets.

@Nicolas-Vandeput
Created July 3, 2021 16:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Nicolas-Vandeput/5a1677fc152f8f9dcdfe73a84ccc349a to your computer and use it in GitHub Desktop.
Save Nicolas-Vandeput/5a1677fc152f8f9dcdfe73a84ccc349a to your computer and use it in GitHub Desktop.
start = time.time()
def loop(file_number):
return pd.read_pickle(f"Dummy {file_number}.pickle")
df = Parallel(n_jobs=-1, verbose=10)(delayed(loop)(file_number) for file_number in range(10))
df = pd.concat(df, ignore_index=True)
end = time.time()
print("Pickle//:", end - start)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment