Skip to content

Instantly share code, notes, and snippets.

@Nicolas-Vandeput
Created July 3, 2021 16:25
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Nicolas-Vandeput/dd0a301016006a6c6606365d7eb19f83 to your computer and use it in GitHub Desktop.
Save Nicolas-Vandeput/dd0a301016006a6c6606365d7eb19f83 to your computer and use it in GitHub Desktop.
start = time.time()
def loop(file_number):
return pd.read_csv(f"Dummy {file_number}.csv")
df = Parallel(n_jobs=-1, verbose=10)(delayed(loop)(file_number) for file_number in range(10))
df = pd.concat(df, ignore_index=True)
end = time.time()
print("CSV//:", end - start)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment