Skip to content

Instantly share code, notes, and snippets.

View PGryllos's full-sized avatar
🎯
Focusing

Gryllos Prokopis PGryllos

🎯
Focusing
View GitHub Profile
@PGryllos
PGryllos / s3_util.py
Created January 5, 2019 12:04
Using dask's multithreaded scheduler to speedup download of multiple files from s3
"""
Using dask's multithreaded scheduler to speedup download of multiple files from
an s3 bucket
"""
import os
from functools import partial
import botocore
import boto3