Skip to content

Instantly share code, notes, and snippets.

View thunterdb's full-sized avatar

Timothy Hunter thunterdb

View GitHub Profile
@thunterdb
thunterdb / s3_read_tensorflow.py
Last active December 8, 2017 23:12
tensorflow reading issue with S3
import tensorflow as tf
data_dir = "s3://databricks-public-datasets/mnist"
import os
from datetime import datetime
def curr_time():
return datetime.now().strftime("%H:%M:%S %D")
# Dataset API code from https://www.tensorflow.org/versions/r1.4/api_docs/python/tf/contrib/data/Dataset#shard