Skip to content

Instantly share code, notes, and snippets.

@kabirahuja2431

kabirahuja2431/iterable_dataloader_v2.py

Last active February 23, 2020 03:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save kabirahuja2431/c0c87e688a565c6284d38453981d05c7 to your computer and use it in GitHub Desktop.
Save kabirahuja2431/c0c87e688a565c6284d38453981d05c7 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
iterable_dataloader_v2.py
dataset = CustomIterableDatasetv1('path_to/somefile')
dataloader = DataLoader(dataset, batch_size = 64)
for X, y in dataloader:
print(len(X)) # 64
print(y.shape) # (64,)
### Do something with X and y
###
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment