Skip to content

Instantly share code, notes, and snippets.

@franchb

franchb/pandas_chunks.py

Created March 5, 2018 13:25
Show Gist options
  • Save franchb/c45566eaac60bfe0fab73eeff5b049fe to your computer and use it in GitHub Desktop.
Save franchb/c45566eaac60bfe0fab73eeff5b049fe to your computer and use it in GitHub Desktop.
Download ZIP
chunks pandas
Raw
pandas_chunks.py
chunksize = 500
chunks = []
for chunk in pd.read_csv('pizza.csv', chunksize=chunksize):
# Do stuff...
chunks.append(chunk)
df = pd.concat(chunks, axis=0)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment