Skip to content

Instantly share code, notes, and snippets.

@Innarticles

Innarticles/combine_csvs.py

Created August 25, 2018 16:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Innarticles/bd8bc0fb2743905310112c098078a5fb to your computer and use it in GitHub Desktop.
Save Innarticles/bd8bc0fb2743905310112c098078a5fb to your computer and use it in GitHub Desktop.
Download ZIP
Combine data from several csv files
Raw
combine_csvs.py
import glob
import pandas as pd
path ='/' # use your path
allFiles = glob.glob("*.csv")
frame = pd.DataFrame()
list_ = []
for file_ in allFiles:
df = pd.read_csv(file_,index_col=None, header=None)
list_.append(df)
frame = pd.concat(list_)
frame.columns = ['SN', 'State', 'LGA', 'Ward', 'Polling Units', 'dd', 'dd2', 'dd3', 'dd4', 'dd5']
cleaned = frame.drop(axis=1, labels=['dd', 'dd2', 'dd3', 'dd4', 'dd5'])
cleaned.to_csv('combined_csv.csv', index=False)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment