Skip to content

Instantly share code, notes, and snippets.

@l1x
Last active May 25, 2016 13:16
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save l1x/702912455ea66cd6e14d7ef2d55109b3 to your computer and use it in GitHub Desktop.

Pandas

Ignore warnings

import warnings
warnings.filterwarnings("ignore")

Read CSV

df = pd.DataFrame.from_csv('data/data_cleaned.tsv', encoding = 'utf8', sep='\t', index_col=False)

Query any null (NaN) field

df[df.isnull().any(axis=1)].count()

Applying lambda functions to dataframe columns

asci          = lambda s: s.encode('ascii',errors='ignore') if isinstance(s, basestring) else s
lowe          = lambda s: s.lower() if isinstance(s, basestring) else s

df['lower_case'] = df_train['name'].apply(lowe)

Getting samples from dataframes

df.sample()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment