pandas-vs-modin-in-fillna.md

pandas vs modin in fillna

datasets

system:

• i5-6400
• 24gb ram 2400mhz
• samsung 860 evo ssd
• gtx 10603gb

import time

import pandas as pd
df = pd.read_csv("esea_master_dmg_demos.part1.csv")



s = time.time()
df = df.fillna(value=0)
e = time.time()
print("Pandas Concat Time = {}".format(e-s))

Pandas Concat Time = 4.92685341835022

del df

import modin.pandas as pd

df = pd.read_csv("esea_master_dmg_demos.part1.csv")

s = time.time()
df = df.fillna(value=0)
e = time.time()

print("Modin Loading Time = {}".format(e-s))

Modin Loading Time = 0.009033441543579102