Skip to content

Instantly share code, notes, and snippets.

@bobchennan
Created April 5, 2018 20:12
Show Gist options
  • Save bobchennan/3ada4e036c741a02860446e45e1b55fa to your computer and use it in GitHub Desktop.
Save bobchennan/3ada4e036c741a02860446e45e1b55fa to your computer and use it in GitHub Desktop.
test of memory usage for scikit-learn lda
import numpy as np
#from sklearn.discriminant_analysis import _class_cov,LinearDiscriminantAnalysis
from discriminant_analysis import _class_cov,LinearDiscriminantAnalysis
X = np.random.rand(1000000, 100)
y = np.random.randint(0, 20000, (1000000, ))
print len(np.unique(y))
#model=LinearDiscriminantAnalysis(solver='eigen')
#model.fit(X,y)
_class_cov(X, y, np.array([1.]*20000)/20000)
@bobchennan
Copy link
Author

sklearn.discriminant_analysis: 2.2GB
discriminant_analysis from new pull: 838m

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment