Skip to content

Instantly share code, notes, and snippets.

@whalebot-helmsman
Last active May 19, 2017 05:11
Show Gist options
  • Save whalebot-helmsman/28b875cc0edb2bd6f69bffbad3a02162 to your computer and use it in GitHub Desktop.
Save whalebot-helmsman/28b875cc0edb2bd6f69bffbad3a02162 to your computer and use it in GitHub Desktop.
/home/adergachev/ve/brl33/lib/python3.3/site-packages/sklearn/utils/fixes.py:200: UserWarning: Using `sort` instead of partition.Upgrade numpy to 1.8 for better performace on large numberof clusters
warnings.warn('Using `sort` instead of partition.'
[Parallel(n_jobs=16)]: Done 30 out of 30 | elapsed: 1.1s remaining: 0.0s
[Parallel(n_jobs=16)]: Done 30 out of 30 | elapsed: 1.1s finished
[Parallel(n_jobs=16)]: Done 29 out of 29 | elapsed: 0.9s finished
[Parallel(n_jobs=16)]: Done 26 out of 28 | elapsed: 0.9s remaining: 0.1s
[Parallel(n_jobs=16)]: Done 28 out of 28 | elapsed: 0.9s finished
[Parallel(n_jobs=16)]: Done 24 out of 27 | elapsed: 0.6s remaining: 0.1s
[Parallel(n_jobs=16)]: Done 27 out of 27 | elapsed: 0.6s finished
[Parallel(n_jobs=16)]: Done 22 out of 26 | elapsed: 1.0s remaining: 0.2s
[Parallel(n_jobs=16)]: Done 26 out of 26 | elapsed: 1.0s finished
[Parallel(n_jobs=16)]: Done 20 out of 25 | elapsed: 0.7s remaining: 0.2s
[Parallel(n_jobs=16)]: Done 25 out of 25 | elapsed: 0.9s finished
[Parallel(n_jobs=16)]: Done 18 out of 24 | elapsed: 0.9s remaining: 0.3s
[Parallel(n_jobs=16)]: Done 24 out of 24 | elapsed: 0.9s finished
[Parallel(n_jobs=16)]: Done 16 out of 23 | elapsed: 1.0s remaining: 0.4s
[Parallel(n_jobs=16)]: Done 23 out of 23 | elapsed: 1.5s finished
[Parallel(n_jobs=16)]: Done 14 out of 22 | elapsed: 1.0s remaining: 0.6s
[Parallel(n_jobs=16)]: Done 22 out of 22 | elapsed: 1.2s finished
[Parallel(n_jobs=16)]: Done 12 out of 21 | elapsed: 0.5s remaining: 0.4s
[Parallel(n_jobs=16)]: Done 21 out of 21 | elapsed: 0.7s finished
[Parallel(n_jobs=16)]: Done 10 out of 20 | elapsed: 0.7s remaining: 0.7s
[Parallel(n_jobs=16)]: Done 20 out of 20 | elapsed: 1.0s finished
[Parallel(n_jobs=16)]: Done 8 out of 19 | elapsed: 0.8s remaining: 1.1s
[Parallel(n_jobs=16)]: Done 19 out of 19 | elapsed: 1.2s finished
[Parallel(n_jobs=16)]: Done 6 out of 18 | elapsed: 0.4s remaining: 0.8s
[Parallel(n_jobs=16)]: Done 18 out of 18 | elapsed: 0.8s finished
real 0m15.290s
user 2m41.787s
sys 0m4.919s
/home/adergachev/ve/brl33/lib/python3.3/site-packages/sklearn/utils/fixes.py:200: UserWarning: Using `sort` instead of partition.Upgrade numpy to 1.8 for better performace on large numberof clusters
warnings.warn('Using `sort` instead of partition.'
[Parallel(n_jobs=13)]: Done 30 out of 30 | elapsed: 1.1s finished
[Parallel(n_jobs=13)]: Done 29 out of 29 | elapsed: 1.1s finished
[Parallel(n_jobs=13)]: Done 28 out of 28 | elapsed: 1.2s finished
[Parallel(n_jobs=13)]: Done 27 out of 27 | elapsed: 1.1s finished
[Parallel(n_jobs=13)]: Done 26 out of 26 | elapsed: 0.8s finished
[Parallel(n_jobs=13)]: Done 25 out of 25 | elapsed: 0.9s finished
[Parallel(n_jobs=13)]: Done 24 out of 24 | elapsed: 1.0s remaining: 0.0s
[Parallel(n_jobs=13)]: Done 24 out of 24 | elapsed: 1.0s finished
[Parallel(n_jobs=13)]: Done 23 out of 23 | elapsed: 0.7s finished
[Parallel(n_jobs=13)]: Done 20 out of 22 | elapsed: 1.2s remaining: 0.1s
[Parallel(n_jobs=13)]: Done 22 out of 22 | elapsed: 1.2s finished
[Parallel(n_jobs=13)]: Done 18 out of 21 | elapsed: 0.7s remaining: 0.1s
[Parallel(n_jobs=13)]: Done 21 out of 21 | elapsed: 0.9s finished
[Parallel(n_jobs=13)]: Done 16 out of 20 | elapsed: 0.8s remaining: 0.2s
[Parallel(n_jobs=13)]: Done 20 out of 20 | elapsed: 1.1s finished
[Parallel(n_jobs=13)]: Done 14 out of 19 | elapsed: 1.1s remaining: 0.4s
[Parallel(n_jobs=13)]: Done 19 out of 19 | elapsed: 1.3s finished
[Parallel(n_jobs=13)]: Done 12 out of 18 | elapsed: 0.7s remaining: 0.3s
[Parallel(n_jobs=13)]: Done 18 out of 18 | elapsed: 1.4s finished
real 0m16.124s
user 2m21.974s
sys 0m4.174s
/home/adergachev/ve/brl33/lib/python3.3/site-packages/sklearn/utils/fixes.py:200: UserWarning: Using `sort` instead of partition.Upgrade numpy to 1.8 for better performace on large numberof clusters
warnings.warn('Using `sort` instead of partition.'
[Parallel(n_jobs=10)]: Done 30 out of 30 | elapsed: 1.2s finished
[Parallel(n_jobs=10)]: Done 29 out of 29 | elapsed: 0.9s finished
[Parallel(n_jobs=10)]: Done 28 out of 28 | elapsed: 1.1s finished
[Parallel(n_jobs=10)]: Done 27 out of 27 | elapsed: 1.7s finished
[Parallel(n_jobs=10)]: Done 26 out of 26 | elapsed: 1.3s finished
[Parallel(n_jobs=10)]: Done 25 out of 25 | elapsed: 1.2s finished
[Parallel(n_jobs=10)]: Done 24 out of 24 | elapsed: 1.2s finished
[Parallel(n_jobs=10)]: Done 23 out of 23 | elapsed: 1.5s finished
[Parallel(n_jobs=10)]: Done 22 out of 22 | elapsed: 1.0s finished
[Parallel(n_jobs=10)]: Done 21 out of 21 | elapsed: 1.0s finished
[Parallel(n_jobs=10)]: Done 20 out of 20 | elapsed: 1.1s finished
[Parallel(n_jobs=10)]: Done 19 out of 19 | elapsed: 0.7s finished
[Parallel(n_jobs=10)]: Done 18 out of 18 | elapsed: 0.8s remaining: 0.0s
[Parallel(n_jobs=10)]: Done 18 out of 18 | elapsed: 0.8s finished
real 0m17.070s
user 2m7.443s
sys 0m3.887s
/home/adergachev/ve/brl33/lib/python3.3/site-packages/sklearn/utils/fixes.py:200: UserWarning: Using `sort` instead of partition.Upgrade numpy to 1.8 for better performace on large numberof clusters
warnings.warn('Using `sort` instead of partition.'
[Parallel(n_jobs=7)]: Done 30 out of 30 | elapsed: 1.2s finished
[Parallel(n_jobs=7)]: Done 29 out of 29 | elapsed: 1.2s finished
[Parallel(n_jobs=7)]: Done 28 out of 28 | elapsed: 1.6s finished
[Parallel(n_jobs=7)]: Done 27 out of 27 | elapsed: 1.2s finished
[Parallel(n_jobs=7)]: Done 26 out of 26 | elapsed: 1.7s finished
[Parallel(n_jobs=7)]: Done 25 out of 25 | elapsed: 1.5s finished
[Parallel(n_jobs=7)]: Done 24 out of 24 | elapsed: 1.6s finished
[Parallel(n_jobs=7)]: Done 23 out of 23 | elapsed: 1.3s finished
[Parallel(n_jobs=7)]: Done 22 out of 22 | elapsed: 1.3s finished
[Parallel(n_jobs=7)]: Done 21 out of 21 | elapsed: 1.5s finished
[Parallel(n_jobs=7)]: Done 20 out of 20 | elapsed: 1.7s finished
[Parallel(n_jobs=7)]: Done 19 out of 19 | elapsed: 1.1s finished
[Parallel(n_jobs=7)]: Done 18 out of 18 | elapsed: 1.1s finished
real 0m20.468s
user 1m55.413s
sys 0m3.665s
/home/adergachev/ve/brl33/lib/python3.3/site-packages/sklearn/utils/fixes.py:200: UserWarning: Using `sort` instead of partition.Upgrade numpy to 1.8 for better performace on large numberof clusters
warnings.warn('Using `sort` instead of partition.'
[Parallel(n_jobs=4)]: Done 30 out of 30 | elapsed: 2.4s finished
[Parallel(n_jobs=4)]: Done 29 out of 29 | elapsed: 2.3s finished
[Parallel(n_jobs=4)]: Done 28 out of 28 | elapsed: 2.2s finished
[Parallel(n_jobs=4)]: Done 27 out of 27 | elapsed: 2.2s finished
[Parallel(n_jobs=4)]: Done 26 out of 26 | elapsed: 2.8s finished
[Parallel(n_jobs=4)]: Done 25 out of 25 | elapsed: 2.3s finished
[Parallel(n_jobs=4)]: Done 24 out of 24 | elapsed: 2.5s finished
[Parallel(n_jobs=4)]: Done 23 out of 23 | elapsed: 2.1s finished
[Parallel(n_jobs=4)]: Done 22 out of 22 | elapsed: 2.5s finished
[Parallel(n_jobs=4)]: Done 21 out of 21 | elapsed: 1.9s finished
[Parallel(n_jobs=4)]: Done 20 out of 20 | elapsed: 2.2s finished
[Parallel(n_jobs=4)]: Done 19 out of 19 | elapsed: 1.7s finished
[Parallel(n_jobs=4)]: Done 18 out of 18 | elapsed: 1.8s finished
real 0m30.832s
user 1m50.622s
sys 0m3.253s
/home/adergachev/ve/brl33/lib/python3.3/site-packages/sklearn/utils/fixes.py:200: UserWarning: Using `sort` instead of partition.Upgrade numpy to 1.8 for better performace on large numberof clusters
warnings.warn('Using `sort` instead of partition.'
[Parallel(n_jobs=1)]: Done 30 out of 30 | elapsed: 6.4s finished
[Parallel(n_jobs=1)]: Done 29 out of 29 | elapsed: 7.0s finished
[Parallel(n_jobs=1)]: Done 28 out of 28 | elapsed: 7.1s finished
[Parallel(n_jobs=1)]: Done 27 out of 27 | elapsed: 7.3s finished
[Parallel(n_jobs=1)]: Done 26 out of 26 | elapsed: 7.0s finished
[Parallel(n_jobs=1)]: Done 25 out of 25 | elapsed: 6.9s finished
[Parallel(n_jobs=1)]: Done 24 out of 24 | elapsed: 7.0s finished
[Parallel(n_jobs=1)]: Done 23 out of 23 | elapsed: 7.0s finished
[Parallel(n_jobs=1)]: Done 22 out of 22 | elapsed: 6.9s finished
[Parallel(n_jobs=1)]: Done 21 out of 21 | elapsed: 6.7s finished
[Parallel(n_jobs=1)]: Done 20 out of 20 | elapsed: 6.5s finished
[Parallel(n_jobs=1)]: Done 19 out of 19 | elapsed: 6.5s finished
[Parallel(n_jobs=1)]: Done 18 out of 18 | elapsed: 6.2s finished
real 1m29.465s
user 1m29.510s
sys 0m2.769s
import sys
from mlxtend.feature_selection import SequentialFeatureSelector
from sklearn.datasets import load_breast_cancer
from sklearn.ensemble import GradientBoostingClassifier
def main():
n_jobs = int(sys.argv[1])
cancer = load_breast_cancer()
X, y = cancer.data, cancer.target
lr = GradientBoostingClassifier()
sfs_r = SequentialFeatureSelector(lr,
k_features=13,
forward=True,
floating=False,
scoring='neg_mean_squared_error',
cv=3,
skip_if_stuck=True,
n_jobs=n_jobs,
verbose=1)
sfs_r = sfs_r.fit(X, y)
if __name__ == "__main__":
main()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment