Skip to content

Instantly share code, notes, and snippets.

@persiyanov
Last active June 22, 2018 12:25
Show Gist options
  • Save persiyanov/60c7764e4b4af8b344d814bdae498cd1 to your computer and use it in GitHub Desktop.
Save persiyanov/60c7764e4b4af8b344d814bdae498cd1 to your computer and use it in GitHub Desktop.
Word2Vec benchmark without _job_producer with CythonLineSentence
----- MODEL "cython-linesentence-word2vec-window-05-workers-01-size-300" RESULTS -----
       * Vocab time: 126.159779072 sec.
       * Total epoch time: 1181.82512498 sec.
       * Processing speed: 144372.118509 words/sec
       * Avg CPU loads: 0.14, 0.35, 5.27, 94.53, 0.09, 0.23, 0.01, 0.02, 0.02, 0.02, 0.02, 0.01, 0.02, 0.02, 0.33, 0.02
       * Sum CPU load: 101.11282
----- MODEL "cython-linesentence-word2vec-window-05-workers-04-size-300" RESULTS -----
       * Vocab time: 126.206352949 sec.
       * Total epoch time: 305.442888975 sec.
       * Processing speed: 558546.858211 words/sec
       * Avg CPU loads: 2.48, 0.18, 0.60, 92.39, 77.44, 41.91, 0.00, 0.09, 0.05, 14.92, 0.08, 0.00, 0.04, 0.02, 92.23, 50.21
       * Sum CPU load: 372.63345
----- MODEL "cython-linesentence-word2vec-window-05-workers-08-size-300" RESULTS -----
       * Vocab time: 127.264240026 sec.
       * Total epoch time: 296.743177891 sec.
       * Processing speed: 574877.195872 words/sec
       * Avg CPU loads: 28.71, 29.08, 40.91, 28.57, 35.72, 43.48, 43.04, 41.27, 21.27, 25.68, 18.85, 27.27, 20.18, 10.60, 12.41, 10.68
       * Sum CPU load: 437.7317
----- MODEL "cython-linesentence-word2vec-window-05-workers-14-size-300" RESULTS -----
       * Vocab time: 131.986757994 sec.
       * Total epoch time: 297.644757986 sec.
       * Processing speed: 573000.63053 words/sec
       * Avg CPU loads: 29.91, 31.17, 31.62, 33.38, 31.06, 30.44, 31.15, 30.19, 28.82, 31.36, 31.25, 29.10, 29.06, 30.33, 29.24, 29.09
       * Sum CPU load: 487.15604
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment