Skip to content

Instantly share code, notes, and snippets.

@holyglenn
holyglenn / manual.md
Last active June 28, 2016 20:20
Petuum Automated Installation Script

Petuum Quick Start

We now provide a script to help you setup Bösen and Strads systems on a single machine with just 1 command. After setting it up, you can run two demo applications to verify that they are working. If you seek further deployment or prefer a more detailed hands-on experience, please refer to this full installation guide. Also check out Poseiden, the multi-GPU distributed deep learning framework of Petuum.

Before start, run the following commands to prepare necessary environment. If you do not have sudo privilege, please contact your administor for help. After getting these ready, you are good to run Petuum with or without sudo.

Model AGIEval GPT4All TruthfulQA Bigbench
AlphaMonarch-7B 45.37 Error: File does not exist 78.39 50.2

AGIEval

Task Version Metric Value Stderr
agieval_aqua_rat 0 acc 28.35 ± 2.83
acc_norm 26.38 ± 2.77
agieval_logiqa_en 0 acc 38.25 ± 1.91
Model AGIEval GPT4All TruthfulQA Bigbench
AlphaMonarch-7B 45.39 Error: File does not exist 78.4 50.15

AGIEval

Task Version Metric Value Stderr
agieval_aqua_rat 0 acc 28.35 ± 2.83
acc_norm 26.38 ± 2.77
agieval_logiqa_en 0 acc 38.25 ± 1.91