Skip to content

Instantly share code, notes, and snippets.

@ckoparkar
Created March 9, 2019 18:16
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ckoparkar/5f42dc21f22e74523ba68fb6a2e02417 to your computer and use it in GitHub Desktop.
Save ckoparkar/5f42dc21f22e74523ba68fb6a2e02417 to your computer and use it in GitHub Desktop.
pldi19-artifact
diff --git a/pldi19/bench.sh b/pldi19/bench.sh
index 1bf8650..412c330 100755
--- a/pldi19/bench.sh
+++ b/pldi19/bench.sh
@@ -138,9 +138,17 @@ echo "MACHINE,NAME,VARIANT,SIZE,TRIALS,ITERS,SELFTIMED(sec)" >> $LITMUS_RESULT_F
echo "Running in-memory benchmarks (Table 1)..."
echo "Sending results to $LITMUS_RESULT_FILE"
-# Some benchmarks require 100M iterations. Only used for CNF and Cap'n Proto.
+
+# Only used for CNF and Cap'n Proto:
+# ----------------------------------
+
+## Some benchmarks require 100M iterations.
HUNDRED_MILL_TESTS=("id" "leftmost" "rightmost")
+## Run these benchmarks only once. Otherwise, they run out of memory on a 8GB machine.
+HIGH_MEM_USAGE_TESTS=("add1" "copy" "build_searchtree" "repconst" "repmax_twopass")
+
+
# The list of benchmarks to run
readarray limus_tests < "$BENCH_LITMUS_DIR/litmus_tests.names"
@@ -166,6 +174,8 @@ do
iters=1000000
elif [ "${tn#test_litmus_}" = "tree_insert" ]; then
iters=200000
+ elif [[ " ${HIGH_MEM_USAGE_TESTS[@]} " =~ " ${tn#test_litmus_} " ]]; then
+ iters=1
fi
set -x
@@ -187,6 +197,8 @@ do
iters=20000000
elif [ "${tn#test_litmus_}" = "tree_lookup" ]; then
iters=20000000
+ elif [[ " ${HIGH_MEM_USAGE_TESTS[@]} " =~ " ${tn#test_litmus_} " ]]; then
+ iters=1
fi
echo -e "[CAP'N PROTO] ITERS: $iters\n"
res_capnproto=`./pldi19_run_capnp.sh ${tn} $SIZE $iters`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment