Skip to content

Instantly share code, notes, and snippets.

View MattsonThieme's full-sized avatar

MattsonThieme

View GitHub Profile
#!/bin/bash
# To run: bash tf_multiworker.sh <num_workers>
# Where <num_workers> is an integer factor of the number of physical cores on the machine
# OpenMPI must be installed for this to run
if [ "$1" == "-h" ]; then
echo "Usage: `basename $0` [<num_workers>]"
echo " where "
echo " [<num_workers>] = Number of TensorFlow workers per node"
echo " "
@MattsonThieme
MattsonThieme / multi_stream_intel_tf_cnn_benchmarks.sh
Last active May 18, 2018 17:19
Run TensorFlow CNN benchmarks on a single node with multiple workers
# !/bin/bash
# Mattson Thieme | 2018
# Run training in TensorFlow's tf_cnn benchmarks with four workers and one ps on a 36 core Skylake
# Activate TensorFlow virtual environment
source activate tensorflow_p36
# Set worker parameters - may need to update port numbers when running on your machine
ps_list="127.0.0.1:26214"
workers_list="127.0.0.1:1104,127.0.0.1:10628,127.0.0.1:1124,127.0.0.1:2003"
@MattsonThieme
MattsonThieme / intel_optimized_ml_envs.sh
Last active June 5, 2019 20:39
Build commands for Intel Optimized Machine Learning Frameworks
# !/bin/bash
# Usage: bash intel_optimized_ml_envs.sh
# Add conda, activate to PATH
export PATH=/anaconda/envs/py35/bin:$PATH
# Add Intel channel to conda
conda config --add channels intel
# Create Python 2.7 TensorFlow env
@MattsonThieme
MattsonThieme / intel_tf_cnn_benchmarks.sh
Last active June 6, 2019 18:44
Intel TensorFlow CNN Benchmarking Script
#!/bin/bash
#
# Copyright (c) 2019 Intel Corporation
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#