JayKimBravekjh

Build tensorflow on OSX with NVIDIA CUDA support (GPU acceleration)

These instructions are based on Mistobaan's gist but expanded and updated to work with the latest tensorflow OSX CUDA PR.

Requirements

OS X 10.10 (Yosemite) or newer

JayKimBravekjh

Large Scale Distributed Deep Networks

Introduction

• In machine learning, accuracy tends to increase with an increase in the number of training examples and number of model parameters.
• For large data, training becomes slow on even GPU (due to increase CPU-GPU data transfer).
• Solution: Distributed training and inference - DistBelief
• Link to paper

DistBelief

JayKimBravekjh

Large Scale Distributed Deep Networks

Introduction

• In machine learning, accuracy tends to increase with an increase in the number of training examples and number of model parameters.
• For large data, training becomes slow on even GPU (due to increase CPU-GPU data transfer).
• Solution: Distributed training and inference - DistBelief
• Link to paper

DistBelief

JayKimBravekjh

''' 
All cases pass for theano backend, but some fail with tensorflow bakcend
'''

from __future__ import print_function

from keras.layers import Input, Embedding, GRU, TimeDistributed, Dense
from keras.models import Model

def build_model(batch_size, input_length):

JayKimBravekjh

from threading import Thread
from time import sleep
import uuid

from dask.distributed import LocalCluster, Client
import dask.dataframe as dd
import pandas as pd
import pyspark

JayKimBravekjh

from threading import Thread
from time import sleep
import uuid

from dask.distributed import LocalCluster, Client
import dask.dataframe as dd
import pandas as pd
import pyspark

JayKimBravekjh

from threading import Thread
from time import sleep
import uuid

from dask.distributed import LocalCluster, Client
import dask.dataframe as dd
import pandas as pd
import pyspark

JayKimBravekjh

from threading import Thread
from time import sleep
import uuid

from dask.distributed import LocalCluster, Client
import dask.dataframe as dd
import pandas as pd
import pyspark

JayKimBravekjh

from __future__ import print_function
'''
Basic Multi GPU computation example using TensorFlow library.
Author: Aymeric Damien
Project: https://github.com/aymericdamien/TensorFlow-Examples/
'''

'''
This tutorial requires your machine to have 2 GPUs
"/cpu:0": The CPU of your machine.

JayKimBravekjh

from __future__ import print_function
'''
Basic Multi GPU computation example using TensorFlow library.
Author: Aymeric Damien
Project: https://github.com/aymericdamien/TensorFlow-Examples/
'''

'''
This tutorial requires your machine to have 2 GPUs
"/cpu:0": The CPU of your machine.