James Harden xiandong79

## using-tensorflow-in-emr-with-sparklyr.md

      
              1 file
            
          
              1 fork
            
          
              1 comment
            
          
              3 stars
            
          
                javierluraschi
                / using-tensorflow-in-emr-with-sparklyr.md
            
            
              Last active
              January 20, 2020 16:53
            
              
                Using TensorFlow in EMR with sparklyr
              
          
    A script to demonstrate using TensorFlow in Spark with Amazon EMR and sparklyr.

Create an EMR cluster for sparklyr, connect to EMR and install required tools:

install.packages(tensorflow)
devtools::install_github("rstudio/tfdeploy")

Connect to Spark using sparklyr, copy some data and the mtcars TensorFlow model:


## periodic.py
#!/usr/bin/env python2
from threading import Event, Thread


class Periodic(object):
    """Periodically run a function with arguments asynchronously in the background

    Period is a float of seconds.
    Don't expect exact precision with timing.
    Threading is used instead of Multiprocessing because we need shared memory
	#!/usr/bin/env python2
	from threading import Event, Thread


	class Periodic(object):
	"""Periodically run a function with arguments asynchronously in the background

	Period is a float of seconds.
	Don't expect exact precision with timing.
	Threading is used instead of Multiprocessing because we need shared memory