Sunny SunnyBingoMe

## Spark high availability.md

      
              1 file
            
          
              0 forks
            
          
              0 comments
            
          
              0 stars
            
          
                SunnyBingoMe
                / Spark high availability.md
            
            
              Created
              February 28, 2019 15:53
                — forked from aseigneurin/Spark high availability.md
            
              
                Spark - High availability
              
          
    Spark - High availability

Components in play

As a reminder, here are the components in play to run an application:

The cluster:

Spark Master: coordinates the resources
Spark Workers: offer resources to run the applications


The application:


## install_mosh_server_non_root.sh
#!/bin/sh

# tested in Ubuntu 14.04 manually.
# this script does absolutely ZERO error checking.   however, it worked
# for me on a RHEL 6.3 machine on 2012-08-08.  clearly, the version numbers
# and/or URLs should be made variables.  cheers,  zmil...@cs.wisc.edu


mkdir mosh
cd mosh
	#!/bin/sh

	# tested in Ubuntu 14.04 manually.
	# this script does absolutely ZERO error checking. however, it worked
	# for me on a RHEL 6.3 machine on 2012-08-08. clearly, the version numbers
	# and/or URLs should be made variables. cheers, zmil...@cs.wisc.edu


	mkdir mosh
	cd mosh