Cosmin Catalin SANDA cosmincatalin

## readme.md

      
              2 files
            
          
              1 fork
            
          
              0 comments
            
          
              7 stars
            
          
                cosmincatalin
                /  readme.md
            
            
              Last active
              October 27, 2022 11:07
            
              
                AWS EMR bootstrap to install R packages from CRAN
              
          
    AWS EMR bootstrap to install R packages from CRAN

This bootstrap is useful if you want to deploy SparkR applications that run arbitrary code on the EMR cluster's workers. The R code will need to have its dependencies already installed on each of the workers, and will fail otherwise.
This is the case if you use functions such as gapply or dapply.
How to use the bootstrap


You will first have to download the gist to a file and then upload it to S3 in a bucket of your choice.
Using the AWS EMR Console create a cluster and choose advanced options.
In Step 3 you can configure your bootstraps. Choose to Configure and add a Custom action


## install-jupyter.sh
#!/bin/bash

MINICONDA_VERSION="4.3.21"
PANDAS_VERSION="0.20.3"
SCIKIT_VERSION="0.19.0"

while [[ $# > 1 ]]; do
    key="$1"

    case $key in
	#!/bin/bash

	MINICONDA_VERSION="4.3.21"
	PANDAS_VERSION="0.20.3"
	SCIKIT_VERSION="0.19.0"

	while [[ $# > 1 ]]; do
	key="$1"

	case $key in