baoGia1404

## setup-notes.md

      
        
          
            
              
              1 file
            
          
          
            
              
              10 forks
            
          
          
            
              
              9 comments
            
          
          
            
              
              33 stars
            
          
        
        
          
              
          
          
            
                eddies
                / setup-notes.md
            
            
              Created
              July 29, 2016 08:00
            
              
                Spark 2.0.0 and Hadoop 2.7 with s3a setup
              
          
        
      
        
  
      
    Standalone Spark 2.0.0 with s3

###Tested with:

Spark 2.0.0 pre-built for Hadoop 2.7
Mac OS X 10.11
Python 3.5.2

Goal

Use s3 within pyspark with minimal hassle.