Neil Patel neil90
vgiri2015
/ Spark2.0FileCompression.scala
Created
August 19, 2016 03:30
File Compression in Spark 2.0
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.{SQLContext, SparkSession} | |
| import org.apache.spark.{SparkConf, SparkContext} | |
| /** | |
| * Created by vgiridatabricks on 8/13/16. | |
| */ | |
| object FileCompression { | |
| case class DataFrameSample(name: String, actor: String, episodeDebut: String) |
aws-scripting-guy
/ gist:884ffa9d44bd14f7493a670543284552
Created
April 2, 2016 18:33
AWS EC2 metadata. Check attached IAM role from EC2 instance. Get temporary credentials.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Get IAM Role name from Instance Profile Id | |
| curl http://169.254.169.254/latest/meta-data/iam/info | |
| # Get credentials | |
| curl http://169.254.169.254/latest/meta-data/iam/security-credentials/<role-name> | |
| # More info | |
| http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-instance-metadata.html | |