Skip to content

Instantly share code, notes, and snippets.

@yarax

yarax/properties

Last active March 8, 2022 15:11
Show Gist options
  • Save yarax/22cbda4617c1f0b5239f5a80c0c4e9db to your computer and use it in GitHub Desktop.
Save yarax/22cbda4617c1f0b5239f5a80c0c4e9db to your computer and use it in GitHub Desktop.
Download ZIP
Raw
properties
| Parameter | Description | Type |
|----------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------------|
| spark.hadoop.fs.s3a.access.key | The access key of your user. | textarea |
| spark.hadoop.fs.s3a.secret.key | The secret key of your user. | textarea |
| spark.hadoop.fs.s3a.endpoint | The hostname/IP of your S3 server. | textarea |
| spark.hadoop.fs.s3a.aws.credentials.provider | The credential provider for your connection. For simple authentication with secret and access key use: org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider | textarea |
| spark.hadoop.fs.s3a.path.style.access | Sets if path style access is supported by the S3 server. Should be activated in general. | textarea with true/false or Checkbox |
| spark.hadoop.fs.s3a.connection.ssl.enabled | Wether your connection uses SSL or not. | textarea with true/false or Checkbox |
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment