To be able to use custom endpoints with the latest Spark distribution, one needs to add an external package (hadoop-aws). Then, custum endpoints can be configured according to docs.
bin/spark-shell --packages org.apache.hadoop:hadoop-aws:2.7.2
Pierre Gronlier ticapix
thomasdarimont
/ docker-compose.yml
Created
January 25, 2019 17:52
Docker OpenLDAP + phpldapadmin example
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| version: '2' | |
| services: | |
| openldap: | |
| image: osixia/openldap:1.2.3 | |
| container_name: openldap | |
| environment: | |
| LDAP_LOG_LEVEL: "256" | |
| LDAP_ORGANISATION: "Example Inc." | |
| LDAP_DOMAIN: "example.org" | |
| LDAP_BASE_DN: "" |
exocode
/ xfs-on-hetzner.yml
Last active
June 18, 2024 16:07
Create xfs partitions on Hetzner via cloud-init. It keeps root disk available again after rebooting. Simply change your desired sizes and filesystem to use it for your needs.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #cloud-config | |
| resize_rootfs: false | |
| disk_setup: | |
| /dev/sda: | |
| table_type: 'mbr' | |
| layout: | |
| - 25 | |
| - 75 | |
| overwrite: true |
tobilg
/ custom_s3_endpoint_in_spark.md
Last active
May 22, 2023 14:57
Description on how to use a custom S3 endpoint (like Rados Gateway for Ceph)
willprice
/ .travis.yml
Last active
June 15, 2024 04:29
How to set up TravisCI for projects that push back to github
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Ruby is our language as asciidoctor is a ruby gem. | |
| lang: ruby | |
| before_install: | |
| - sudo apt-get install pandoc | |
| - gem install asciidoctor | |
| script: | |
| - make | |
| after_success: | |
| - .travis/push.sh | |
| env: |
mastbaum
/ custom_directive.py
Created
May 10, 2012 20:32
Example of a custom ReST directive in Python docutils
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| '''Example of a custom ReST directive in Python docutils''' | |
| import docutils.core | |
| from docutils.nodes import TextElement, Inline | |
| from docutils.parsers.rst import Directive, directives | |
| from docutils.writers.html4css1 import Writer, HTMLTranslator | |
| class foo(Inline, TextElement): | |
| '''This node class is a no-op -- just a fun way to define some parameters. | |
| There are lots of base classes to choose from in `docutils.nodes`. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!doctype html> | |
| <html> | |
| <head> | |
| <meta charset="utf-8"> | |
| <title>Page Title</title> | |
| <meta name="description" content="Webpage for xxxx"> | |
| <!-- http://meyerweb.com/eric/tools/css/reset/ --> | |
| <link rel="stylesheet" href="css/reset/reset.css"> | |
| <!--[if lt IE 9]> | |
| <script src="//html5shiv.googlecode.com/svn/trunk/html5.js" type="text/javascript"></script> |