Peter Flook pflooky
👀
pflooky
/ OpenMetadataGenerateValidate.scala
Created
December 7, 2023 01:56
Example of Data Caterer connecting to OpenMetadata to generate and validate data in JSON and CSV file. Customised field values for JSON file as well.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| class AdvancedOpenMetadataSourcePlanRun extends PlanRun { | |
| val openMetadataSource = metadataSource.openMetadata( | |
| "http://host.docker.internal:8585/api", | |
| OPEN_METADATA_AUTH_TYPE_OPEN_METADATA, | |
| Map( | |
| OPEN_METADATA_JWT_TOKEN -> "abc123", //find under settings/bots/ingestion-bot/token | |
| OPEN_METADATA_TABLE_FQN -> "sample_data.ecommerce_db.shopify.raw_customer" | |
| ) | |
| ) |
pflooky
/ after_json_patch_pod.yaml
Created
January 11, 2022 00:21
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| apiVersion: v1 | |
| kind: Pod | |
| metadata: | |
| name: test-pod | |
| spec: | |
| containers: | |
| - image: k8s.gcr.io/test-webserver | |
| name: test-container | |
| volumeMounts: | |
| - name: tmp-dir |
pflooky
/ before_json_patch_pod.yaml
Created
January 11, 2022 00:20
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| apiVersion: v1 | |
| kind: Pod | |
| metadata: | |
| name: test-pod | |
| spec: | |
| containers: | |
| - image: k8s.gcr.io/test-webserver | |
| name: test-container |
pflooky
/ json_patch_add_volume.json
Created
January 11, 2022 00:18
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [ | |
| { | |
| "op": "add", | |
| "path": "/spec/volumes/-", | |
| "value": { | |
| "name": "tmp-dir", | |
| "emptyDir": {} | |
| } | |
| }, | |
| { |
pflooky
/ mutating_webhook_rules.yaml
Created
December 23, 2021 09:05
Rules section for Kubernetes mutating webhook configuration
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| rules: | |
| - operations: ["CREATE"] | |
| apiGroups: ["*"] | |
| apiVersions: ["*"] | |
| resources: ["pods"] | |
| objectSelector: | |
| matchLabels: | |
| app: backend |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "Version": "2012-10-17", | |
| "Statement": [ | |
| { | |
| "Action": [ | |
| "s3:PutObject" | |
| ], | |
| "Effect": "Allow", | |
| "Resource": [ | |
| "arn:aws:s3:::secret-bucket/*" |
pflooky
/ spark_write_s3_policy.json
Last active
January 13, 2022 08:04
Minimum AWS permissions needed for Spark to write a file to S3
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "Version": "2012-10-17", | |
| "Statement": [ | |
| { | |
| "Action": [ | |
| "s3:GetObject", | |
| "s3:PutObject", | |
| "s3:ListObject", | |
| "s3:DeleteObject" | |
| ], |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| Green='\033[0;32m' | |
| echo -e "${Green} Installing all apps under $HOME/install folder" | |
| mkdir ~/install | |
| cd install | |
| #Homebrew | |
| echo -e "${Green} Installing homebrew..." | |
| mkdir homebrew && curl -L https://github.com/Homebrew/brew/tarball/master | tar xz --strip 1 -C homebrew |
pflooky
/ twitch_ad_block.js
Created
October 5, 2020 05:47
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # https://github.com/uBlockOrigin/uAssets/pull/3517 | |
| twitch-videoad.js application/javascript | |
| (function() { | |
| if ( /(^|\.)twitch\.tv$/.test(document.location.hostname) === false ) { return; } | |
| var realFetch = window.fetch; | |
| window.fetch = function(input, init) { | |
| if ( arguments.length >= 2 && typeof input === 'string' && input.includes('/access_token') ) { | |
| var url = new URL(arguments[0]); | |
| url.searchParams.forEach(function(value, key) { | |
| url.searchParams.delete(key); |