Skip to content

Instantly share code, notes, and snippets.

@mr1azl
mr1azl / 0-self-publishing.md
Created August 31, 2022 08:43 — forked from caseywatts/0-self-publishing.md
Self-Publishing via Markdown
{
"schema": {
"type": "struct",
"fields": [{
"type": "int32",
"optional": false,
"field": "id"
}, {
"type": "struct",
"name": "data",
@mr1azl
mr1azl / load_parquet_s3.py
Created December 12, 2018 11:45 — forked from asmaier/load_parquet_s3.py
Pyspark script for downloading a single parquet file from Amazon S3 via the s3a protocol. It also reads the credentials from the "~/.aws/credentials", so we don't need to hardcode them. See also https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html .
#
# Some constants
#
aws_profile = "your_profile"
aws_region = "your_region"
s3_bucket = "your_bucket"
#
# Reading environment variables from aws credential file
#
@mr1azl
mr1azl / android
Last active August 10, 2017 16:54
`android update sdk --no-ui --filter build-tools-24.0.0,android-24,extra-android-m2repository`
```
sudo apt-get install -y lib32gcc1 libc6-i386 lib32z1 lib32stdc++6
sudo apt-get install -y lib32ncurses5 lib32gomp1 lib32z1-dev
cordova build --platform android
cordova build --platform android --release
```
* DataFlow example : https://github.com/GoogleCloudPlatform/dataflow-opinion-analysis
* scientific labs : https://codelabs.developers.google.com/cloud-quest-scientific-data
* BigQuery + AirFlow : https://cloud.google.com/blog/big-data/2017/07/how-to-aggregate-data-for-bigquery-using-apache-airflow
*
@mr1azl
mr1azl / .block
Created December 6, 2016 15:56 — forked from Bl3f/.block
Simple D3.js heatmap
license: WTFPL
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.