Skip to content

Instantly share code, notes, and snippets.

View l1x's full-sized avatar
🏠
Working from home

Istvan l1x

🏠
Working from home
View GitHub Profile

Keybase proof

I hereby claim:

  • I am l1x on github.
  • I am l1x (https://keybase.io/l1x) on keybase.
  • I have a public key ASCW3LuhleISdHbcI77ZHqThTbH0BUfhK58fm9eBuf9zxwo

To claim this, I am signing this object:

@l1x
l1x / convert_json_to_yaml.py
Last active August 24, 2022 21:53
Python 3 version of converting JSON to YAML one liner
python -c 'import sys, yaml, json; j=json.loads(sys.stdin.read()); print(yaml.safe_dump(j))'
# on windows(PS):
# Get-Content example.json | python -c 'import sys, yaml, json; j=json.loads(sys.stdin.read()); print(yaml.safe_dump(j))' > example.yaml
# on Unix clones
# python -c 'import sys, yaml, json; j=json.loads(sys.stdin.read()); print(yaml.safe_dump(j)) < example.json > example.yaml
@l1x
l1x / athena_size_time_statistics.sh
Last active September 17, 2019 09:11
One liner to print out runtime statistics for the last N Athena queries
export PROFILE=foxi-maxi
export REGION=eu-west-1
aws --region $REGION --profile $PROFILE athena list-query-executions --max-items 10 \
| jq '.QueryExecutionIds[]' \
| xargs -I {} aws --region $REGION --profile $PROFILE athena get-query-execution --query-execution-id {} \
| jq '.QueryExecution.Statistics'
@l1x
l1x / merge.parquet.py
Last active March 2, 2024 05:16
Merging Parquet files with Python
import os
import pyarrow.parquet as pq
#
# Warning!!!
# Suffers from the same problem as the parquet-tools merge function
#
#parquet-tools merge:
#Merges multiple Parquet files into one. The command doesn't merge row groups,
#just places one after the other. When used to merge many small files, the
@l1x
l1x / python.wat.moments.py
Created September 10, 2019 09:40
Wat moments while coding in Python
# nope
for folder in "state/" "logs/":
print(folder)
# nope #2
for folder in [ "state/" "logs/" ]:
print(folder)
# yes
for folder in "state/", "logs/":
print(folder)
xt1092
@l1x
l1x / git_alias.ps
Created May 29, 2019 12:36
Git aliases for PowerShell
function gpom { git pull origin master }
Set-Alias -Name pull -Value gpom
function gpod { git pull origin develop }
Set-Alias -Name gpod -Value gpod
@l1x
l1x / python.install.alpine.linux.sh
Last active May 7, 2019 18:06
Installing Python on Alpine
sudo apk add libffi-dev openssl-dev python2-dev musl-dev gcc py2-pip make cmake
pip install --user aws
use std::collections::HashMap;
use std::io;
use std::num::ParseFloatError;
use std::rc::Rc;
//
// Types
//
#[derive(Clone)]
@l1x
l1x / fish.prompt.sh
Last active May 2, 2019 08:20
Set up Fish shell prompt with tilde for home
function fish_prompt
set -g __branch \((git branch ^/dev/null | grep \* | sed 's/* //')\)
if test "$__branch = master"
set -g __git_prompt (set_color cyan)$__branch(set_color normal)
else
set -g __git_prompt (set_color orange)$__branch(set_color normal)
end
if test "$PWD" != "$HOME"
printf "%s %s > " (echo $PWD|sed -e 's|/private||' -e "s|^$HOME|~|") $__git_prompt