Skip to content

Instantly share code, notes, and snippets.

View makmanalp's full-sized avatar

Mehmet Ali "Mali" Akmanalp makmanalp

View GitHub Profile
@makmanalp
makmanalp / eb.md
Created April 6, 2017 18:52
Elastic beanstalk python gotchas

Config not being run / used

Don't forget to actually commit the config or run eb deploy --staged. Also eb deploy -v gives you a detailed view of which config files get pushed.

Where are my application logs?

/var/log/httpd/error.log (unless you put them elsewhere, this is where stdout goes)

I set WSGIPath right and it's still not working, I get 500 errors

You need to name the variable with the WSGI application application. Naming it app as is flask convention won't work.

@makmanalp
makmanalp / fillin.py
Created April 5, 2017 16:09
STATA fillin in pandas
def fillin(df, entities):
"""STATA style 'fillin', makes sure all combinations of entities in the
index are in the dataset."""
return df\
.set_index(entities)\
.reindex(pd.MultiIndex.from_product(df.index.levels, names=df.index.names))
@makmanalp
makmanalp / indent.json
Created March 15, 2017 16:17
Weird python json pretty printing that puts many tiny items on their own lines
{
"neighbors":{
"2":[
441
],
"3":[
29,
31
],
"4":[
@makmanalp
makmanalp / list.md
Last active March 9, 2017 03:45
30 women in tech with awesome twitters that you should follow
@makmanalp
makmanalp / rectangularize.py
Last active December 12, 2018 19:56
monchtangularize / rectangularize data
from collections import OrderedDict
from itertools import product
def rectangularize(data, keys):
"""Make sure there is a row in the dataset for each unique combination of
values for the given keys.
E.g. If your rows are:
[
h = {}
h[5] = 10
k = h.get(10, None)
is_missing = (k == None)
del h[5]
for k,v in h.items():
if v is not None:
h[k]=v
@makmanalp
makmanalp / khash_example.c
Created August 25, 2016 04:10
KHash example
#include "khash.h"
KHASH_MAP_INIT_INT(32, char)
int main() {
int ret, is_missing;
khiter_t k;
khash_t(32) *h = kh_init(32);
k = kh_put(32, h, 5, &ret);
kh_value(h, k) = 10;
k = kh_get(32, h, 10);
is_missing = (k == kh_end(h));
@makmanalp
makmanalp / shift_columns.py
Created August 17, 2016 20:36
Shift a column down by n rows in pandas
def shift_columns(df, key_columns, data_columns, shift_years, year_column="year"):
"""Shift given data columns by n years in order to be able to later compute deltas."""
shifted = df[key_columns + data_columns].copy()
shifted[year_column] = shifted[year_column] - shift_years
new_column_names = {x: (x + "_plus" + str(shift_years))
for x in data_columns}
shifted = shifted.rename_axis(new_column_names, axis="columns")
return shifted
#eg
drwxr-xr-x 12 makmana HKS\Domain Users 408 Jul 5 10:19 .
drwxr-xr-x 33 makmana HKS\Domain Users 1122 Jul 5 10:18 ..
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 0
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 1
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 2
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 3
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 a
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 AA
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 b
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 BB
drwxr-xr-x 12 makmana HKS\Domain Users 408 Jul 5 10:19 .
drwxr-xr-x 33 makmana HKS\Domain Users 1122 Jul 5 10:18 ..
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 0
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 1
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 2
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 3
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 a
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 AA
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 b
-rw-r--r-- 1 makmana HKS\Domain Users 0 Jul 5 10:19 BB