| I moved this script to repo: https://github.com/PolideaInternal/airflow-pianka-sh |
| from datetime import datetime, timedelta | |
| import networkx as nx | |
| from airflow import DAG | |
| from airflow.operators import BashOperator, SubDagOperator | |
| start_date = datetime(year=2017, month=6, day=13, hour=19, minute=0) | |
| schedule_interval = '0 * * * 1-5' | |
| default_args = { |
Today at LunchConf we watched this talk by Bret Victor on "Media for Thinking the Unthinkable". Here are some additional links that came up in our discussion after watching the talk.
Early in August 2016 Microsoft released the Windows 10 Anniversary Update. There were a number of changes, but the one that got me to actually take the time to install the update was "Bash on Ubuntu on Windows". This feature would install Ubuntu Linux without the kernel. It would run linux in user-mode. Linux would run the commands while Windows does all the work/processing.
For an upcoming project I needed to get Kubernetes running. Being as Kubernetes is not able to be run in Windows the normally accepted way to procees is to create a virtual Linux box and run it from there. I wanted to see if Kubernetes would run in Bash on Ubuntu on Windows.
This is how I got it to work:
| package main | |
| import ( | |
| "encoding/json" | |
| "fmt" | |
| "net/http" | |
| "net/url" | |
| "strconv" | |
| "strings" | |
| ) |
| #!/bin/bash | |
| # output format is like this: | |
| # upload: index.html to s3://$BUCKET/index.html | |
| # | |
| # so we grab the second item which is the file path and pass that via xargs to the | |
| # cloudfront invalidation command | |
| aws s3 sync --sse AES256 s3://$BUCKET/ site/ | awk '{print $2;}' | \ | |
| xargs aws cloudfront create-invalidation --distribution-id $CF_DISTRO_ID --paths |
| #!/bin/sh | |
| command="${*}" | |
| printf "Initialized REPL for `%s`\n" "$command" | |
| printf "%s> " "$command" | |
| read -r input | |
| while [ "$input" != "" ]; | |
| do | |
| eval "$command $input" | |
| printf "%s> " "$command" |
| Finally posting my 389-page tutorial | |
| "data science @ the new york times" | |
| from last week's Machine Learning Summer School | |
| in Arequipa, Peru ( http://mlss.cc/ ) | |
| here: http://www.slideshare.net/chrishwiggins/machine-learning-summer-school-2016 | |
| Topics include: | |
| descriptive/predictive/prescriptive modeling | |
| (unsupervised/supervised/reinforcement learning), |
A curated list of AWS resources to prepare for the AWS Certifications
A curated list of awesome AWS resources you need to prepare for the all 5 AWS Certifications. This gist will include: open source repos, blogs & blogposts, ebooks, PDF, whitepapers, video courses, free lecture, slides, sample test and many other resources.
| alias accio=wget | |
| alias avadaKedavra='rm -f' | |
| alias imperio=sudo | |
| alias priorIncantato='echo `history |tail -n2 |head -n1` | sed "s/[0-9]* //"' | |
| alias stupefy='sleep 5' | |
| alias wingardiumLeviosa=mv | |
| alias sonorus='set -v' | |
| alias quietus='set +v' |
