Skip to content

Instantly share code, notes, and snippets.

View elamdf's full-sized avatar

Elam Day-Friedland elamdf

  • PhD Student
  • MIT
View GitHub Profile
### Keybase proof
I hereby claim:
* I am elamdf on github.
* I am elamdf (https://keybase.io/elamdf) on keybase.
* I have a public key ASAuW4YoRtdTGl5sAHSKkyYz7hr7zYnaZreddqYule-8LQo
To claim this, I am signing this object:
set -o pipefail
mkdir -p ~/Downloads
cd ~/Downloads
git clone https://github.com/neovim/neovim.git
cd neovim
make CMAKE_EXTRA_FLAGS="-DCMAKE_INSTALL_PREFIX=$HOME/.neovim"
make install
echo "export PATH=$HOME/.neovim/bin:$PATH" >> ~/.bashrc
echo "alias vi=nvim" >> ~/.bashrc
git clone https://github.com/elamdf/nvim.git ~/.config/nvim
@elamdf
elamdf / seriation_analysis.py
Created April 27, 2024 01:15
Elam's Anthro 2AC Data Analysis
import pandas as pd
import matplotlib.pyplot as plt
# Load your dataset
data = pd.read_csv('anthroseriationdatafinal.csv')
data['Date of Death'] = pd.to_datetime(data['Date of Death'], errors='coerce') # make misinputs play nice
language_grouped = data.groupby('Which Language used')['Age at Death']
average_age_by_language = language_grouped.mean()
@elamdf
elamdf / .tmux.conf
Last active May 22, 2023 03:16
tmux conf
unbind C-b
set-option -g prefix C-a
bind-key C-a last-window
set -g default-command $SHELL
bind-key f run-shell "tmux neww tms"
@elamdf
elamdf / dist_resnet.py
Last active April 16, 2022 00:35
distributed training for sky w/ goofys and catfs v0.0.1
import getpass
import subprocess
from typing import List, Optional
import uuid
import sky
# (username, mac addr last 4 chars): for uniquefying users on shared-account
# cloud providers.
_user_and_mac = f'{getpass.getuser()}-{hex(uuid.getnode())[-4:]}'
@elamdf
elamdf / cached_resnet.yaml
Created April 1, 2022 20:09
cached_resent rerunnable n times
name: resnet-app-storage
workdir: ~/Downloads/tpu
resources:
cloud: gcp
accelerators: V100:1
num_nodes: 1
file_mounts:
~/.aws/credentials: ~/.aws/credentials
@elamdf
elamdf / cached_resnet.yaml
Created March 24, 2022 05:55
sky resnet training example with fuse caching
name: resnet-app-storage
workdir: ~/Downloads/tpu
# THE TPU FOLDER MUST CONTAIN sky.sh (seen below)
resources:
cloud: gcp
accelerators: V100:1
num_nodes: 1
file_mounts:
@elamdf
elamdf / cached_resnet.yaml
Created March 20, 2022 02:02
sky script for cached goofys resnet train
name: resnet-app-storage
workdir: ~/Downloads/tpu
resources:
cloud: gcp
# instance_type: p3.2xlarge
instance_type: n1-highmem-8
# storage: List[sky.Storage]
@elamdf
elamdf / repro.sh
Created March 15, 2022 20:37
Goofys cache/no cache benchmarking for Sky
#!/bin/bash
if [ $# -eq 0 ]; then
cache=0
else
if [ $1 -eq 1 ]; then
cache=1
else
cache=0
fi
#!/bin/python3
from os import walk
from os.path import exists
import os
import subprocess
from subprocess import run, PIPE
from timeit import timeit
import csv
from datetime import datetime
import pickle