Skip to content

Instantly share code, notes, and snippets.

View wasade's full-sized avatar

Daniel McDonald wasade

View GitHub Profile
#!/bin/bash
#SBATCH -t 24:00:00
#SBATCH -N 1
#SBATCH -n 1
#SBATCH --array 1-97
cd /home/mcdonadt/agp_demux_barcode_assessment-8.4.21
source activate qiime2-2020.11
export TMPDIR=/panfs/dtmcdonald/
python processor.py demux.details $SLURM_ARRAY_TASK_ID
@wasade
wasade / summarize-q2-demux-stats.py
Last active August 9, 2021 14:58
summarize q2-demux stats
import qiime2
import pandas as pd
import glob
from collections import defaultdict
import sys
import time, os
details = [l.strip() for l in open(sys.argv[1])]
f = details[int(sys.argv[2]) - 1]
@wasade
wasade / q2-2017.2.0.mvp.sh
Last active September 9, 2017 15:29
Run the MVP tutorial for q2 2017.2.0 using q2-deblur
#!/bin/bash
set -e
set -x
envname=q2deblur_mvp_test
executiondir=mvp
redeploy=$1
source deactivate
@wasade
wasade / sparcc.py
Created July 28, 2016 00:15
Get SparCC correlations and a network
# python 2
# conda install biom-format -c bioconda
# conda install matplotlib # pysurvey setup.py is incomplete
# pip install -e "hg+https://bitbucket.org/yonatanf/pysurvey#egg=pysurvey"
# note: the pysurvey build in pypi does not work. unsure why.
import click
# this little gem is because pysurvey depends on an older version of scipy
# and attempts to import nanmedian from scipy.stats. This is a dirty hack.
@wasade
wasade / snappy_unifrac.py
Last active August 15, 2016 17:37
Block decomposition method for unifrac + rapid subsetting of biom direct from disk + joblib + balanced parentheses tree
import numpy as np
import bp
import biom
import skbio
import sys
import joblib
import h5py
class biom_counts_wrapper(object):
def __init__(self, table_f):
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@wasade
wasade / agmissing.ipynb
Created April 13, 2016 20:09
AG samples not in "clean" metadata
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@wasade
wasade / joblib_poc.ipynb
Last active March 18, 2016 22:16
Example of using joblib to run systemcalls in parallel complete with ipy magics
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@wasade
wasade / joblib_poc
Created March 18, 2016 21:41
Example using joblib for running systemcalls in parallel
{
"cells": [
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": []