Skip to content

Instantly share code, notes, and snippets.

View mpkocher's full-sized avatar

M. Kocher mpkocher

View GitHub Profile
@mpkocher
mpkocher / smrtlink-scraper.py
Last active July 10, 2018 23:53
smrtlink-scraper.py
@mpkocher
mpkocher / Readme.md
Last active October 2, 2019 15:06
SMRT Link System and Test Dependencies

SMRT Link Dependencies

DOT Legend

Shape (and Color) Description
RECT DOTTED Third party dependency
OVAL GREEN Build Output
RECT BitBucket Repo
@mpkocher
mpkocher / output_example.txt
Last active June 28, 2017 16:34
pbcommand validation example of commandline arg directory
09:33 $ python /Users/mkocher/repos/pbcommand/extras/validation_argparse_option_example.py log
(pbsmrtpipe_test) ✔ ~/scratch_pad/verify-bugs/SL-1512
09:33 $ python /Users/mkocher/repos/pbcommand/extras/validation_argparse_option_example.py dir-that-does-not-exist
ls: cannot access 'dir-that-does-not-exist': No such file or directory
Traceback (most recent call last):
File "/Users/mkocher/repos/pbcommand/extras/validation_argparse_option_example.py", line 19, in <module>
sys.exit(main(argv=sys.argv[1:]))
File "/Users/mkocher/repos/pbcommand/extras/validation_argparse_option_example.py", line 14, in main
p.parse_args(argv)
File "/Users/mkocher/miniconda2/envs/pbsmrtpipe_test/lib/python2.7/argparse.py", line 1701, in parse_args
@mpkocher
mpkocher / install-zeppelin-r-dep.sh
Created May 4, 2017 18:40
Install the Zeppelin R dependencies for 0.7.1
#!/bin/bash
declare -a packages=("devtools" "knitr" "ggplot2" "mplot" "googleVis" "data.table" "caret" "pRoc" "sqldf" "glmnet")
declare -a ghpackages=("ramnathv/rCharts")
for i in "${packages[$@]}"; do
echo "Attempting to install '${i}'"
R -e "install.packages('${i}', repos = 'http://cran.us.r-project.org')"
done
@mpkocher
mpkocher / hmac_example.py
Created April 26, 2017 04:04
Example HMAC for Eve and SL Auth
import hashlib
import hmac
import math
import datetime
import base64
def to_h(secret, method, segment, t=None):
"""
Example:
@mpkocher
mpkocher / process_smrtlink_log.R
Last active October 2, 2019 15:07
Example of Plotting TimeStamps in R using the SL log
@mpkocher
mpkocher / MergeDataSetProfile.ipynb
Last active October 2, 2019 15:08
SMRT Link Merge DataSet RunTime Profile
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mpkocher
mpkocher / snaker.py
Created March 5, 2017 11:16
Possible Pure Python SnakeMake API
from snakemake.core import SnakeMakeShellRule, SnakeMakePyRule, AllRule
class CollectReferences(SnakeMakeShellRule):
ID = "collect_references"
THREADS = 8
DESCRIPTION = "Does some stuff"
def inputs():
return dict(alpha="f1.fasta")
@mpkocher
mpkocher / ServicesDataflowComponentsOverView.md
Last active October 2, 2019 15:09
SMRT Link Services + Dataflow + Components High Level Overview

SMRT Link System Architecture High Level Overview

The SMRT Link System is comprised of 6 core components:

  • SMRT Link System Installer for general admin, configuring the system, and upgrading
  • SMRT Link Tools Commandline tools written in python, c++ and scala from the SAT and SL team
  • SMRT Link Analysis Services (SLA) Scala driven webservices using spray framework
  • SMRT Link Tomcat WebServer For SMRT Link UI written in Javascript/Typescript using angular2
  • SMRT View Visualization of SMRT Link Analysis Jobs
  • Enterprise WSO2 API Manager for authentication and authorization
@mpkocher
mpkocher / Pbservice2.scala
Last active February 24, 2017 20:47
Example of Pbservice2
package com.pacbio.secondary.smrtserver.tools
import java.util.UUID
import akka.actor.ActorSystem
import com.pacbio.secondary.analysis.jobs.JobModels.EngineJob
import com.pacbio.secondary.analysis.reports.ReportModels.Report
import com.pacbio.secondary.smrtlink.models.{DataSetMetaDataSet, DataStoreReportFile}
import com.pacbio.secondary.smrtserver.client.AnalysisServiceAccessLayer