Skip to content

Instantly share code, notes, and snippets.

View brockpalen's full-sized avatar

Brock Palen brockpalen

View GitHub Profile
@brockpalen
brockpalen / setup-xsede-gsi.sh
Created November 7, 2015 20:16
Globus Toolkit 6.0 and XSEDE GSI integration
#download and install Globus toolkit, get version 6.0
tar -xzf globus_toolkit-6.0.1443479657.tar.gz
cd globus_toolkit-6.0.1443479657
#enable GSI and myproxy for myproxy-login
./configure --prefix=<INSTALL_PREFIX> --enable-myproxy
make -j 12
make install
#setup location for XSEDE Certificates
@brockpalen
brockpalen / logstash-gridftp.conf
Last active August 29, 2015 14:22
logstash GridFTP config
#Brock Palen brockp@umich.edu
# 5/2015
# GridFTP config for Logstash
input {
#track the globus gridftp transfer logs
file {
path => [ "/var/log/gridftp-go.log" ]
sincedb_path => "/var/run/logstash-gridftp.sincedb"
@brockpalen
brockpalen / blas_speed.cpp
Created April 1, 2015 15:07
Simple BLAS 1, 2, and 3 benchmark code
#include <iostream>
#include <stdlib.h>
#include <sys/time.h>
#include <unistd.h>
//#define DIM 20000
/*****
Total size used should be DIM*DIM*sizeof(double)
compute the matrix multiply dgemm
@brockpalen
brockpalen / mpiLibConf.m
Created February 3, 2015 01:51
mpiLibConf.m
function [lib, extras] = mpiLibConf
%MATLAB MPI Library overloading for Infiniband and Ethernet Networks
%
%USAGE
% place in ~/matlab/mpiLibConf.m
% Update to point to your MPICH / Intel MPI etc location
% mvapich has two extra libraries libmpl.so and libopa.so
% use # ldd /home/software/rhel6/mvapich2/1.8/lib/libmpich.so
% Any libraries from the mpich/mvapich install location need to be included in extras
@brockpalen
brockpalen / benchmarkpct.m
Created January 10, 2015 17:46
MATLAB Parallel Computing Toolbox Demo
function benchmarkpct(ncpus)
sched= findResource('scheduler', 'type', 'mpiexec') ;
set(sched, 'EnvironmentSetMethod', 'setenv')
set(sched, 'MpiexecFileName', '/home/software/rhel6/mpiexec/bin/mpiexec')
sched
%get current mpi library
mpiLibConf
@brockpalen
brockpalen / json-stats-wrapper.py
Last active March 29, 2017 20:40
Lustre Logstash Files
#!/usr/bin/python
#Brock Palen
# brockp@umich.edu
#
'''
Takes data in the form of:
metric number
@brockpalen
brockpalen / flux.sh
Last active August 29, 2015 14:07
Demenstrate the use of MATLAB MCC to make standalone executables.
#compile source on Flux
module load matlab/2014a
mcc -m implicitthreads.m
#run blender in batch, take all settings from those saved in the .blend file
#http://wiki.blender.org/index.php/Doc:2.6/Manual/Render/Command_Line
blender -b blender.blend -o //imagename -F PNG -x 1 -f 1
@brockpalen
brockpalen / gridftp-log
Last active August 29, 2015 14:04
example gridftp log entry
"message" => "[3743] Wed Jul 16 09:34:54 2014 :: Transfer stats: DATE=20140716133454.587582 HOST=flux-xfer1.engin.umich.edu PROG=globus-gridftp-server NL.EVNT=FTP_INFO START=20140716133453.570157 USER=brockp FILE=/tmp/brockp/linux_x64_64_sfx.exe BUFFER=87380 BLOCK=262144 NBYTES=280590752 VOLUME=/ STREAMS=4 STRIPES=1 DEST=[141.212.30.10] TYPE=RETR CODE=226",
@brockpalen
brockpalen / build.sh
Last active August 29, 2015 14:03
Building your own Xsede Single Sign On Service
tar -xjf gt<version>-all-source-installer.tar.bz2
cd gt<version>-all-source-installer
./configure --prefix=/home/brockp/gt5.0.4
make globus-data-management-client
make gsi-myproxy
make install