ryantanaka

#!/bin/bash
for i in {1..3}
do
    sleep 1
    echo "$i .. doing some work ..., these are fake logs"
done

ryantanaka

# Ubuntu 18.04
from nvidia/cuda:10.1-base

# set locale
ENV LANG C.UTF-8

# install linux packages
RUN apt update && apt install -y \
        software-properties-common \
        wget \

ryantanaka

Trigger Usage

1. pegasus-em create <ensemble name>
2. pegasus-em trigger <ensemble name> <trigger name> <prefix> <pattern> <interval> <workflow script>

• At each interval, file names matching the given pattern(s) and which have a modification date s.t. (time now - interval) <= mod date < time now, will be given as arguments to the workflow script. The workflow will be planned and submitted as <ensemble name>.<prefix>_<time now or runXXX>.

• Example:

ryantanaka

Pegasus 5.0 Notes

XML -> YAML

• workflow
• site catalog
• replica catalog (text)
• transformation catalog (text)
• braindump (text)

Python API

API Docs: https://pegasus.isi.edu/docs/5.0.0dev/python.html#python-api