- workflow
- site catalog
- replica catalog (text)
- transformation catalog (text)
- braindump (text)
API Docs: https://pegasus.isi.edu/docs/5.0.0dev/python.html#python-api
API Docs: https://pegasus.isi.edu/docs/5.0.0dev/python.html#python-api
pegasus-em create <ensemble name>
pegasus-em trigger <ensemble name> <trigger name> <prefix> <pattern> <interval> <workflow script>
At each interval, file names matching the given pattern(s) and which have a modification date s.t.
(time now - interval) <= mod date < time now, will be given as arguments to the workflow script. The workflow
will be planned and submitted as <ensemble name>.<prefix>_<time now or runXXX>
.
Example:
# Ubuntu 18.04 | |
from nvidia/cuda:10.1-base | |
# set locale | |
ENV LANG C.UTF-8 | |
# install linux packages | |
RUN apt update && apt install -y \ | |
software-properties-common \ | |
wget \ |
#!/bin/bash | |
for i in {1..3} | |
do | |
sleep 1 | |
echo "$i .. doing some work ..., these are fake logs" | |
done |