yadudoc

Release Process

This is a first attempt at documenting the release process and the various testing/dev processes that go into making master release ready. Following is a checklist of items that are to be cleared for the 0.9.0 release

Checklist

Documentation updates :

yadudoc

yadudoc

yadudoc

{
  "data": [
    {
      "core_hrs": 1.47, 
      "lat": "41.7813", 
      "long": "-87.6051", 
      "org": "AS160 University of Chicago"
    }, 
    {
      "core_hrs": 1.2, 

yadudoc

#!/usr/bin/env python3

import argparse
import time
import os
import glob
import parsl
from parsl.app.app import python_app, bash_app
from parsl import File

yadudoc

rom parsl.providers import LocalProvider
from parsl.channels import SSHChannel
from parsl.executors import HighThroughputExecutor

from parsl.config import Config

username = "yadunand"
remotes = ['midway2-login1.rcc.uchicago.edu', 'midway2-login2.rcc.uchicago.edu']

config = Config(

yadudoc

import parsl
import os
from sample_configs import threads_config, cori_config

if os.environ.get('PIPELINE_ENV', 'test'):
    parsl.load(threads_config)
else:
    parsl.load(cori_config)
    
#... rest of the pipeline...

yadudoc

@python_app
def pi(num_points):
    from random import random
    inside = 0
    for i in range(num_points):
        x, y = random(), random()  # Drop a random point in the box.
        if x**2 + y**2 < 1:        # Count points within the circle.
            inside += 1
    return (inside*4 / num_points)

yadudoc

import argparse
import time
import signal
from functools import wraps

import parsl
from parsl.configs.htex_local import config
from parsl.app.app import python_app

parsl.set_stream_logger()

yadudoc

Let's say you are connecting from SiteA to SiteB via OAuth SSH [1]. I assume that the oauth-ssh client is installed on SiteA and the server is installed and running on SiteB.

First try setting up the oath tokens:

oauth-ssh-token authorize -l <SiteB_URL>

Ensure that you can connect to the SiteB:

oauth-ssh <SiteB_URL>

Install the globus-ssh branch, into your python env. I recommend you use virtualenv or conda, whichever