Skip to content

Instantly share code, notes, and snippets.

import argparse
import boto3
class ClusterDestroyer:
"""Destroy all ParallelCluster clusters in a given region."""
def __init__(self, region, dryrun):
self.__created_clusters = []
self.region = region
@sean-smith
sean-smith / pcluster_networking.md
Last active May 11, 2020 20:47
Setup AWS ParallelCluster with a subnet in a specific Availibility Zone

AWS ParallelCluster Specific AZ Deployment

To use AWS ParallelCluster in a specific Availibility Zone, do the following:

  1. In the VPC Dashboard , click "VPC Wizard"

image

@sean-smith
sean-smith / schedulers.md
Last active July 30, 2020 00:19
Scheduler Cheatsheet for AWS ParallelCluster

General

sge slurm torque
Submit Interactive Job qlogin srun qsub -I
Submit Batch Job qsub sbatch qsub
Number of Slots -pe mpi [n] -n [n] -l ppn=[n]
Number of Nodes -pe mpi [slots * n] -N [n] -l nodes=[n]
Cancel Job qdel scancel qdel
See Queue qstat squeue qstat
@sean-smith
sean-smith / intel_psxe_install.md
Created July 31, 2020 23:13
Install Intel Parallel Studio on AWS ParallelCluster

Install Intel Parallel Studio Runtime on AWS ParallelCluster

Tested on Amazon Linux 2

On all AWS ParallelCluster clusters /opt/intel is already shared out via NFS:

$ showmount -e
Export list for ip-172-31-41-183:
@sean-smith
sean-smith / Spack_Binary_cache.md
Last active October 5, 2020 16:34
Create a Cluster with Spack Binary Cache

Create a Cluster with Spack Binary Cache

package install command working?
openfoam spack install --no-check-signature --cache-only openfoam
gromacs spack install --no-check-signature --cache-only gromacs
ior spack install --no-check-signature --cache-only ior
osu-micro-benchmarks spack install --no-check-signature --cache-only osu-micro-benchmarks

Intel Select Solution

Intel Select Solution Cluster Setup

  1. Create a cluster using the following config, the keypair, VPC, subnet and region are automatically picked off your Cloud9 instance.

If you're not using Cloud9, subsitute the variables ${VPC_ID}, ${SUBNET_ID}, ${REGION} and make a keypair (or use your own called intel-cluster

@sean-smith
sean-smith / ec2_ipython.md
Last active February 15, 2021 23:09
iPython using EC2 and LetsEncrypt

Setup an iPython Notebook on AWS with LetsEncrypt Certificate

The first step is to setup an EC2 Ubuntu 16.04 instance that you can ssh into. I won't go into detail here but you should be able to easily google it.

You can get free AWS credit here https://education.github.com/pack

A better guide w/ pictures is here: https://chrisalbon.com/jupyter/run_project_jupyter_on_amazon_ec2.html (Note this doesn't include LetsEncrypt, so it only has self signed certificates)

Once you've setup an instance and ssh'd in, do the following:

@sean-smith
sean-smith / ls_dyna.md
Last active April 2, 2021 23:50
LS-Dyna Setup on SOCA

Setup LS-Dyna on SOCA 2.6.1

Part 1: LS-Dyna Installation

  1. First download the correct binary,

You can download the LS-Dyna binaries here (password protected): https://ftp.lstc.com/user/mpp-dyna/

Screen Shot 2021-04-02 at 4 45 41 PM

@sean-smith
sean-smith / intel.md
Last active May 6, 2021 00:35
Intel Select Solution Setup