LiutongZhou

1. Squash commits into a single commit and rebase feature branch onto upstream/develop

   git fetch upstream && git rebase -i $(git merge-base feature_name upstream/develop)

2. Cleanup git repository aggressively

   use bfg https://rtyley.github.io/bfg-repo-cleaner/

   java -jar bfg.jar --delete-files your_unwanted_files

LiutongZhou

{
      // For a full list of commands, refer 
      // https://github.com/jupyterlab/jupyterlab/blob/master/packages/notebook-extension/src/index.ts
"shortcuts":[
      {
         "command":"notebook:run-all-above",
         "keys":[
            "F5"
         ],
         "selector":".jp-Notebook:focus"

LiutongZhou

# pip install autopep8 pylint flake8 black blackcellmagic yapf

Program: autopep8
Arguments: --in-place --aggressive --aggressive $FilePath$
Working Directory: $ProjectFileDir$
Regular expression to match output：$FILE_PATH$:$LINE$:$COLUMN$:.*

Program: pylint
Arguments: "--msg-template='{abspath}:{line}: [{msg_id}({symbol}), {obj}] {msg}'" --output-format=colorized "$FilePath$"
Working directory: $ProjectFileDir$

LiutongZhou

sudo yum --enablerepo=extras install centos-release-scl;
sudo yum install devtoolset-7;
scl enable devtoolset-7 bash

LiutongZhou

# Add to ~/.bash_aliases
alias port_forward='nohup ssh -N -f -L localhost:8889:localhost:8889 username:password@remote_server_ip'
alias remote_notebook_start='nohup ssh -f username:password@remote_server_ip "cd rne; conda activate env_name; jupyter notebook --no-browser --port=8889"; port_forward'
alias remote_notebook_stop='ssh username:password@remote_server_ip "pkill -u username jupyter"'
# Add this to crontab -e
@reboot cd /home/{username}; source ./.bashrc;  ./miniconda3/envs/{env_name}/bin/jupyter-lab >> ./cronrun.log 2>&1

LiutongZhou

import functools
from typing import Any, Mapping


def singleton(cls):
    '''a class decorator that wraps class definition so that only one class instance can exist'''
    existing_instances = dict() 
    @functools.wraps(cls)
    def singleton_class(*args, **kwargs): 
        if cls not in existing_instances:

LiutongZhou

#  Copyright 2020 Amazon.com, Inc. or its affiliates. All Rights Reserved.
#  SPDX-License-Identifier: LicenseRef-.amazon.com.-AmznSL-1.0
#  Licensed under the Amazon Software License  http://aws.amazon.com/asl/

"""S3 Client

A helper class which wraps boto3's s3 service
"""

__author__ = "Liutong Zhou"

LiutongZhou

Setup Cloud9 on EC2 and remote Jupyter

Create an EC2 instance on AWS

• Launch: t3.2xlarge ($0.33/h) / m5d.4xlarge ($0.904) / g4dn.4xlarge ($1.2/h) / p3.2xlarge ($3.02/h)
• Image: Deep Learning AMI (Ubuntu 22.04)
• Configure Security Group:
  • open custom TCP and port 9999
  • open HTTPS, HTTP to anywhere
• Attach an Elastic IP to the instance

ssh into EC2 from MobaXterm and run

LiutongZhou

""" Time-and-Space-Efficient Sampling Methods"""
from typing import Iterable
from random import random, randint, seed
from math import exp, log, floor
from itertools import islice

__author__ = "Liutong Zhou"


def take(iterable, n: int) -> list:

LiutongZhou

"""UnionFind (Disjoint Sets)"""

from typing import Optional, Iterable, Hashable, Any


class UnionFind:
    def __init__(
        self, initial_disjoint_items: Optional[Iterable[Hashable]] = None
    ):
        """Initialize a UnionFind of disjoint sets"""