J Seppänen jseppanen

## jarvislabs_launch.py
"""
Launch new JarvisLabs instance to run a training script.

Please edit your JarvisLabs (and Weights & Biases) credentials below. Also, you first
need to upload `run_base64.sh` as a startup script in JarvisLabs UI and enter its
script id below.

The instance will have PyTorch and an RTX5000 GPU.

Usage:

## sander_lr.py
from torch.optim.lr_scheduler import LambdaLR


class SanderLR(LambdaLR):
    """Linear warmup -> constant -> 10x decay.

    Badly tuned LR decay schedules are an excellent way to silently shoot yourself
    in the foot. Models can often look like they are converging but it's just LR
    getting too low too fast. FixedLR (+optional warmup) with 1 manual decay of 10X
    on plateau is a safe strong baseline.

## keybase.md

      
              1 file
            
          
              0 forks
            
          
              0 comments
            
          
              0 stars
            
          
                jseppanen
                / keybase.md
            
            
              Created
              February 6, 2016 17:13
            
              
                Keybase proof
              
          
    Keybase proof

I hereby claim:

I am jseppanen on github.
I am jseppanen (https://keybase.io/jseppanen) on keybase.
I have a public key ASBoSoFDDWQfvmRk0_pzlJ4Eg1qOuWdQcQeulDgH9DeHlwo

To claim this, I am signing this object:
	"""
	Launch new JarvisLabs instance to run a training script.

	Please edit your JarvisLabs (and Weights & Biases) credentials below. Also, you first
	need to upload `run_base64.sh` as a startup script in JarvisLabs UI and enter its
	script id below.

	The instance will have PyTorch and an RTX5000 GPU.

	Usage:
	from torch.optim.lr_scheduler import LambdaLR


	class SanderLR(LambdaLR):
	"""Linear warmup -> constant -> 10x decay.

	Badly tuned LR decay schedules are an excellent way to silently shoot yourself
	in the foot. Models can often look like they are converging but it's just LR
	getting too low too fast. FixedLR (+optional warmup) with 1 manual decay of 10X
	on plateau is a safe strong baseline.