Skip to content

Instantly share code, notes, and snippets.

@black0017
black0017 / lars.py
Created August 20, 2021 12:42
LARS_SGD_optimizer_Pytorch
from torch.optim.optimizer import Optimizer, required
import torch
# almost copy paste from https://github.com/noahgolmant/pytorch-lars/blob/master/lars.py
class LARS(Optimizer):
r"""Implements LARS (Layer-wise Adaptive Rate Scaling).
Args:
params (iterable): iterable of parameters to optimize or dicts defining
parameter groups
lr (float): learning rate
@black0017
black0017 / k-nn-ssl-pytorch.py
Last active July 9, 2021 09:30
K-NN for unsupervised evaluation of self-supervised learning in Pytorch/sklearn
"""
A K-NN implemented with pytorch data loading for evaluation of
self-supervised pretraining
Authors: Nikolas Adaloglou, Nima Rafiee
MIT Licence
Copyright © 2021 Nikolas Adaloglou, Nima Rafiee
Permission is hereby granted, free of charge, to any person