Akshay Chawla akshaychawla
gyglim
/ tensorboard_logging.py
Last active
August 23, 2023 21:29
Logging to tensorboard without tensorflow operations. Uses manually generated summaries instead of summary ops
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """Simple example on how to log scalars and images to tensorboard without tensor ops. | |
| License: BSD License 2.0 | |
| """ | |
| __author__ = "Michael Gygli" | |
| import tensorflow as tf | |
| from StringIO import StringIO | |
| import matplotlib.pyplot as plt | |
| import numpy as np |
akshaychawla
/ cscheduler.py
Last active
December 22, 2023 11:56
Learning rate schedulers for PyTorch. (1) Cosine annealing with warmup and (2) Linear with warmup
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Useful learning rate schedulers | |
| Warmup | |
| CosineAnnealingLRWarmup | |
| """ | |
| import torch | |
| import math | |
| import functools | |
| def _cosine_decay_warmup(iteration, warmup_iterations, total_iterations): |