This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
def cycle_hyper_param(low, high): | |
'''Dynamically oscillate a hyper-parameter between two values. | |
Uses the loss momentum to adjust the rate of change. The idea is | |
that the value should move through regions where the loss is flat | |
faster, and linger in values where the loss improves. | |
''' | |
inc = 0.0001 | |
trend = 0. | |
prev = 0. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env bash | |
# First download cudnn to a directory /tmp/binaries. | |
# The filename should be cudnn-9.2-linux-x64-v7.1.tgz | |
set -e | |
# Install driver | |
sudo add-apt-repository ppa:graphics-drivers/ppa | |
sudo apt-get update |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
"""See https://twitter.com/honnibal/status/1120020992636661767 """ | |
import time | |
import srsly | |
from prodigy import recipe | |
from prodigy.components.db import connect | |
from prodigy.util import INPUT_HASH_ATTR, set_hashes | |
from prodigy.components.filters import filter_duplicates | |
def get_rank_priority(data): |
OlderNewer