Skip to content

Instantly share code, notes, and snippets.


Masanori Yamada MasanoriYamada

  • Tokyo, Japan
View GitHub Profile
# Description:
# Joke commands.
# Commands:
# ぬるぽ - You reply with, "ガッ" When you post a "ぬるぽ" word.
# Notes:
# ネタ/ジョーク系のbot全般
module.exports = (robot) ->
MasanoriYamada /
Created Jul 2, 2016 — forked from karpathy/
Training a Neural Network ATARI Pong agent with Policy Gradients from raw pixels
""" Trains an agent with (stochastic) Policy Gradients on Pong. Uses OpenAI Gym. """
import numpy as np
import cPickle as pickle
import gym
# hyperparameters
H = 200 # number of hidden layer neurons
batch_size = 10 # every how many episodes to do a param update?
learning_rate = 1e-4
gamma = 0.99 # discount factor for reward
from __future__ import print_function
import threading
from joblib import Parallel, delayed
import Queue
import os
# Fix print
_print = print
_rlock = threading.RLock()
def print(*args, **kwargs):
MasanoriYamada /
Created Dec 27, 2019 — forked from sbarratt/
Get the jacobian of a vector-valued function that takes batch inputs, in pytorch.
def get_jacobian(net, x, noutputs):
x = x.squeeze()
n = x.size()[0]
x = x.repeat(noutputs, 1)
y = net(x)