Skip to content

Instantly share code, notes, and snippets.


Masanori Yamada MasanoriYamada

  • Tokyo, Japan
View GitHub Profile
MasanoriYamada /
Created Dec 27, 2019 — forked from sbarratt/
Get the jacobian of a vector-valued function that takes batch inputs, in pytorch.
def get_jacobian(net, x, noutputs):
x = x.squeeze()
n = x.size()[0]
x = x.repeat(noutputs, 1)
y = net(x)
from __future__ import print_function
import threading
from joblib import Parallel, delayed
import Queue
import os
# Fix print
_print = print
_rlock = threading.RLock()
def print(*args, **kwargs):
MasanoriYamada /
Created Jul 2, 2016 — forked from karpathy/
Training a Neural Network ATARI Pong agent with Policy Gradients from raw pixels
""" Trains an agent with (stochastic) Policy Gradients on Pong. Uses OpenAI Gym. """
import numpy as np
import cPickle as pickle
import gym
# hyperparameters
H = 200 # number of hidden layer neurons
batch_size = 10 # every how many episodes to do a param update?
learning_rate = 1e-4
gamma = 0.99 # discount factor for reward
# Description:
# Joke commands.
# Commands:
# ぬるぽ - You reply with, "ガッ" When you post a "ぬるぽ" word.
# Notes:
# ネタ/ジョーク系のbot全般
module.exports = (robot) ->