Skip to content

Instantly share code, notes, and snippets.

View jinpan's full-sized avatar

Jin Pan jinpan

11 followers · 0 following
View GitHub Profile
@jinpan
jinpan / my_adam_wd
Created June 18, 2020 19:17
def my_adam_step(p, lr, mom, mom_damp, step, sqr_mom, sqr_damp, grad_avg, sqr_avg, eps, wd, **kwargs):
debias1 = debias(mom, mom_damp, step)
debias2 = debias(sqr_mom, sqr_damp, step)
grad_avg_debiased = grad_avg / debias1
grad_var_debiased = sqr_avg / debias2
p.data = p.data - lr * ((grad_avg_debiased) / (grad_var_debiased.sqrt() + eps) + wd * p.data)
return p
my_adam_step._defaults = dict(eps=1e-5, wd=0.)
@jinpan
jinpan / baseline_wd
Created June 18, 2020 19:05
for seed in (7, 42, 10914):
fix_seeds(seed)
learn,run = get_learn_run(nfs, data, 0.001, conv_layer, cbs=cbfs, opt_func=adam_opt(wd=1e-2))
run.fit(10, learn)
print('-'*80)
@jinpan
jinpan / baseline
Created June 18, 2020 19:04
for seed in (7, 42, 10914):
fix_seeds(seed)
learn,run = get_learn_run(nfs, data, 0.001, conv_layer, cbs=cbfs, opt_func=adam_opt())
run.fit(10, learn)
print('-'*80)
@jinpan
jinpan / index.html
Created July 30, 2016 08:47
duff's device (http://jsbench.github.io/#627af6079d4ec404f5e2a98993d3b42a) #jsbench #jsperf
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8"/>
<title>duff's device</title>
<script src="https://cdnjs.cloudflare.com/ajax/libs/benchmark/1.0.0/benchmark.min.js"></script>
<script src="./suite.js"></script>
</head>
<body>
<h1>Open the console to view the results</h1>
@jinpan
jinpan / index.html
Last active July 30, 2016 07:17
caching array length (http://jsbench.github.io/#1e5e7b15abe4e5be288ddfa6f23ec885) #jsbench #jsperf
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8"/>
<title>caching array length</title>
<script src="https://cdnjs.cloudflare.com/ajax/libs/benchmark/1.0.0/benchmark.min.js"></script>
<script src="./suite.js"></script>
</head>
<body>
<h1>Open the console to view the results</h1>
@jinpan
jinpan / index.html
Created July 28, 2016 02:48
Set vs Array (http://jsbench.github.io/#057395600504bb113d08d028fd1ac0ca) #jsbench #jsperf
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8"/>
<title>Set vs Array</title>
<script src="https://cdnjs.cloudflare.com/ajax/libs/benchmark/1.0.0/benchmark.min.js"></script>
<script src="./suite.js"></script>
</head>
<body>
<h1>Open the console to view the results</h1>
@jinpan
jinpan / index.html
Last active July 24, 2016 02:50
Math.random vs Math.sin (http://jsbench.github.io/#f8f884c637666139edc1c95855e61f54) #jsbench #jsperf
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8"/>
<title>Math.random vs Math.sin</title>
<script src="https://cdnjs.cloudflare.com/ajax/libs/benchmark/1.0.0/benchmark.min.js"></script>
<script src="./suite.js"></script>
</head>
<body>
<h1>Open the console to view the results</h1>
@jinpan
jinpan / index.html
Created July 22, 2016 21:12
looping (http://jsbench.github.io/#4ee227ba4699e433c8406b118bf73166) #jsbench #jsperf
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8"/>
<title>looping</title>
<script src="https://cdnjs.cloudflare.com/ajax/libs/benchmark/1.0.0/benchmark.min.js"></script>
<script src="./suite.js"></script>
</head>
<body>
<h1>Open the console to view the results</h1>
@jinpan
jinpan / index.html
Last active July 6, 2016 06:37
Array sizes vs Lookup speed #jsbench #jsperf (https://jsbench.github.io/#30270be3d6d834b6c78f96e0297c0eec) #jsbench #jsperf
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8"/>
<title>Array sizes vs Lookup speed #jsbench #jsperf</title>
<script src="https://cdnjs.cloudflare.com/ajax/libs/benchmark/1.0.0/benchmark.min.js"></script>
<script src="./suite.js"></script>
</head>
<body>
<h1>Open the console to view the results</h1>
@jinpan
jinpan / fib
Created June 7, 2016 19:00
f = function*(__wl_agt, __wl_scp){ ;
;
let __wl_171_param_name = String("n");
;
;