Skip to content

Instantly share code, notes, and snippets.

View shenkev's full-sized avatar

Tingke Shen shenkev

9 followers · 4 following
View GitHub Profile
@shenkev
shenkev / Load file with memory fix
Created May 2, 2020 17:25
def generate_dict(path):
type_map = {
**{k: np.uint8 for k in range(0, 4)},
**{k: np.float32 for k in range(4, 4+297)},
**{k: np.float32 for k in range(301, 369)},
**{k: np.int32 for k in range(370, 372)},
}
@shenkev
shenkev / loop.py
Created November 19, 2017 02:20
Gist affiliated with Stackoverflow https://stackoverflow.com/questions/47372815/tensorflow-every-iteration-of-for-loop-gets-slower-and-slower
from __future__ import print_function
import numpy as np
import tensorflow as tf
import edward as ed
import pickle
from mcmc.util import plot, plot_save
from mcmc.mcmc2 import run_experiment, compare_vae_hmc_loss
@shenkev
shenkev / test.ipynb
Last active November 6, 2017 17:46
test
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@shenkev
shenkev / Untitled1.ipynb
Created November 6, 2017 17:41
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@shenkev
shenkev / test.html
Created May 24, 2017 18:08
onHover response for each parameter
<!DOCTYPE html>
<html lang="en">
<head>
<title>Test</title>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.2.1/jquery.min.js"></script>
</head>
@shenkev
shenkev / Component.js
Last active May 11, 2017 23:01
// Preview.js
let Preview = (props) => {
const {username, tex} = props;
return (
<div>{username}</div>
<div>$${tex}$$</div>
)
}
@shenkev
shenkev / Error Console Output
Created December 5, 2016 04:58
ArbiterUIServer.getInstance() throws NoClassDefFoundError
20:55:54.494 [main] INFO org.reflections.Reflections - Reflections took 178 ms to scan 12 urls, producing 29 keys and 172 values
20:55:54.801 [main] INFO o.d.a.s.l.m.LocalMultiLayerNetworkSaver - LocalMultiLayerNetworkSaver saving networks to local directory: ./hyperParamSearch/
Exception in thread "main" java.lang.NoClassDefFoundError: org/hibernate/validator/spi/valuehandling/ValidatedValueUnwrapper
at io.dropwizard.Application.run(Application.java:68)
at org.deeplearning4j.arbiter.optimize.ui.ArbiterUIServer.getInstance(ArbiterUIServer.java:153)
at RandomGridSearch.main(RandomGridSearch.java:183)
Caused by: java.lang.ClassNotFoundException: org.hibernate.validator.spi.valuehandling.ValidatedValueUnwrapper
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
@shenkev
shenkev / train
Created December 4, 2016 22:48
Configuration and training file
//Initialize the user interface backend
UIServer uiServer = UIServer.getInstance();
//Configure where the network information (gradients, score vs. time etc) is to be stored. Here: store in memory.
StatsStorage statsStorage = new InMemoryStatsStorage(); //Alternative: new FileStatsStorage(File), for saving and loading later
//Attach the StatsStorage instance to the UI: this allows the contents of the StatsStorage to be visualized
uiServer.attach(statsStorage);
Object[] dat = offlineTraining.loadOfflineDat();
@shenkev
shenkev / Error
Created December 4, 2016 22:47
Out of memory console error
! @729lio93n - Internal server error, for (GET) [/train/overview/data] ->
play.api.http.HttpErrorHandlerExceptions$$anon$1: Execution exception[[InvocationTargetException: null]]
at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:265) ~[play_2.10-2.4.6.jar:2.4.6]
at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:191) ~[play_2.10-2.4.6.jar:2.4.6]
at play.core.server.netty.PlayDefaultUpstreamHandler$$anonfun$9$$anonfun$apply$1.applyOrElse(PlayDefaultUpstreamHandler.scala:151) [play-netty-server_2.10-2.4.6.jar:2.4.6]
at play.core.server.netty.PlayDefaultUpstreamHandler$$anonfun$9$$anonfun$apply$1.applyOrElse(PlayDefaultUpstreamHandler.scala:148) [play-netty-server_2.10-2.4.6.jar:2.4.6]
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:33) [scala-library-2.10.5.jar:na]
at scala.util.Failure$$anonfun$recover$1.apply(Try.scala:185) [scala-library-2.10.5.jar:na]
at scala.util.Try$.apply(Try.scala:161) [scala-l
@shenkev
shenkev / NN
Created December 3, 2016 23:38
// Network Parameters
int rngSeed = 123; // random number seed for reproducibility
final Random rng = new Random(rngSeed);
OptimizationAlgorithm algo = OptimizationAlgorithm.STOCHASTIC_GRADIENT_DESCENT;
int iterations = 1; //Number of iterations per minibatch
String hiddenAct = "tanh";
String outAct = "tanh";
Updater updater = Updater.ADAGRAD;
// Learning Parameters