Skip to content

Instantly share code, notes, and snippets.

View yilaguan's full-sized avatar

Dwayne Glenn yilaguan

View GitHub Profile
@yilaguan
yilaguan / Core-dump_in_MnistMLPExamlple.java.txt
Last active November 24, 2016 08:45
"Core-dumped" in MnistMLPExample.java
**When I run the example in "dl4j-spark-examples/dl4j-spark/src/main/java/org.deeplearning4j/mlp/MnistMLPExample.java", I find some Error as below:
I have updata dl4j-example to 0.7.1 version
And I can train the network, but some Error in evaluation period.**
```java
16/11/24 16:12:55 ERROR YarnScheduler: Lost executor 1 on longzhou-hdp4.lz.dscc: Container marked as failed: container_1479880322401_0153_02_000002 on host: longzhou-hdp4.lz.dscc. Exit status: 134. Diagnostics: Exception from container-launch.
Container id: container_1479880322401_0153_02_000002
Exit code: 134
Exception message: /bin/bash: line 1: 30037 Aborted (core dumped) /home/work/java//bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms8192m -Xmx8192m '-Dorg.deeplearning4j.spark.time.TimeSource=org.deeplearning4j.spark.time.SystemClockTimeSource' -Djava.io.tmpdir=/home/disk1/yarn/usercache/zhangliang/appcache/application_1479880322401_0153/container_1479880322401_0153_02_000002/tmp '-Dspark.driver.port=50840' -Dspark.yarn
@yilaguan
yilaguan / The Load model is as below
Last active November 18, 2016 07:53
The Score is low when I load the model to predict the testing data.
package org.deeplearning4j.examples.feedforward.mnist;
import org.datavec.api.io.labels.ParentPathLabelGenerator;
import org.datavec.api.split.FileSplit;
import org.datavec.image.loader.NativeImageLoader;
import org.datavec.image.recordreader.ImageRecordReader;
import org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator;
import org.deeplearning4j.eval.Evaluation;
import org.deeplearning4j.nn.api.OptimizationAlgorithm;
import org.deeplearning4j.nn.conf.MultiLayerConfiguration;
@yilaguan
yilaguan / gist:322bb6db5fd2d27bc0b41e89d8231ef2
Created November 16, 2016 03:44
ERROR: in thread "main" java.lang.ExceptionInInitializerError and no jnind4j in java.library.path
The ERROR is as below:
Exception in thread "main" java.lang.ExceptionInInitializerError
at org.nd4j.nativeblas.NativeOpsHolder.<init>(NativeOpsHolder.java:16)
at org.nd4j.nativeblas.NativeOpsHolder.<clinit>(NativeOpsHolder.java:9)
at org.nd4j.linalg.cpu.nativecpu.ops.NativeOpExecutioner.<init>(NativeOpExecutioner.java:37)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at java.lang.Class.newInstance(Class.java:442)
package org.deeplearning4j.mlp;
import com.beust.jcommander.JCommander;
import com.beust.jcommander.Parameter;
import com.beust.jcommander.ParameterException;
import org.apache.hadoop.io.BytesWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapred.SequenceFileOutputFormat;
import org.apache.spark.SparkConf;
import org.apache.spark.api.java.JavaPairRDD;
import org.apache.spark.api.java.JavaRDD;
@yilaguan
yilaguan / gist:333b6078efa15aefb3ddb9e003366eba
Last active October 14, 2016 09:54
MnistMLPPreprocessed.java Exception in thread "main" java.lang.NullPointerException
When I use MnistMLPPreprocessed.java to submit spark job. An ERROR find as below:
```
Exception in thread "main" java.lang.NullPointerException
at org.deeplearning4j.spark.stats.StatsUtils.exportStatsAsHtml(StatsUtils.java:93)
at org.deeplearning4j.spark.stats.StatsUtils.exportStatsAsHtml(StatsUtils.java:79)
at org.deeplearning4j.spark.stats.StatsUtils.exportStatsAsHtml(StatsUtils.java:66)
at org.deeplearning4j.mlp.MnistMLPPreprocessed.entryPoint(MnistMLPPreprocessed.java:150)
at org.deeplearning4j.mlp.MnistMLPPreprocessed.main(MnistMLPPreprocessed.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
@yilaguan
yilaguan / gist:604bb659b67f3334265afa59929b30cb
Last active October 14, 2016 02:41
Project nd4j-example: Compilation failure: Compilation failure
When I compile the project "dl4j-examples" and use command:
```
git clone https://github.com/deeplearning4j/dl4j-examples.git
cd dl4j-examples/
mvn clean install
```
but I get some ERROR as below:
```
[INFO] DeepLearning4j Examples Parent .................... SUCCESS [0.382s]