This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
**When I run the example in "dl4j-spark-examples/dl4j-spark/src/main/java/org.deeplearning4j/mlp/MnistMLPExample.java", I find some Error as below: | |
I have updata dl4j-example to 0.7.1 version | |
And I can train the network, but some Error in evaluation period.** | |
```java | |
16/11/24 16:12:55 ERROR YarnScheduler: Lost executor 1 on longzhou-hdp4.lz.dscc: Container marked as failed: container_1479880322401_0153_02_000002 on host: longzhou-hdp4.lz.dscc. Exit status: 134. Diagnostics: Exception from container-launch. | |
Container id: container_1479880322401_0153_02_000002 | |
Exit code: 134 | |
Exception message: /bin/bash: line 1: 30037 Aborted (core dumped) /home/work/java//bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms8192m -Xmx8192m '-Dorg.deeplearning4j.spark.time.TimeSource=org.deeplearning4j.spark.time.SystemClockTimeSource' -Djava.io.tmpdir=/home/disk1/yarn/usercache/zhangliang/appcache/application_1479880322401_0153/container_1479880322401_0153_02_000002/tmp '-Dspark.driver.port=50840' -Dspark.yarn |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package org.deeplearning4j.examples.feedforward.mnist; | |
import org.datavec.api.io.labels.ParentPathLabelGenerator; | |
import org.datavec.api.split.FileSplit; | |
import org.datavec.image.loader.NativeImageLoader; | |
import org.datavec.image.recordreader.ImageRecordReader; | |
import org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator; | |
import org.deeplearning4j.eval.Evaluation; | |
import org.deeplearning4j.nn.api.OptimizationAlgorithm; | |
import org.deeplearning4j.nn.conf.MultiLayerConfiguration; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The ERROR is as below: | |
Exception in thread "main" java.lang.ExceptionInInitializerError | |
at org.nd4j.nativeblas.NativeOpsHolder.<init>(NativeOpsHolder.java:16) | |
at org.nd4j.nativeblas.NativeOpsHolder.<clinit>(NativeOpsHolder.java:9) | |
at org.nd4j.linalg.cpu.nativecpu.ops.NativeOpExecutioner.<init>(NativeOpExecutioner.java:37) | |
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) | |
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) | |
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) | |
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) | |
at java.lang.Class.newInstance(Class.java:442) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package org.deeplearning4j.mlp; | |
import com.beust.jcommander.JCommander; | |
import com.beust.jcommander.Parameter; | |
import com.beust.jcommander.ParameterException; | |
import org.apache.hadoop.io.BytesWritable; | |
import org.apache.hadoop.io.Text; | |
import org.apache.hadoop.mapred.SequenceFileOutputFormat; | |
import org.apache.spark.SparkConf; | |
import org.apache.spark.api.java.JavaPairRDD; | |
import org.apache.spark.api.java.JavaRDD; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
When I use MnistMLPPreprocessed.java to submit spark job. An ERROR find as below: | |
``` | |
Exception in thread "main" java.lang.NullPointerException | |
at org.deeplearning4j.spark.stats.StatsUtils.exportStatsAsHtml(StatsUtils.java:93) | |
at org.deeplearning4j.spark.stats.StatsUtils.exportStatsAsHtml(StatsUtils.java:79) | |
at org.deeplearning4j.spark.stats.StatsUtils.exportStatsAsHtml(StatsUtils.java:66) | |
at org.deeplearning4j.mlp.MnistMLPPreprocessed.entryPoint(MnistMLPPreprocessed.java:150) | |
at org.deeplearning4j.mlp.MnistMLPPreprocessed.main(MnistMLPPreprocessed.java:68) | |
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
When I compile the project "dl4j-examples" and use command: | |
``` | |
git clone https://github.com/deeplearning4j/dl4j-examples.git | |
cd dl4j-examples/ | |
mvn clean install | |
``` | |
but I get some ERROR as below: | |
``` | |
[INFO] DeepLearning4j Examples Parent .................... SUCCESS [0.382s] |