Skip to content

Instantly share code, notes, and snippets.

@tastyminerals
Created January 29, 2018 16:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tastyminerals/a8b54c088aeb23d2a6759386f40c5ef1 to your computer and use it in GitHub Desktop.
Save tastyminerals/a8b54c088aeb23d2a6759386f40c5ef1 to your computer and use it in GitHub Desktop.
Testing DL4J multiiter
// init DL4J seq readers
val seqWordsReader = new CSVSequenceRecordReader()
seqWordsReader.initialize(new FileSplit(new File(wordsFileSavePath)))
val seqFeatsReader = new CSVSequenceRecordReader()
seqFeatsReader.initialize(new FileSplit(new File(featsFileSavePath)))
val seqLabelsReader = new CSVSequenceRecordReader()
seqLabelsReader.initialize(new FileSplit(new File(labelsFileSavePath)))
// wrap the readers into multi iterator
val batchSize = 1
val numOfClasses = 2
val multiIter = new RecordReaderMultiDataSetIterator.Builder(batchSize)
.addSequenceReader("wordsReader", seqWordsReader)
.addSequenceReader("featsReader", seqFeatsReader)
.addSequenceReader("labelsReader", seqLabelsReader)
.addInput("wordsReader")
.addInput("featsReader")
.addOutput("labelsReader")
.build()
while (multiIter.hasNext()) {
val ds = multiIter.next()
println(ds)
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment