Skip to content

Instantly share code, notes, and snippets.

@frankfliu
frankfliu / serving.properties
Created January 5, 2022 19:50
Example serving.properties file
# serving.properties can be used to define model's metadata, all the arguments will be
# passed to TranslatorFactory to create proper Translator
# defines model's application
application=nlp/question_answer
# defines the model's engine, can be overrid by Criteria.optEngine()
engine=PyTorch
# defines TranslatorFactory, can be overrid by Criteria.optTranslator() or Criteria.optTranslatorFactory()
@frankfliu
frankfliu / LoadModelFromLocalFile.java
Created January 5, 2022 03:26
Load PyTorch model from local file
import ai.djl.Application;
import ai.djl.ModelException;
import ai.djl.inference.Predictor;
import ai.djl.modality.Classifications;
import ai.djl.modality.cv.Image;
import ai.djl.modality.cv.ImageFactory;
import ai.djl.repository.zoo.Criteria;
import ai.djl.repository.zoo.ZooModel;
import ai.djl.translate.TranslateException;
@frankfliu
frankfliu / LoadModelFromHttpURL
Created January 5, 2022 02:57
Load PyTorch model from HTTP URL
import ai.djl.Application;
import ai.djl.ModelException;
import ai.djl.inference.Predictor;
import ai.djl.modality.Classifications;
import ai.djl.modality.cv.Image;
import ai.djl.modality.cv.ImageFactory;
import ai.djl.repository.zoo.Criteria;
import ai.djl.repository.zoo.ZooModel;
import ai.djl.translate.TranslateException;
@frankfliu
frankfliu / LoadModelFromHdfs.java
Last active January 5, 2022 02:58
Load PyTorch model from HDFS
import ai.djl.Application;
import ai.djl.ModelException;
import ai.djl.inference.Predictor;
import ai.djl.modality.Classifications;
import ai.djl.modality.cv.Image;
import ai.djl.modality.cv.ImageFactory;
import ai.djl.repository.zoo.Criteria;
import ai.djl.repository.zoo.ZooModel;
import ai.djl.translate.TranslateException;
@frankfliu
frankfliu / LoadModelFromJar.java
Last active January 27, 2022 09:57
Load PyTorch model for jar file
import ai.djl.Application;
import ai.djl.ModelException;
import ai.djl.inference.Predictor;
import ai.djl.modality.Classifications;
import ai.djl.modality.cv.Image;
import ai.djl.modality.cv.ImageFactory;
import ai.djl.repository.zoo.Criteria;
import ai.djl.repository.zoo.ZooModel;
import ai.djl.translate.TranslateException;
@frankfliu
frankfliu / Example.java
Created December 27, 2021 17:37
DJL blockrunner example
package ai.djl.examples;
import ai.djl.inference.Predictor;
import ai.djl.modality.Classifications;
import ai.djl.modality.cv.*;
import ai.djl.modality.cv.transform.*;
import ai.djl.modality.cv.translator.*;
import ai.djl.repository.zoo.*;
public class Example {