Skip to content

Instantly share code, notes, and snippets.

@FavioVazquez

FavioVazquez/class_transfer.py

Created May 2, 2018 14:59
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save FavioVazquez/96e13301b6286eb7b52f34faedce4c24 to your computer and use it in GitHub Desktop.
Save FavioVazquez/96e13301b6286eb7b52f34faedce4c24 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
class_transfer.py
from pyspark.ml.classification import LogisticRegression
from pyspark.ml import Pipeline
from sparkdl import DeepImageFeaturizer
featurizer = DeepImageFeaturizer(inputCol="image", outputCol="features", modelName="InceptionV3")
lr = LogisticRegression(maxIter=10, regParam=0.05, elasticNetParam=0.3, labelCol="label")
p = Pipeline(stages=[featurizer, lr])
p_model = p.fit(train_df)
@Faheemkhaskheli
Copy link

i am getting this error on google colab, i can only install spark 0.2.2 version,
can you help how can i solve this error

from sparkdl import DeepImageFeaturizer
AttributeError: module 'sparkdl' has no attribute 'graph'

@taiwotman
Copy link

taiwotman commented Sep 26, 2019 •
edited

I faced a similar issue using Sparkdl. It seems the keras_image.py, where the error comes from, has been modified without the sparkdl graph attribute.
See: keras_image

@shwetamittal019
Copy link

any update on the same. Getting the error
module 'sparkdl' has no attribute 'utils'

while import from sparkdl import DeepImageFeaturizer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment