Skip to content

Instantly share code, notes, and snippets.

@KernelA
Created October 27, 2021 21:29
Show Gist options
  • Save KernelA/8a271e8880a726028a6302e7e974b8e0 to your computer and use it in GitHub Desktop.
Save KernelA/8a271e8880a726028a6302e7e974b8e0 to your computer and use it in GitHub Desktop.
Jupyter Lab with Scala and Spark
FROM bde2020/spark-master:3.1.1-hadoop3.2
RUN apk add gcc python3-dev linux-headers libc-dev libffi-dev g++
RUN --mount=type=cache,target=/root/.cache/pip pip3 install spylon-kernel jupyterlab~=3.2
RUN python3 -m spylon_kernel install
WORKDIR /home/app
ENV SPARK_HOME=/spark
ENTRYPOINT [ "jupyter", "lab", "--allow-root", "--no-browser", "--ip", "0.0.0.0", "--LabApp.token=''" ]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment