Skip to content

Instantly share code, notes, and snippets.

@stardigits
Last active February 23, 2023 08:43
Show Gist options
  • Save stardigits/a097185ff28f1178cab973318b2ec47d to your computer and use it in GitHub Desktop.
Save stardigits/a097185ff28f1178cab973318b2ec47d to your computer and use it in GitHub Desktop.
Manually Setup Data Science Tools (DSTools) on Windows 10

dstools

Windows Data Science Tools

Directory Structure

DSTools\bin
DSTools\src

Source Files

dstools.cmd

@echo off
rem DSTools Environment Setup

set DSTOOLSDIR=F:\DSTools

rem java
if exist %DSTOOLSDIR%\bin\jdk\bin\javac.exe set JAVA_HOME=%DSTOOLSDIR%\bin\jdk
if exist %DSTOOLSDIR%\bin\jdk\bin\javac.exe set JDK_HOME=%DSTOOLSDIR%\bin\jdk
if exist %DSTOOLSDIR%\bin\jdk\bin\javac.exe set JRE_HOME=%DSTOOLSDIR%\bin\jdk\jre
if exist %DSTOOLSDIR%\bin\jdk\bin\javac.exe set CLASSPATH=.;%JDK_HOME%\lib;%JRE_HOME%\lib
if exist %DSTOOLSDIR%\bin\jdk\bin\javac.exe set PATH=%JAVA_HOME%\bin;%PATH%

rem scala
set SCALA_HOME=%DSTOOLSDIR%\bin\scala

rem spark
set SPARK_HOME=%DSTOOLSDIR%\bin\spark
set HADOOP_HOME=%SPARK_HOME%

rem R & git
rem set PATH=%SPARK_HOME%\bin;%SCALA_HOME%\bin;%DSTOOLSDIR%\bin\R\bin\x64;%DSTOOLSDIR%\bin\winpython\scripts;%PATH%
set PATH=%SPARK_HOME%\bin;%SCALA_HOME%\bin;%DSTOOLSDIR%\bin\R\bin\x64;%DSTOOLSDIR%\bin\git;;%DSTOOLSDIR%\bin\git\bin;%PATH%

rem winpython
%DSTOOLSDIR%\bin\winpython\scripts\env.bat
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment