Skip to content

Instantly share code, notes, and snippets.

View ajayborra's full-sized avatar

Ajay Borra ajayborra

9 followers · 2 following
View GitHub Profile
@ajayborra
ajayborra / castinOutput.scala
Created November 5, 2018 20:35
Casting Output
+-------+-----------------+------------------+------------------+------------------+------------------+-----------------+------------------+-----------------+-----------------+-------------------+
|summary| houseId| medianHouseValue| medianIncome| housingMedianAge| totalRooms| totalBedrooms| population| households| latitude| longitude|
+-------+-----------------+------------------+------------------+------------------+------------------+-----------------+------------------+-----------------+-----------------+-------------------+
| count| 20640| 20640| 20640| 20640| 20640| 20640| 20640| 20640| 20640| 20640|
| mean| 10320.5|206855.81690891474|3.8706710029070246|28.639486434108527|2635.7630813953488|537.8980135658915|1425.4767441860465|499.5396802325581| 35.6318614341087|-119.56970445736148|
| stddev|5958.399113856003|115395.61587
@ajayborra
ajayborra / trainOut.scala
Created November 5, 2018 20:31
Training Output
"bestModelUID" : "gbtr_ee53956069aa",
"testSetEvaluationResults" : {
"(regEval)_R2" : 0.7763428813232043,
"(regEval)_RootMeanSquaredError" : 54308.675029060905,
"(regEval)_MeanAbsoluteError" : 36619.733388656015,
"(regEval)_MeanSquaredError" : 2.9494321834121437E9
},
"bestModelName" : "gbtr_ee53956069aa_13",
"trainingSetEvaluationResults" : {
"(regEval)_R2" : 0.8184847478105526,
@ajayborra
ajayborra / train.sh
Created November 5, 2018 20:30
AutoML Training
./gradlew sparkSubmit -Dmain=com.salesforce.app.RealEstateApp -Dargs="--run-type=train --model-location=./house-model --read-location HouseObject=`pwd`/../data/cadata.csv"
@ajayborra
ajayborra / generate.sh
Created November 5, 2018 20:29
Generate App using CLI
transmogrifai gen --input data/cadata.csv --id houseId --response medianHouseValue --overwrite --auto HouseObject RealEstateApp
cd realestateapp && ./gradlew compileTestScala installDist
@ajayborra
ajayborra / fetch.sh
Created November 5, 2018 20:28
Fetch Dataset
cd .. && mkdir -p blog/data && cd blog/data
wget https://raw.githubusercontent.com/ajayborra/TransmogrifAI-CaliforniaHousing/master/data/cadata.csv && cd ..
@ajayborra
ajayborra / build.sh
Created November 5, 2018 20:27
Build CLI and Setup alias
./gradlew cli:shadowJar
alias transmogrifai="java -cp `pwd`/cli/build/libs/\* com.salesforce.op.cli.CLI"
@ajayborra
ajayborra / checkout.sh
Created November 5, 2018 20:26
Checkout Latest Branch 0.4.0
cd ./TransmogrifAI
git checkout 0.4.0
@ajayborra
ajayborra / clone.sh
Last active November 5, 2018 20:26
Cloning TransmogrifAI
# Cloning TransmogrifAI Repo
git clone https://github.com/salesforce/TransmogrifAI.git
@ajayborra
ajayborra / featuresOut.scala
Created November 5, 2018 20:20
Features Output
+----------------+--------------------+
|medianHouseValue| features|
+----------------+--------------------+
| 452600.0|[8.3252,41.0,880....|
| 358500.0|[8.3014,21.0,7099...|
| 352100.0|[7.2574,52.0,1467...|
| 341300.0|[5.6431,52.0,1274...|
| 342200.0|[3.8462,52.0,1627...|
| 269700.0|[4.0368,52.0,919....|
| 299200.0|[3.6591,52.0,2535...|
@ajayborra
ajayborra / linearRegressionModelOut.scala
Created November 5, 2018 20:01
Linear Regression Model Output
Coefficients: [76738.94522230534,14903.054273122021,-18332.757718162775,50003.22137242165,-42713.72451462165,16547.521499666713,-90676.93313902401,-85365.66935383904] Intercept: 206772.90073196447
numIterations: 101
objectiveHistory: [0.5,0.429025021421256,0.26855114619613496,0.22652891956525684,0.21499857945908582,0.20773178001678289,0.19514784970174676,0.1885232671505026,0.1859671425971781,0.1853561326312991,0.18457399881973188,0.18441537651204076,0.18373103793910683,0.18350208412916771,0.1823597273673587,0.18229316947052004,0.18218622679968952,0.18215858300437648,0.18213798185173202,0.1821246023017618,0.18211459711626019,0.18209961828343316,0.18208837731785227,0.18205588604904863,0.1820434687407733,0.1820208677601439,0.18200624291405224,0.18200467173854357,0.18199278217947065,0.18199099118402143,0.18198050302769553,0.1819789044800163,0.18196944209901966,0.1819675578082704,0.18195935806645552,0.18195583674748167,0.18194791834626967,0.1819391408347191,0.1819311038867398,0.1819225377989266,0.18191655895966014