Skip to content

Instantly share code, notes, and snippets.

View geoHeil's full-sized avatar

geoHeil geoHeil

View GitHub Profile
@geoHeil
geoHeil / esxi.json
Last active February 8, 2017 16:38
vmware esxi
{
"type": "virtualbox-iso",
"boot_command": [
"<tab> text ks=http://{{ .HTTPIP }}:{{ .HTTPPort }}/ks.cfg<enter><wait>"
],
"boot_wait": "10s",
"disk_size": 40520,
"guest_os_type": "RedHat_64",
"http_directory": "http",
"iso_checksum": "27bd866242ee058b7a5754e83d8ee8403e216b93d130d800852a96f41c34d86a",
@geoHeil
geoHeil / blueprint.json
Created February 13, 2017 17:25
ambari
{
"configurations": [
{
"hive-env": {
"properties": {
"hive_security_authorization" : "Ranger",
"hive_database": "Existing MySQL Database"
}
}
},
Feb 28 06:43:29.176207 -0800 000001.261667 Brcm4360<D>[0] [0xe750e2cbf1a897d5][1][0] apple80211Request Get "APPLE80211_IOC_PHY_MODE" rejected while _powerState:0, pid[0]'kernel_task'
Feb 28 06:43:29.176217 -0800 000001.261676 Brcm4360<D>[1] [0xe750e2cbf1a897d5][1][0] apple80211Request Get "ID:80" rejected while _powerState:0, pid[0]'kernel_task'
Feb 28 06:43:29.176243 -0800 000001.261703 Brcm4360<D>[2] [0xe750e2cbf1a897d5][1][0] BRCM tunables:
Feb 28 06:43:29.176248 -0800 000001.261708 Brcm4360<D>[3] [0xe750e2cbf1a897d5][1][0] pullmode[1] txringsize[ 256] txsendqsize[0] reapmin[ 32] reapcount[ 128]
Feb 28 06:43:29.176477 -0800 000001.261937 Brcm4360<D>[4] [0xe750e2cbf1a897d5][1][0] saveDeviceState: device[0xe750e2cbf1a8fa9d], override[0]
Feb 28 06:43:29.176628 -0800 000001.262088 Brcm4360<D>[5] [0xe750e2cbf1a897d5][1][0] saveDeviceState: dump of cached config-space
Feb 28 06:43:29.176633 -0800 000001.262093 Brcm4360<D>[6] [0xe750e2cbf1a897d5][1][0]
00:
Feb 28 06:43:29.176634 -0800 000001.262094 Brc
// Copyright (C) 2017 Georg Heiler
package myOrg
import com.vividsolutions.jts.geom.{ GeometryFactory, MultiPolygon, Polygon }
import com.vividsolutions.jts.io.WKTReader
import org.apache.spark.api.java.function.FlatMapFunction
import scala.collection.generic.Growable
import scala.collection.mutable
[Stage 17:> (0 + 0) / 10]17/03/09 08:30:24 WARN TaskSetManager: Stage 17 contains a task of very large size (586 KB). The maximum recommended task size is 100 KB.
java.lang.NullPointerException
at org.datasyslab.babylon.extension.imageGenerator.NativeJavaImageGenerator.SaveAsFile(NativeJavaImageGenerator.java:29)
at myOrg.GeoSpark$.buildScatterPlot(GeoSpark.scala:96)
at myOrg.GeoSpark$.delayedEndpoint$myOrg$GeoSpark$1(GeoSpark.scala:77)
at myOrg.GeoSpark$delayedInit$body.apply(GeoSpark.scala:19)
at scala.Function0$class.apply$mcV$sp(Function0.scala:34)
at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)
at scala.App$$anonfun$main$1.apply(App.scala:76)
at scala.App$$anonfun$main$1.apply(App.scala:76)
@geoHeil
geoHeil / error.txt
Created March 20, 2017 06:31
xgboost build problem
mvn clean install [±master ✓]
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for ml.dmlc:xgboost4j:jar:0.7
[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:exec-maven-plugin is missing. @ line 40, column 29
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
for (row in 2:(nrow(distance_matrix)-1)){
for (column in 2:(ncol(distance_matrix)-1)){
if (column != row){
result <- distance_matrix[1, row] + # distance c-i-0
distance_matrix[1, row +1] - # distance c-0-j
distance_matrix[column, row] # distnace c-i-j
# savings_matrix[column,row] <- result
# TODO check is the i or i+1 th index correct?
savings_list <- rbind(savings_list,c(column, row, result))
}
(xgb) > $ mvn clean install [±518 ✓]
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for ml.dmlc:xgboost4j:jar:0.7
[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:exec-maven-plugin is missing. @ line 40, column 29
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
import net.ruippeixotog.scalascraper.browser.JsoupBrowser
import net.ruippeixotog.scalascraper.dsl.DSL.Extract._
import net.ruippeixotog.scalascraper.dsl.DSL._
import net.ruippeixotog.scalascraper.scraper.ContentExtractors.elementList
@transient lazy val browser = JsoupBrowser()
val broken =
"""
|<docno>
| LA051089-0001
@geoHeil
geoHeil / babylon.scala
Created April 24, 2017 08:08
scala methods for visualization
import java.awt.Color
import com.vividsolutions.jts.geom.Polygon
import org.apache.spark.api.java.JavaPairRDD
import org.datasyslab.babylon.core.OverlayOperator
import org.datasyslab.babylon.extension.imageGenerator.NativeJavaImageGenerator
import org.datasyslab.babylon.extension.visualizationEffect.{ ChoroplethMap, HeatMap, ScatterPlot }
import org.datasyslab.babylon.utils.ImageType
import org.datasyslab.geospark.spatialRDD.{ PolygonRDD, SpatialRDD }