Skip to content

Instantly share code, notes, and snippets.

View geoHeil's full-sized avatar

geoHeil geoHeil

View GitHub Profile
org.apache.spark.SparkException: Exception thrown in awaitResult: at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:226) at org.apache.spark.sql.execution.exchange.BroadcastExchangeExec.doExecuteBroadcast(BroadcastExchangeExec.scala:146) at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:144) at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeBroadcast$1.apply(SparkPlan.scala:140) at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151) at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152) at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:140) at org.apache.spark.sql.execution.joins.BroadcastNestedLoopJoinExec.doExecute(BroadcastNestedLoopJoinExec.scala:343) at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131) at org.apache.spark.sql.ex
> install.packages("sf")
Installing package into ‘/Users/geoheil/my_project/packrat/lib/x86_64-apple-darwin18.2.0/3.5.3’
(as ‘lib’ is unspecified)
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 7975k 100 7975k 0 0 2506k 0 0:00:03 0:00:03 --:--:-- 2507k
* installing *source* package ‘sf’ ...
** Paket ‘sf’ erfolgreich entpackt und MD5 Summen überprüft
configure: CC: clang
configure: CXX: clang++ -std=gnu++11
@geoHeil
geoHeil / keplergl(2).json
Created December 11, 2018 07:26
kepler.gl earthquakes example data earthquakes
{
"version": "v1",
"config": {
"visState": {
"filters": [
{
"dataId": "earthquakes",
"id": "vo18yorx",
"name": "DateTime",
"type": "timeRange",
/usr/local/opt/qt/lib/QtSql.framework/Headers -isystem /usr/local/opt/qt/lib/QtConcurrent.framework/Headers -isystem /usr/local/opt/qt/lib/QtPositioning.framework/Headers -isystem /usr/local/Cellar/grass7/7.4.1/grass-base/include -Wall -Wextra -Wno-long-long -Wformat-security -Wno-strict-aliasing -Wno-return-type-c-linkage -Wno-overloaded-virtual -Qunused-arguments -O2 -g -DNDEBUG -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.13.sdk -fPIC -fvisibility=hidden -F/usr/local/opt/qca/lib -fPIC -std=gnu++11 -MD -MT src/core/CMakeFiles/qgis_core.dir/processing/models/qgsprocessingmodeloutput.cpp.o -MF src/core/CMakeFiles/qgis_core.dir/processing/models/qgsprocessingmodeloutput.cpp.o.d -o src/core/CMakeFiles/qgis_core.dir/processing/models/qgsprocessingmodeloutput.cpp.o -c ../src/core/processing/models/qgsprocessingmodeloutput.cpp
[1990/4818] /usr/local/Homebrew/Library/Homebrew/shims/mac/super/clang++ -DQT_CONCURRENT_LIB -DQT_CORE_LIB -DQT_DISABLE_DEPRECAT
@geoHeil
geoHeil / foo.sh
Last active July 29, 2018 09:46
scala class path
gradle dependencyInsight --dependency scala-reflect [±65-home-night-location ●●]
> Task :proj1:dependencyInsight
org.scala-lang:scala-reflect:2.11.11
variant "runtime" [
org.gradle.status = release (not requested)
Requested attributes not found in the selected variant:
org.gradle.usage = java-api
]
Selection reasons:
scala.reflect.internal.Types$TypeError: value <none> is not a member of $line23.$read
at scala.tools.nsc.typechecker.Contexts$ThrowingReporter.handleError(Contexts.scala:1402)
at scala.tools.nsc.typechecker.Contexts$ContextReporter.issue(Contexts.scala:1254)
at scala.tools.nsc.typechecker.Contexts$Context.issue(Contexts.scala:573)
at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$normalTypedApply$1$1.apply(Typers.scala:4549)
at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$normalTypedApply$1$1.apply(Typers.scala:4548)
at scala.tools.nsc.typechecker.Typers$Typer.onError$3(Typers.scala:4522)
at scala.tools.nsc.typechecker.Typers$Typer.normalTypedApply$1(Typers.scala:4548)
at scala.tools.nsc.typechecker.Typers$Typer.typedApply$1(Typers.scala:4580)
at scala.tools.nsc.typechecker.Typers$Typer.typedInAnyMode$1(Typers.scala:5343)
@geoHeil
geoHeil / geomesaOrcStacktrace.log
Created June 1, 2018 14:12
geomesa orc stack trace
2018-06-01 16:06:48 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Main class:
Job1
Arguments:
Spark config:
(spark.app.name,Job1)
(spark.submit.deployMode,client)
(spark.master,local[2])
(spark.jars,*********(redacted))
@geoHeil
geoHeil / gist:ca0d4670c1dcc13f1ed9c7429564c2a5
Created May 30, 2018 12:46
grade dependency scan after exclude
gradle dependencyInsight --dependency om.typesafe:config [±master ●●]
> Task :dependencyInsight
com.typesafe:config:1.3.1
variant "runtime" [
Requested attributes not found in the selected variant:
org.gradle.usage = java-api
]
\--- com.github.kxbmap:configs_2.11:0.4.4
\--- compileClasspath
@geoHeil
geoHeil / QUGIS_dev.rb
Created April 11, 2018 14:53
gis Homebrew
class Qgis3DevUnlinkedFormulae < Requirement
fatal true
satisfy(:build_env => false) { !qt4_linked && !pyqt4_linked && !txt2tags_linked }
def qt4_linked
(Formula["qt"].linked_keg/"lib/QtCore.framework/Versions/4").exist?
rescue
return false
end
@geoHeil
geoHeil / foo.scala
Last active April 4, 2018 09:12
spark term frequency
// Copyright (C) 2017 Georg Heiler
package ir
import java.io.File
import com.databricks.spark.corenlp.functions._
import com.typesafe.config.ConfigFactory
import net.ruippeixotog.scalascraper.browser.JsoupBrowser
import org.apache.spark.sql.functions._