Skip to content

Instantly share code, notes, and snippets.

View romeokienzler's full-sized avatar

Romeo Kienzler romeokienzler

  • Senior Scientific Software Engineer - STSM - AI for Climate Impact (ACT), IBM Research Europe
  • Switzerland
View GitHub Profile
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
sparkSession = SQLContext.getOrCreate(sc).sparkSession
cloudantdata=sparkSession.read.format("com.cloudant.spark"). \
option("cloudant.host","-888e-315f36925447-bluemix.cloudant.com"). \
option("cloudant.username", "0495289d-888e-315f36925447-bluemix"). \
option("cloudant.password", "0b7338d23c08afaff0d8dc7b9726f051174d93a36de9"). \
load("berlinshakeshake")
cloudantdata.createOrReplaceTempView("shakeshake")
spark.sql("SELECT sensorid, sum(abs(x))+sum(abs(z))+sum(abs(y)) as energy FROM shakeshake group by sensorid order by energy desc").show()
%AddJar http://central.maven.org/maven2/org/deeplearning4j/deeplearning4j-core/0.4.0/deeplearning4j-core-0.4.0.jar
%AddJar http://central.maven.org/maven2/org/nd4j/nd4j-api/0.4.0/nd4j-api-0.4.0.jar
%AddJar http://central.maven.org/maven2/org/nd4j/nd4j-buffer/0.4.0/nd4j-buffer-0.4.0.jar
%AddJar http://central.maven.org/maven2/org/nd4j/canova-nd4j-image/0.0.0.17/canova-nd4j-image-0.0.0.17.jar
%AddJar http://central.maven.org/maven2/org/nd4j/canova-nd4j-codec/0.0.0.17/canova-nd4j-codec-0.0.0.17.jar
%AddJar http://central.maven.org/maven2/org/nd4j/canova-api/0.0.0.17/canova-api-0.0.0.17.jar
%AddJar http://central.maven.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar
%AddJar http://central.maven.org/maven2/org/nd4j/nd4j-x86/0.4-rc3.8/nd4j-x86-0.4-rc3.8.jar
import urllib2
import numpy as np
#response = urllib2.urlopen("file:///Users/romeokienzler/Downloads/lorenz.csv")
response = urllib2.urlopen("https://pmqsimulator-romeokienzler-2310.mybluemix.net/data")
data = response.read()
data = data.split("\n")
data.pop()
table = map(lambda s : s.split(';'), data)
import numpy as np
import sys
'''
Created on Apr 8, 2016
@author: romeokienzler
'''
class SenseHat():
index = 0
import time
import numpy as np
import ibmiotf.gateway
from sense_hat import SenseHat
import math
R = [255, 0, 0] # Red
W = [255, 255, 255] # White
G = [0, 255, 0] # Green
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.nd4j:nd4j-perf:jar:0.4-rc3.9-SNAPSHOT
[WARNING] The expression ${version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${version} is deprecated. Please use ${project.version} instead.
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.nd4j:nd4j-cuda-7.5:jar:0.4-rc3.9-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: junit:junit:jar -> version ${junit.version} vs (?) @ org.nd4j:nd4j-cuda-7.5:[unknown-version], /home/romeokienzler/nd4j/nd4j-backends/nd4j-backend-impls/nd4j-cuda-7.5/pom.xml, line 181, column 21
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.nd4j:nd4j-perf:jar:0.4-rc3.9-SNAPSHOT
[WARNING] The expression ${version} is deprecated. Please use ${project.version} instead.
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.nd4j:nd4j-cuda-7.5:jar:0.4-rc3.9-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: junit:junit:jar -> version ${junit.version} vs (?) @ org.nd4j:nd4j-cuda-7.5:[unknown-version], /home/romeokienzler/nd4j/nd4j-backends/nd4j-backend-impls/nd4j-cuda-7.5/pom.xml, line 181, column 21
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
This file has been truncated, but you can view the full file.
Apache Maven 3.3.3
Maven home: /usr/share/maven
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /opt/jdk1.8.0_91/jre
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "4.2.0-16-generic", arch: "amd64", family: "unix"
[DEBUG] Created new class realm maven.api
[DEBUG] Importing foreign packages into class realm maven.api
[DEBUG] Imported: javax.enterprise.inject.* < plexus.core
[DEBUG] Imported: javax.enterprise.util.* < plexus.core
This file has been truncated, but you can view the full file.
Apache Maven 3.3.3
Maven home: /usr/share/maven
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /opt/jdk1.8.0_91/jre
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "4.2.0-16-generic", arch: "amd64", family: "unix"
[DEBUG] Created new class realm maven.api
[DEBUG] Importing foreign packages into class realm maven.api
[DEBUG] Imported: javax.enterprise.inject.* < plexus.core
[DEBUG] Imported: javax.enterprise.util.* < plexus.core