Andy Petrella andypetrella
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| numberOfNodes = 10000 | |
| avgDegree = 10 | |
| function getRandomInt(min, max) { | |
| min = Math.ceil(min); | |
| max = Math.floor(max); | |
| return Math.floor(Math.random() * (max - min)) + min; | |
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| FWIW, I know it's dirty/nasty :-/ |
andypetrella
/ access.py
Created
July 21, 2018 18:07
How to reference a scala object in python using Py4j (JavaGateway)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # This function takes the fully classified object name, say: <package>.<name>. | |
| # Returns the static object instance on the heap | |
| def ref_scala_object(object_name): | |
| clazz = jvm.java.lang.Class.forName(object_name+"$") | |
| ff = clazz.getDeclaredField("MODULE$") | |
| o = ff.get(None) | |
| return o |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| dam_dependencies = [ | |
| ProcessLineageDepsBuilder(input_schema, output_schema) | |
| .identity_from_output("data") | |
| .append('f', ['name', 'last'], "data"), | |
| ProcessLineageDepsBuilder(input_schema_2, output_schema) | |
| .identity_from_output("data") | |
| ] | |
| dam_create_process_run_and_lineage(process, user, | |
| code_version, process_name, |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| dam_dependencies = [ | |
| ProcessLineageDepsBuilder(input_schema, output_schema) | |
| .identity_from_output("data") | |
| .append('f', ['name', 'last'], "data"), | |
| ProcessLineageDepsBuilder(input_schema_2, output_schema) | |
| .identity_from_output("data") | |
| ] | |
| dam_create_process_run_and_lineage(process, user, | |
| code_version, process_name, |
andypetrella
/ libnd4j log
Created
June 17, 2016 08:54
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| root@ip-172-31-15-75:/mnt/nd4j# cd ../libnd4j/ | |
| root@ip-172-31-15-75:/mnt/libnd4j# ./buildnativeoperations.sh | |
| eval cmake | |
| PACKAGING = none | |
| BUILD = release | |
| CHIP = cpu | |
| LIBRARY TYPE = dynamic | |
| /mnt/libnd4j/blasbuild/cpu | |
| -- The C compiler identification is GNU 4.8.4 | |
| -- The CXX compiler identification is GNU 4.8.4 |
andypetrella
/ nd4j - ld problem
Created
June 17, 2016 08:50
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [INFO] Scanning for projects... | |
| [WARNING] | |
| [WARNING] Some problems were encountered while building the effective model for org.nd4j:nd4j-jdbc-api:jar:0.4-rc3.11-SNAPSHOT | |
| [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-deploy-plugin is missing. @ org.nd4j:nd4j:0.4-rc3.11-SNAPSHOT, /mnt/nd4j/pom.xml, line 327, column 21 | |
| [WARNING] | |
| [WARNING] Some problems were encountered while building the effective model for org.nd4j:nd4j-jdbc-mysql:jar:0.4-rc3.11-SNAPSHOT | |
| [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-deploy-plugin is missing. @ org.nd4j:nd4j:0.4-rc3.11-SNAPSHOT, /mnt/nd4j/pom.xml, line 327, column 21 | |
| [WARNING] | |
| [WARNING] Some problems were encountered while building the effective model for org.nd4j:nd4j-jdbc:pom:0.4-rc3.11-SNAPSHOT | |
| [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-deploy-plugin is missing. @ org.nd4j:nd4j:0.4-rc3.11-SNAPSHOT, /mnt/nd4j/pom.xml, line 327, column 21 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| root@ip-172-31-15-75:/mnt/libnd4j# ./buildnativeoperations.sh | |
| eval cmake | |
| PACKAGING = none | |
| BUILD = release | |
| CHIP = cpu | |
| LIBRARY TYPE = dynamic | |
| /mnt/libnd4j/blasbuild/cpu | |
| -- The C compiler identification is GNU 4.8.4 | |
| -- The CXX compiler identification is GNU 4.8.4 | |
| -- Check for working C compiler: /usr/bin/cc |
andypetrella
/ StateStream-Workaround.snb
Created
March 14, 2016 19:37
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata" : { | |
| "name" : "Serializable StateStream", | |
| "user_save_timestamp" : "1970-01-01T01:00:00.000Z", | |
| "auto_save_timestamp" : "1970-01-01T01:00:00.000Z", | |
| "language_info" : { | |
| "name" : "scala", | |
| "file_extension" : "scala", | |
| "codemirror_mode" : "text/x-scala" | |
| }, |
andypetrella
/ QPlot.snb
Last active
March 9, 2016 02:33
Super basic qplot implementation on Scala collection, using R backend as renderer... in 74 lines :-)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata" : { | |
| "name" : "QPlot", | |
| "user_save_timestamp" : "1970-01-01T01:00:00.000Z", | |
| "auto_save_timestamp" : "1970-01-01T01:00:00.000Z", | |
| "language_info" : { | |
| "name" : "scala", | |
| "file_extension" : "scala", | |
| "codemirror_mode" : "text/x-scala" | |
| }, |
NewerOlder