Skip to content

Instantly share code, notes, and snippets.

View wnojopra's full-sized avatar

Willy Nojopranoto wnojopra

View GitHub Profile
TsvHttpData-1.0
https://example.com/buckets/obj1 1357 wHENa08V36iPYAsOa2JAdw==
https://example.com/buckets/obj2 2468 R9acAaveoPd2y8nniLUYbw==
@wnojopra
wnojopra / gist:b70dc2d4bc6d5ed6aefb53818adc05e1
Created February 22, 2023 17:55
Show first occurrence Output of !grep -a -m 1 -B 5 -A 200 OutOfMemoryError {CROMWELL_SERVER_LOG}
[INFO] [02/22/2023 08:52:28.908] [cromwell-system-akka.dispatchers.backend-dispatcher-4207] [akka://cromwell-system/user/cromwell-service/WorkflowManagerActor/WorkflowActor-b35166e1-eb7f-4d64-b58d-37636db405c3/WorkflowExecutionActor-b35166e1-eb7f-4d64-b58d-37636db405c3/b35166e1-eb7f-4d64-b58d-37636db405c3-SubWorkflowExecutionActor-SubWorkflow-GvsUnified:-1:1/6b303fbe-2d58-493d-a4e5-34a86b8e3366-SubWorkflowActor-SubWorkflow-GvsUnified:-1:1/6b303fbe-2d58-493d-a4e5-34a86b8e3366-SubWorkflowExecutionActor-SubWorkflow-GvsImportGenomes:-1:1/e5f30ea8-a4c9-4690-aa22-e575cdcb5996-SubWorkflowActor-SubWorkflow-GvsImportGenomes:-1:1/e5f30ea8-a4c9-4690-aa22-e575cdcb5996-EngineJobExecutionActor-GvsImportGenomes.LoadData:209:1/e5f30ea8-a4c9-4690-aa22-e575cdcb5996-BackendJobExecutionActor-GvsImportGenomes.LoadData:209:1/PipelinesApiAsyncBackendJobExecutionActor] PipelinesApiAsyncBackendJobExecutionActor [UUID(e5f30ea8)GvsImportGenomes.LoadData:209:1]: Status change from Running to Success
[WARN] [02/22/2023 08:52:34.215] [cro
@wnojopra
wnojopra / gist:8c8f56bc2638970321f751549f273f67
Created February 22, 2023 17:11
Stack trace for Java heap space error in Cromwell
[ERROR] [02/22/2023 17:09:59.597] [cromwell-system-akka.dispatchers.service-dispatcher-51] [akka://cromwell-system/user/cromwell-service/ServiceRegistryActor/MetadataService/WriteMetadataActor] WriteMetadataActor Failed to properly process data
java.sql.SQLException: java.lang.OutOfMemoryError: Java heap space
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
at org.hsqldb.jdbc.JDBCPreparedStatement.executeUpdate(Unknown Source)
at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeUpdate(ProxyPreparedStatement.java:61)
at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeUpdate(HikariProxyPreparedStatement.java)
at slick.jdbc.JdbcActionComponent$InsertActionComposerImpl$MultiInsertAction.$anonfun$run$17(JdbcActionComponent.scala:533)
at slick.jdbc.JdbcBackend$SessionDef.withPreparedStatement(JdbcBackend.scala:427)
@wnojopra
wnojopra / parse_pricing_api.py
Created November 16, 2021 21:02
Script that parses pricing data from Google's API.
"""Script that parses pricing data from Google's API.
Intended to be run periodically for the terra-ui's estimated price UI. The
output is something you could copy and paste into a javascript file.
See https://cloud.google.com/billing/v1/how-tos/catalog-api for more detail
on Google Cloud pricing information.
Usage:
1) Follow the instructions at the above URL to create an API key
2) Run `python3 parse_pricing_api.py ${API_KEY}`