Raúl Gracia RaulGracia
RaulGracia
/ parallelism_latency_results.csv
Last active
March 4, 2021 19:32
We can make this file beautiful and searchable if this error is corrected: It looks like row 6 should actually have 21 columns, instead of 12 in line 5.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| "1KB events, TP=250K e/s",Pravega,,,,Kafka,,,,Kafka (flush),,,,Pulsar,,,,Pulsar (fav. config),,, | |
| Segments,1 Prod. (P95 lat. ms),10 Prod. (P95 lat. ms),50 Prod. (P95 lat. ms),100 Prod. (P95 lat. ms),1 Prod. (P95 lat. ms),10 Prod. (P95 lat. ms),50 Prod. (P95 lat. ms),100 Prod. (P95 lat. ms),1 Prod. (P95 lat. ms),10 Prod. (P95 lat. ms),50 Prod. (P95 lat. ms),100 Prod. (P95 lat. ms),1 Prod. (P95 lat. ms),10 Prod. (P95 lat. ms),50 Prod. (P95 lat. ms),100 Prod. (P95 lat. ms),1 Prod. (P95 lat. ms),10 Prod. (P95 lat. ms),50 Prod. (P95 lat. ms),100 Prod. (P95 lat. ms) | |
| 1,1877.9,2872.8,3892.2,4690.8,384.395,2042.159,9945.471,20510.591,653.767,3016.223,11713.919,23082.879,3.73,4.582,4.866,4057.535,3.769,4.551,10.931,35.797 | |
| 10,6.8,7.1,9.6,7,4.622,11.811,13.622,15.643,1491.743,46.199,141.059,259.486,4.772,4.082,0,0,4.073,4.541,4.606,4.6 | |
| 100,7.2,7.2,12.4,6.9,12.591,22.284,36.828,43.262,45.415,188.892,323.391,499.929,0,0,0,0,4.099,4.572,4.823,17.464 | |
| 500,9.8,7.9,6.6,6.6,20.495,27.331,67.322,98.24,57.32,176.968, |
RaulGracia
/ parallelism_tp_table.csv
Last active
March 4, 2021 19:32
We can make this file beautiful and searchable if this error is corrected: It looks like row 6 should actually have 21 columns, instead of 20 in line 5.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| "1KB events, TP=250K e/s ",Pravega,,,,Kafka,,,,Kafka (flush),,,,Pulsar,,,,Pulsar (fav. config),,, | |
| Segments,1 Prod.,10 Prod.,50 Prod.,100 Prod.,1 Prod.,10 Prod.,50 Prod.,100 Prod.,1 Prod.,10 Prod.,50 Prod.,100 Prod.,1 Prod.,10 Prod.,50 Prod.,100 Prod.,1 Prod.,10 Prod.,50 Prod.,100 Prod. | |
| 1,224455,216100.7,200103.9,181491.3,85978.589,159915.286,162824.581,157726.807,50637.199,107837.374,137845.22,139717.262,250171.526,250288.397,250473.364,250815.99,250168.441,250312.216,250480.222,250566.29 | |
| 10,250109.6,250306.4,250335.4,250392.3,250256.253,250376.275,250727.985,250570.64,177911.675,250429.989,250535.519,250580.831,250305.536,250382.574,0,0,250275.186,250300.654,250404.772,250588.875 | |
| 100,250175.9,250394.2,250470.7,250412.4,33409.198,216355.776,250583.517,250844.233,9671.452,31022.333,73583.512,86462.976,0,0,0,0,250264.726,250359.084,250383.61,250637.768 | |
| 500,250207.4,250476.5,250414.6,250464.1,16893.811,134149.684,250514.748,250949.744,6535.525,20848.232,36435.269,42544.849,0,0,0,0,250330.836,250320.651,250499.97 |
RaulGracia
/ pravega-release-checksums-verification.sh
Last active
February 4, 2021 15:12
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Release and Tag for the release to check | |
| RELEASE_VERSION="0.9.0" | |
| RELEASE_TAG="v$RELEASE_VERSION-rc1" | |
| echo "RELEASE VERSION: $RELEASE_VERSION" | |
| echo "TAG VERSION: $RELEASE_TAG" | |
| # Iterate over all the artifacts in the release | |
| for ARTIFACT in "pravega-$RELEASE_VERSION.tgz" "pravega-$RELEASE_VERSION.zip" "pravega-client-$RELEASE_VERSION.tgz" "pravega-client-$RELEASE_VERSION.zip" "pravega-javadoc-$RELEASE_VERSION.tgz" "pravega-javadoc-$RELEASE_VERSION.zip" | |
| do |
RaulGracia
/ pulsar-terraform.tfvars
Created
February 2, 2021 10:38
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| public_key_path = "~/.ssh/pulsar_aws.pub" | |
| region = "us-west-2" | |
| ami = "ami-9fa343e7" // RHEL-7.4 | |
| instance_types = { | |
| "pulsar" = "i3.16xlarge" | |
| "zookeeper" = "t3.small" | |
| "client" = "c5.4xlarge" | |
| "prometheus" = "t3.small" | |
| } |
RaulGracia
/ pravega-teraform.tfvars
Created
February 2, 2021 10:37
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| public_key_path = "~/.ssh/pravega_aws.pub" | |
| region = "us-west-2" | |
| ami = "ami-9fa343e7" // RHEL-7.4 us-west-2 | |
| instance_types = { | |
| "controller" = "m5.large" | |
| "bookkeeper" = "i3.16xlarge" | |
| "zookeeper" = "t3.small" | |
| "client" = "c5.4xlarge" | |
| "metrics" = "t3.large" |
RaulGracia
/ kafka-terraform.tfvars
Created
February 2, 2021 10:36
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| public_key_path = "~/.ssh/kafka_aws.pub" | |
| region = "us-west-2" | |
| ami = "ami-9fa343e7" // RHEL-7.4 | |
| profile = "default" | |
| instance_types = { | |
| "kafka" = "i3.16xlarge" | |
| "zookeeper" = "t3.small" | |
| "client" = "c5.4xlarge" | |
| "prometheus" = "c5.2xlarge" |
RaulGracia
/ testgen-kafka-parallelism.py
Last active
February 2, 2021 10:17
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| from __future__ import print_function | |
| import json | |
| import sys | |
| def add_test(): | |
| driver = { | |
| 'name': 'Kafka', | |
| 'driverClass': 'io.openmessaging.benchmark.driver.kafka.KafkaBenchmarkDriver', |
RaulGracia
/ testgen-pulsar-parallelism.py
Created
February 2, 2021 10:13
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| from __future__ import print_function | |
| import json | |
| import sys | |
| test_list = [] | |
| localWorker = False | |
| tarball = 'package/target/openmessaging-benchmark-0.0.1-SNAPSHOT-bin.tar.gz' |
RaulGracia
/ testgen-pravega-parallelism.py
Created
February 2, 2021 10:09
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| from __future__ import print_function | |
| import json | |
| import sys | |
| def add_test(): | |
| driver = { | |
| 'name': 'Pravega', |
RaulGracia
/ install-public-pravega-charts
Last active
October 16, 2020 11:15
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| helm repo add pravega https://charts.pravega.io | |
| helm repo update |
NewerOlder