Skip to content

Instantly share code, notes, and snippets.

@zloster
Created November 18, 2019 10:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save zloster/7d51fa9732b94db8210e4b428241aa29 to your computer and use it in GitHub Desktop.
Save zloster/7d51fa9732b94db8210e4b428241aa29 to your computer and use it in GitHub Desktop.
FrameworkBenchmarks Toolset - Concurrency set to 128 Python error
vagrant@TFB-all:~$ tfb --mode verify --test dropwizard-postgres --concurrency-levels 128
Sending build context to Docker daemon 2.56kB
Step 1/9 : FROM buildpack-deps:bionic
---> da7bebef4e62
Step 2/9 : RUN apt-get -yqq update
---> Using cache
---> 20cac748fdbc
Step 3/9 : RUN apt-get -yqq install -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" git-core cloc dstat `# Collect resource usage statistics` python-dev python-pip software-properties-common libmysqlclient-dev `# Needed for MySQL-python`
---> Using cache
---> b1c704fea105
Step 4/9 : RUN pip install colorama==0.3.1 requests MySQL-python psycopg2-binary pymongo docker==4.0.2 psutil
---> Using cache
---> 22f285687e68
Step 5/9 : RUN apt-get install -yqq siege
---> Using cache
---> 573301629929
Step 6/9 : RUN cp -r /usr/local/lib/python2.7/dist-packages/backports/ssl_match_hostname/ /usr/lib/python2.7/dist-packages/backports
---> Using cache
---> 472713d4e315
Step 7/9 : ENV PYTHONPATH /FrameworkBenchmarks
---> Using cache
---> 899f73c62319
Step 8/9 : ENV FWROOT /FrameworkBenchmarks
---> Using cache
---> 2c2f392d69ec
Step 9/9 : ENTRYPOINT ["python", "/FrameworkBenchmarks/toolset/run-tests.py"]
---> Using cache
---> af4384cb337d
Successfully built af4384cb337d
Successfully tagged techempower/tfb:latest
================================================================================
Running Tests...
================================================================================
wrk: Step 1/19 : FROM buildpack-deps:bionic
wrk: ---> da7bebef4e62
wrk: Step 2/19 : WORKDIR /wrk
wrk: ---> Using cache
wrk: ---> 600779a0cadc
wrk: Step 3/19 : RUN curl -sL https://github.com/wg/wrk/archive/4.1.0.tar.gz | tar xz --strip-components=1
wrk: ---> Using cache
wrk: ---> 7b2352df087e
wrk: Step 4/19 : RUN make > /dev/null
wrk: ---> Using cache
wrk: ---> 59e72081f1a9
wrk: Step 5/19 : RUN cp wrk /usr/local/bin
wrk: ---> Using cache
wrk: ---> 70a234244749
wrk: Step 6/19 : WORKDIR /
wrk: ---> Using cache
wrk: ---> 7ebb0c044efc
wrk: Step 7/19 : COPY pipeline.lua pipeline.lua
wrk: ---> Using cache
wrk: ---> dfae6901b9f2
wrk: Step 8/19 : COPY concurrency.sh concurrency.sh
wrk: ---> Using cache
wrk: ---> 4afecfcb174f
wrk: Step 9/19 : COPY pipeline.sh pipeline.sh
wrk: ---> Using cache
wrk: ---> 3fea67de80f6
wrk: Step 10/19 : COPY query.sh query.sh
wrk: ---> Using cache
wrk: ---> 6aff5ef5ac2f
wrk: Step 11/19 : RUN chmod 777 pipeline.lua concurrency.sh pipeline.sh query.sh
wrk: ---> Using cache
wrk: ---> 3d813fa63898
wrk: Step 12/19 : ENV name name
wrk: ---> Using cache
wrk: ---> ca8ca194ade9
wrk: Step 13/19 : ENV server_host server_host
wrk: ---> Using cache
wrk: ---> 99ea9116c321
wrk: Step 14/19 : ENV levels levels
wrk: ---> Using cache
wrk: ---> a3cee2489fca
wrk: Step 15/19 : ENV duration duration
wrk: ---> Using cache
wrk: ---> 365ad531132a
wrk: Step 16/19 : ENV max_concurrency max_concurrency
wrk: ---> Using cache
wrk: ---> 08fc3b8c976e
wrk: Step 17/19 : ENV max_threads max_threads
wrk: ---> Using cache
wrk: ---> 30789f345343
wrk: Step 18/19 : ENV pipeline pipeline
wrk: ---> Using cache
wrk: ---> 8a75f853f6aa
wrk: Step 19/19 : ENV accept accept
wrk: ---> Using cache
wrk: ---> 1fdd6a598026
wrk: Successfully built 1fdd6a598026
wrk: Successfully tagged techempower/tfb.wrk:latest
wrk: Build time: 3s
techempower/postgres:latest: Step 1/35 : FROM buildpack-deps:bionic
techempower/postgres:latest: ---> da7bebef4e62
techempower/postgres:latest: Step 2/35 : ADD postgresql.conf postgresql.conf
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> afda08ed62e0
techempower/postgres:latest: Step 3/35 : ADD pg_hba.conf pg_hba.conf
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 7cbe1432dcc5
techempower/postgres:latest: Step 4/35 : ADD 60-postgresql-shm.conf 60-postgresql-shm.conf
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 69a4c7b367c9
techempower/postgres:latest: Step 5/35 : ADD create-postgres-database.sql create-postgres-database.sql
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 64ea4fb8d1bc
techempower/postgres:latest: Step 6/35 : ADD create-postgres.sql create-postgres.sql
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> eafa109e40f2
techempower/postgres:latest: Step 7/35 : ADD pgdg.list pgdg.list
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> d03fe3d2dc27
techempower/postgres:latest: Step 8/35 : RUN cp pgdg.list /etc/apt/sources.list.d/
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 0e6acead8841
techempower/postgres:latest: Step 9/35 : RUN wget --quiet -O - https://www.postgresql.org/media/keys/ACCC4CF8.asc | apt-key add -
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> d6998f33f65c
techempower/postgres:latest: Step 10/35 : RUN apt-get -yqq update > /dev/null
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 4da0c07556fb
techempower/postgres:latest: Step 11/35 : RUN apt-get -yqq install locales
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> bab63138050c
techempower/postgres:latest: Step 12/35 : ENV PG_VERSION 12
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 404b93331979
techempower/postgres:latest: Step 13/35 : RUN locale-gen en_US.UTF-8
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 82207febbae3
techempower/postgres:latest: Step 14/35 : ENV LANG en_US.UTF-8
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> bfe1eefba506
techempower/postgres:latest: Step 15/35 : ENV LANGUAGE en_US:en
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> aa13007c5419
techempower/postgres:latest: Step 16/35 : ENV LC_ALL en_US.UTF-8
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> f04db279c773
techempower/postgres:latest: Step 17/35 : ENV DEBIAN_FRONTEND noninteractive
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> e9eb8d9973b1
techempower/postgres:latest: Step 18/35 : RUN apt-get -yqq install -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" postgresql postgresql-contrib
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 331010d2d8e1
techempower/postgres:latest: Step 19/35 : RUN mv postgresql.conf /etc/postgresql/${PG_VERSION}/main/postgresql.conf
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> d4fbcc0e8f81
techempower/postgres:latest: Step 20/35 : RUN mv pg_hba.conf /etc/postgresql/${PG_VERSION}/main/pg_hba.conf
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 6f79e80458e2
techempower/postgres:latest: Step 21/35 : RUN chown -Rf postgres:postgres /etc/postgresql/${PG_VERSION}/main
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> d1dcd7012de5
techempower/postgres:latest: Step 22/35 : RUN mkdir /ssd
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 677c58019362
techempower/postgres:latest: Step 23/35 : RUN cp -R -p /var/lib/postgresql/${PG_VERSION}/main /ssd/postgresql
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> a6692472ff0e
techempower/postgres:latest: Step 24/35 : RUN cp /etc/postgresql/${PG_VERSION}/main/postgresql.conf /ssd/postgresql
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 51421e866637
techempower/postgres:latest: Step 25/35 : RUN mv 60-postgresql-shm.conf /etc/sysctl.d/60-postgresql-shm.conf
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 402e02d714f4
techempower/postgres:latest: Step 26/35 : RUN chown -Rf postgres:postgres /var/run/postgresql
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 53ef16d5b9f3
techempower/postgres:latest: Step 27/35 : RUN chmod 2777 /var/run/postgresql
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> bbcc2ecea618
techempower/postgres:latest: Step 28/35 : RUN chown postgres:postgres /etc/sysctl.d/60-postgresql-shm.conf
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 00462db6b9aa
techempower/postgres:latest: Step 29/35 : RUN chown postgres:postgres create-postgres*
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 81a2723d33d0
techempower/postgres:latest: Step 30/35 : RUN chown -Rf postgres:postgres /ssd
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> efe545e9c25d
techempower/postgres:latest: Step 31/35 : ENV PGDATA=/ssd/postgresql
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 382866fa512b
techempower/postgres:latest: Step 32/35 : USER postgres
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> ac33f78b555c
techempower/postgres:latest: Step 33/35 : RUN service postgresql start && until psql -c "\q"; do sleep 1; done && psql < create-postgres-database.sql && psql -a hello_world < create-postgres.sql && service postgresql stop
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> 213e17557c34
techempower/postgres:latest: Step 34/35 : ENV PATH $PATH:/usr/lib/postgresql/$PG_VERSION/bin
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> c76aef3f4547
techempower/postgres:latest: Step 35/35 : CMD ["postgres"]
techempower/postgres:latest: ---> Using cache
techempower/postgres:latest: ---> df1c1cfe3997
techempower/postgres:latest: Successfully built df1c1cfe3997
techempower/postgres:latest: Successfully tagged techempower/postgres:latest
techempower/postgres:latest: Build time: 3s
--------------------------------------------------------------------------------
Running Test: dropwizard-postgres
--------------------------------------------------------------------------------
dropwizard-postgres: Step 1/10 : FROM maven:3.6.1-jdk-11-slim as maven
dropwizard-postgres: ---> b67032e30f89
dropwizard-postgres: Step 2/10 : WORKDIR /dropwizard
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> 4143ee52d037
dropwizard-postgres: Step 3/10 : COPY pom.xml pom.xml
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> 6611d67a52fc
dropwizard-postgres: Step 4/10 : COPY src src
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> 65aab27c0f4a
dropwizard-postgres: Step 5/10 : RUN mvn package -q -P postgres
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> 3c9ab6f8b7c3
dropwizard-postgres: Step 6/10 : FROM openjdk:11.0.3-jdk-slim
dropwizard-postgres: ---> a22f1f595f31
dropwizard-postgres: Step 7/10 : WORKDIR /dropwizard
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> f5b3f752d29c
dropwizard-postgres: Step 8/10 : COPY --from=maven /dropwizard/target/hello-world-0.0.1-SNAPSHOT.jar app.jar
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> 04d6fbe5fb55
dropwizard-postgres: Step 9/10 : COPY hello-world-postgres.yml hello-world-postgres.yml
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> c341460b3fd2
dropwizard-postgres: Step 10/10 : CMD ["java", "-jar", "app.jar", "server", "hello-world-postgres.yml"]
dropwizard-postgres: ---> Using cache
dropwizard-postgres: ---> 52f46c4bd510
dropwizard-postgres: [Warning] One or more build-args [BENCHMARK_ENV TFB_TEST_DATABASE TFB_TEST_NAME] were not consumed
dropwizard-postgres: Successfully built 52f46c4bd510
dropwizard-postgres: Successfully tagged techempower/tfb.test.dropwizard-postgres:latest
dropwizard-postgres: Build time: 10s
dropwizard-postgres: WARNING: An illegal reflective access operation has occurred
dropwizard-postgres: WARNING: Illegal reflective access by com.fasterxml.jackson.module.afterburner.util.MyClassLoader (file:/dropwizard/app.jar) to method java.lang.ClassLoader.findLoadedClass(java.lang.String)
dropwizard-postgres: WARNING: Please consider reporting this to the maintainers of com.fasterxml.jackson.module.afterburner.util.MyClassLoader
dropwizard-postgres: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
dropwizard-postgres: WARNING: All illegal access operations will be denied in a future release
dropwizard-postgres: Verifying framework URLs
--------------------------------------------------------------------------------
VERIFYING DB
--------------------------------------------------------------------------------
Accessing URL http://tfb-server:9090/db:
Accessing URL http://tfb-server:9090/db:
--------------------------------------------------------------------------------
VERIFYING QUERY COUNT FOR http://tfb-server:9090/db
--------------------------------------------------------------------------------
New configuration template added to /root/.siege
Run siege -C to view the current settings in that file
** SIEGE 4.0.4
** Preparing 128 concurrent users for battle.
The server is now under siege...
Transactions: 128 hits
Availability: 100.00 %
Elapsed time: 3.10 secs
Data transferred: 0.00 MB
Response time: 1.83 secs
Transaction rate: 41.29 trans/sec
Throughput: 0.00 MB/sec
Concurrency: 75.49
Successful transactions: 128
Failed transactions: 0
Longest transaction: 2.99
Shortest transaction: 0.61
Verifying test db for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float'
FAIL for http://tfb-server:9090
Caused Exception in TFB
This almost certainly means your return value is incorrect,
but also that you have found a bug. Please submit an issue
including this message: can't multiply sequence by non-int of type 'float'
Traceback (most recent call last):
File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type
results = test.verify(base_url)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/db_type.py", line 61, in verify
problems += verify_queries_count(self, "World", url, concurrency, repetitions, expected_queries, expected_queries)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 433, in verify_queries_count
problems.append(display_queries_count_result(queries * queries_margin, expected_queries, queries, "executed queries", url))
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 451, in display_queries_count_result
if result > expected_result * 1.05:
TypeError: can't multiply sequence by non-int of type 'float'
See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements
{'Date': 'Mon, 18 Nov 2019 09:55:51 GMT', 'Content-Length': '31', 'Content-Type': 'application/json', 'Server': 'Jetty(9.4.z-SNAPSHOT)'}
{"id":2065,"randomNumber":8706}
--------------------------------------------------------------------------------
VERIFYING QUERY
--------------------------------------------------------------------------------
Accessing URL http://tfb-server:9090/db/query?queries=2:
Accessing URL http://tfb-server:9090/db/query?queries=2:
Accessing URL http://tfb-server:9090/db/query?queries=0:
Accessing URL http://tfb-server:9090/db/query?queries=0:
Accessing URL http://tfb-server:9090/db/query?queries=foo:
Accessing URL http://tfb-server:9090/db/query?queries=foo:
Accessing URL http://tfb-server:9090/db/query?queries=501:
Accessing URL http://tfb-server:9090/db/query?queries=501:
Accessing URL http://tfb-server:9090/db/query?queries=:
Accessing URL http://tfb-server:9090/db/query?queries=:
--------------------------------------------------------------------------------
VERIFYING QUERY COUNT FOR http://tfb-server:9090/db/query?queries=20
--------------------------------------------------------------------------------
** SIEGE 4.0.4
** Preparing 128 concurrent users for battle.
The server is now under siege...
Transactions: 128 hits
Availability: 100.00 %
Elapsed time: 8.11 secs
Data transferred: 0.08 MB
Response time: 6.71 secs
Transaction rate: 15.78 trans/sec
Throughput: 0.01 MB/sec
Concurrency: 105.89
Successful transactions: 128
Failed transactions: 0
Longest transaction: 7.83
Shortest transaction: 2.42
Verifying test query for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float'
FAIL for http://tfb-server:9090
Caused Exception in TFB
This almost certainly means your return value is incorrect,
but also that you have found a bug. Please submit an issue
including this message: can't multiply sequence by non-int of type 'float'
Traceback (most recent call last):
File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type
results = test.verify(base_url)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/query_type.py", line 32, in verify
problems = verify_query_cases(self, cases, url, False)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 399, in verify_query_cases
problems += verify_queries_count(self, "world", url+"20", concurrency, repetitions, expected_queries, expected_rows, check_updates)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 433, in verify_queries_count
problems.append(display_queries_count_result(queries * queries_margin, expected_queries, queries, "executed queries", url))
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 451, in display_queries_count_result
if result > expected_result * 1.05:
TypeError: can't multiply sequence by non-int of type 'float'
See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements
{'Date': 'Mon, 18 Nov 2019 09:56:14 GMT', 'Content-Length': '33', 'Content-Type': 'application/json', 'Server': 'Jetty(9.4.z-SNAPSHOT)'}
[{"id":4724,"randomNumber":1011}]
--------------------------------------------------------------------------------
VERIFYING UPDATE
--------------------------------------------------------------------------------
Accessing URL http://tfb-server:9090/db/update?queries=2:
Accessing URL http://tfb-server:9090/db/update?queries=2:
Accessing URL http://tfb-server:9090/db/update?queries=0:
Accessing URL http://tfb-server:9090/db/update?queries=0:
Accessing URL http://tfb-server:9090/db/update?queries=foo:
Accessing URL http://tfb-server:9090/db/update?queries=foo:
Accessing URL http://tfb-server:9090/db/update?queries=501:
Accessing URL http://tfb-server:9090/db/update?queries=501:
Accessing URL http://tfb-server:9090/db/update?queries=:
Accessing URL http://tfb-server:9090/db/update?queries=:
--------------------------------------------------------------------------------
VERIFYING QUERY COUNT FOR http://tfb-server:9090/db/update?queries=20
--------------------------------------------------------------------------------
** SIEGE 4.0.4
** Preparing 128 concurrent users for battle.
The server is now under siege...
Transactions: 128 hits
Availability: 100.00 %
Elapsed time: 5.78 secs
Data transferred: 0.08 MB
Response time: 4.40 secs
Transaction rate: 22.15 trans/sec
Throughput: 0.01 MB/sec
Concurrency: 97.36
Successful transactions: 128
Failed transactions: 0
Longest transaction: 5.71
Shortest transaction: 1.05
Verifying test update for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float'
FAIL for http://tfb-server:9090
Caused Exception in TFB
This almost certainly means your return value is incorrect,
but also that you have found a bug. Please submit an issue
including this message: can't multiply sequence by non-int of type 'float'
Traceback (most recent call last):
File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type
results = test.verify(base_url)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/update_type.py", line 31, in verify
problems = verify_query_cases(self, cases, url, True)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 399, in verify_query_cases
problems += verify_queries_count(self, "world", url+"20", concurrency, repetitions, expected_queries, expected_rows, check_updates)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 417, in verify_queries_count
isBulk = check_updates and (queries < 1.001 * expected_queries) and (queries > 0.999 * expected_queries)
TypeError: can't multiply sequence by non-int of type 'float'
See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements
{'Date': 'Mon, 18 Nov 2019 09:56:44 GMT', 'Content-Length': '33', 'Content-Type': 'application/json', 'Server': 'Jetty(9.4.z-SNAPSHOT)'}
[{"id":4132,"randomNumber":5170}]
--------------------------------------------------------------------------------
VERIFYING FORTUNE
--------------------------------------------------------------------------------
Accessing URL http://tfb-server:9090/fortunes:
Accessing URL http://tfb-server:9090/fortunes:
--------------------------------------------------------------------------------
VERIFYING QUERY COUNT FOR http://tfb-server:9090/fortunes
--------------------------------------------------------------------------------
** SIEGE 4.0.4
** Preparing 128 concurrent users for battle.
The server is now under siege...
Transactions: 128 hits
Availability: 100.00 %
Elapsed time: 2.45 secs
Data transferred: 0.18 MB
Response time: 1.50 secs
Transaction rate: 52.24 trans/sec
Throughput: 0.08 MB/sec
Concurrency: 78.12
Successful transactions: 128
Failed transactions: 0
Longest transaction: 2.35
Shortest transaction: 0.45
Verifying test fortune for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float'
FAIL for http://tfb-server:9090
Caused Exception in TFB
This almost certainly means your return value is incorrect,
but also that you have found a bug. Please submit an issue
including this message: can't multiply sequence by non-int of type 'float'
Traceback (most recent call last):
File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type
results = test.verify(base_url)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/fortune_type.py", line 47, in verify
problems += verify_queries_count(self, "fortune", url, concurrency, repetitions, expected_queries, expected_rows)
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 433, in verify_queries_count
problems.append(display_queries_count_result(queries * queries_margin, expected_queries, queries, "executed queries", url))
File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 451, in display_queries_count_result
if result > expected_result * 1.05:
TypeError: can't multiply sequence by non-int of type 'float'
See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements
{'Date': 'Mon, 18 Nov 2019 09:56:54 GMT', 'Content-Length': '1509', 'Content-Type': 'text/html;charset=utf-8', 'Server': 'Jetty(9.4.z-SNAPSHOT)'}
<!DOCTYPE html>
<html>
<head>
<title>Fortunes</title>
</head>
<body>
<table>
<tr><th>id</th><th>message</th></tr>
<tr><td>11</td><td>&lt;script&gt;alert(&quot;This should not be displayed in a browser alert box.&quot;);&lt;/script&gt;</td></tr>
<tr><td>4</td><td>A bad random number generator: 1, 1, 1, 1, 1, 4.33e+67, 1, 1, 1</td></tr>
<tr><td>5</td><td>A computer program does what you tell it to do, not what you want it to do.</td></tr>
<tr><td>2</td><td>A computer scientist is someone who fixes things that aren&#39;t broken.</td></tr>
<tr><td>8</td><td>A list is only as strong as its weakest link. — Donald Knuth</td></tr>
<tr><td>0</td><td>Additional fortune added at request time.</td></tr>
<tr><td>3</td><td>After enough decimal places, nobody gives a damn.</td></tr>
<tr><td>7</td><td>Any program that runs right is obsolete.</td></tr>
<tr><td>10</td><td>Computers make very fast, very accurate mistakes.</td></tr>
<tr><td>6</td><td>Emacs is a nice operating system, but I prefer UNIX. — Tom Christaensen</td></tr>
<tr><td>9</td><td>Feature: A bug with seniority.</td></tr>
<tr><td>1</td><td>fortune: No such file or directory</td></tr>
<tr><td>12</td><td>フレームワークのベンチマーク</td></tr>
</table>
</body>
</html>
Auditing /FrameworkBenchmarks/frameworks/Java/dropwizard:
No problems to report
wrk: Build time: 3s
techempower/postgres:latest: Build time: 3s
dropwizard-postgres: Build time: 10s
dropwizard-postgres: Time starting database: 13s
dropwizard-postgres: Time until accepting requests: 40s
dropwizard-postgres: Verify time: 1m 10s
dropwizard-postgres: Failed verify!
dropwizard-postgres: Total test time: 2m 18s
tfb: Total time building so far: 16s
tfb: Total time verifying so far: 1m 10s
tfb: Total execution time so far: 2m 28s
================================================================================
Verification Summary
--------------------------------------------------------------------------------
| dropwizard-postgres
| query : FAIL
| db : FAIL
| update : FAIL
| fortune : FAIL
================================================================================
Results are saved in /FrameworkBenchmarks/results/20191118095429
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment