Skip to content

Instantly share code, notes, and snippets.

View gangliao's full-sized avatar
🏠
Working from home

Gang Liao gangliao

🏠
Working from home
165 followers · 8 following
View GitHub Profile
@gangliao
gangliao / blob_cache_bench3.txt
Last active August 8, 2022 17:19
#### Baseline (DIRECT_IO enabled) vs Baseline (Buffered_IO enabled) vs Blob_cache (DIRECT_IO enabled) vs Blob_cache (Buffered_IO enabled) DB = 32GB, Compression=lz4, Cache Size = 32 GB
\n\n1k\n\n
ops_sec mb_sec lsm_sz blob_sz c_wgb w_amp c_mbps c_wsecs c_csecs b_rgb b_wgb usec_op p50 p99 p99.9 p99.99 pmax uptime stall% Nstall u_cpu s_cpu rss test date version job_id githash
425060 423.2 357MB 13.1GB, 13.5 1.1 230.1 150 139 0 13 2.4 1.5 9 19 29 5204 60 0.0 0 0.3 0.0 NA bulkload 2022-08-6T18:30:32 7.6.0 d69f834b15
90323 56.9 281MB 19.9GB, 0.0 0.0 0.0 0 0 0 0 177.0 203.7 574 869 2046 70351 60 0.0 0 0.2 0.2 0.8 readwhilewriting.t16 2022-08-6T18:32:19 7.6.0 d69f834b15
5327 53.0 283MB 19.9GB, 0.1 1.6 0.5 1 0 0 0 2978.0 2884.8 5281 9638 21243 42060 122 0.0 0 0.1 0.2 0.8 fwdrangewhilewriting.t16 2022-08-6T18:34:22 7.6.0 d69f834b15
97928 61.9 285MB 20.0GB, 0.1 NA 1.1 1 0 0 0 163.3 194.2 549 1464 5954 100836 61 0.0 0 0.2 0.2 0.8 readrandom.t16 2022-08-6T18:36:27 7.6.0 d69f834b15
6073 60.5 285MB 20.0GB, 0.0 NA 0
@gangliao
gangliao / blob_cache_bench2.txt
Created August 5, 2022 20:42
#### Baseline (DIRECT_IO enabled) vs Blob_cache (DIRECT_IO enabled) DB = 32GB Compression=none
32G 1k
ops_sec mb_sec lsm_sz blob_sz c_wgb w_amp c_mbps c_wsecs c_csecs b_rgb b_wgb usec_op p50 p99 p99.9 p99.99 pmax uptime stall% Nstall u_cpu s_cpu rss test date version job_id githash
442378 440.4 818MB 23.9GB, 24.7 1.9 421.4 114 96 0 24 2.3 1.5 7 20 30 5285 60 0.0 0 0.2 0.0 NA bulkload 2022-08-5T01:36:44 7.6.0 d69f834b15
86224 54.3 725MB 33.1GB, 0.0 0.0 0.0 0 0 0 0 185.4 208.3 656 1254 4544 31108 61 0.0 0 0.2 0.2 0.8 readwhilewriting.t16 2022-08-5T01:38:26 7.6.0 d69f834b15
5183 51.6 728MB 33.2GB, 0.1 2.0 0.8 0 0 0 0 3067.6 2959.5 6275 14145 30677 43467 122 0.0 0 0.1 0.2 0.8 fwdrangewhilewriting.t16 2022-08-5T01:40:28 7.6.0 d69f834b15
@gangliao
gangliao / flock-function-deps
Created January 25, 2022 16:23
flock-function v0.3.0
├── async-trait v0.1.52 (proc-macro)
│ ├── proc-macro2 v1.0.36
│ │ └── unicode-xid v0.2.2
│ ├── quote v1.0.15
│ │ └── proc-macro2 v1.0.36 (*)
│ └── syn v1.0.86
│ ├── proc-macro2 v1.0.36 (*)
│ ├── quote v1.0.15 (*)
│ └── unicode-xid v0.2.2
@gangliao
gangliao / nexmark_q13_side_input.csv
Last active December 24, 2021 00:18
key value
0 0
1 1
2 2
3 3
4 4
5 5
6 6
7 7
8 8
@gangliao
gangliao / nexmark.json
Created April 2, 2021 00:58
This file has been truncated, but you can view the full file.
```json
{"time":0,"event":{"type":"Person","id":1000,"name":"vicky noris","email_address":"vzbhp@wxv.com","credit_card":"4355 0142 3460 9324","city":"boise","state":"ca","date_time":1436918400000}}
{"time":0,"event":{"type":"Person","id":1001,"name":"peter white","email_address":"hpp@eqgs.com","credit_card":"1654 3220 6913 9348","city":"boise","state":"wy","date_time":1436918400001}}
{"time":0,"event":{"type":"Person","id":1002,"name":"sarah spencer","email_address":"vbk@yp.com","credit_card":"9433 2020 5329 7651","city":"phoenix","state":"wa","date_time":1436918400002}}
{"time":0,"event":{"type":"Person","id":1003,"name":"vicky jones","email_address":"xahy@offl.com","credit_card":"0177 9514 9268 1496","city":"los angeles","state":"ca","date_time":1436918400002}}
{"time":0,"event":{"type":"Person","id":1004,"name":"julie white","email_address":"mlhga@erww.com","credit_card":"1109 7365 8600 8718","city":"portland","state":"or","date_time":1436918400003}}
{"time":0,"event":{"type":"Person","id":1005,"name":"sar
@gangliao
gangliao / squirtle-cla.txt
Last active October 30, 2021 04:25
Squirtle-CLA.md
# Flock Contributor License Agreement
In order to clarify the intellectual property license granted with Contributions from any person or entity, the open-source project Flock ("Flock") must have a Contributor License Agreement (CLA) on file that has been signed by each Contributor, indicating agreement to the license terms below. This license is for your protection as a Contributor as well as the protection of Flock and its users; it does not change your rights to use your own Contributions for any other purpose.
You accept and agree to the following terms and conditions for your present and future Contributions submitted to Flock. Except for the license granted herein to Flock and recipients of software distributed by Flock, You reserve all right, title, and interest in and to Your Contributions.
1. Definitions.
"You" (or "Your") shall mean the copyright owner or legal entity authorized by the copyright owner that is making this Agreement with Flock. For legal entities, the entity making a Contribution a
@gangliao
gangliao / HDFS rename
Created March 27, 2020 12:08
Started [cpu] profiling
--- Execution profile ---
Total samples : 14613
unknown_Java : 19 (0.13%)
not_walkable_Java : 12 (0.08%)
Frame buffer usage : 2.7247%
--- 50800082519 ns (34.52%), 5062 samples
[ 0] oop_disjoint_arraycopy
@gangliao
gangliao / P2PDB-CLA.md
Last active December 19, 2019 07:13

P2PDB Contributor License Agreement

In order to clarify the intellectual property license granted with Contributions from any person or entity, the open-source project P2PDB ("P2PDB") must have a Contributor License Agreement (CLA) on file that has been signed by each Contributor, indicating agreement to the license terms below. This license is for your protection as a Contributor as well as the protection of P2PDB and its users; it does not change your rights to use your own Contributions for any other purpose.

You accept and agree to the following terms and conditions for your present and future Contributions submitted to P2PDB. Except for the license granted herein to P2PDB and recipients of software distributed by P2PDB, You reserve all right, title, and interest in and to Your Contributions.

  1. Definitions. "You" (or "Your") shall mean the copyright owner or legal entity authorized by the copyright owner that is making this Agreement with P2PDB. For legal entities, the entity making a Contribution a
@gangliao
gangliao / bert.txt
Created July 17, 2019 22:35
left_rows=960, right_rows=39939 2 op
0 :: 100 2.6 37.2 7.6000e+00 6.4179e-01 8.242 1.3314e-04
0 :: 200 15.1 6.4 7.6687e+00 6.8078e-01 8.349 1.2607e-04
0 :: 300 0.5 187.4 7.2080e+00 7.7016e-01 7.978 1.1914e-04
0 :: 400 0.5 187.2 7.2450e+00 7.0879e-01 7.954 1.1214e-04
0 :: 500 0.5 186.7 7.1506e+00 6.7466e-01 7.825 1.0514e-04
0 :: 600 0.6 172.2 6.8240e+00 6.8332e-01 7.507 9.8140e-05
0 :: 700 0.5 185.6 6.7771e+00 6.9906e-01 7.476 9.1140e-05
0 :: 800 0.5 184.9 6.9732e+00 6.6641e-01 7.640 8.4140e-05
0 :: 900 0.5 185.0 6.9443e+00 6.1609e-01 7.560 7.7140e-05
@gangliao
gangliao / baseline.txt
Last active September 13, 2019 06:45
RHEL:
Create:
| | # threads | # files | Ops/sec | average time |
|------|-----------|---------|----------|--------------|
| Volt | 1 | 1 | 20.83 | 47 |
| Volt | 1 | 10 | 166.67 | 6 |
| Volt | 1 | 100 | 555.55 | 1 |
| Volt | 1 | 1000 | 1377.41 | 0 |