Skip to content

Instantly share code, notes, and snippets.

@komamitsu
Last active June 3, 2020 12:58
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save komamitsu/c1e4045fe2ddb108cfbf12d5f014b683 to your computer and use it in GitHub Desktop.
Save komamitsu/c1e4045fe2ddb108cfbf12d5f014b683 to your computer and use it in GitHub Desktop.
Throughput comparison between fluency and fluent-logger-java

Throughput comparison

Instances

  • fluency/fluent-logger-java:
  • m3.large
  • fleuentd
  • m3.large

Result

throughput_comparison.png

fluency is 4x faster than fluent-logger-java.

fluency

  • handles about 520000 events per seconds
2016-11-06 02:19:52.180969933 +0000 fluentd.traffic: {"fluency.test_count":0,"fluency.test_count_rate":0.0}
2016-11-06 02:19:53.181454623 +0000 fluentd.traffic: {"fluency.test_count":0,"fluency.test_count_rate":0.0}
2016-11-06 02:19:54.181994523 +0000 fluentd.traffic: {"fluency.test_count":174764,"fluency.test_count_rate":174764.0}
2016-11-06 02:19:55.191787566 +0000 fluentd.traffic: {"fluency.test_count":349528,"fluency.test_count_rate":349528.0}
2016-11-06 02:19:56.192463332 +0000 fluentd.traffic: {"fluency.test_count":567983,"fluency.test_count_rate":567983.0}
2016-11-06 02:19:57.292708773 +0000 fluentd.traffic: {"fluency.test_count":655365,"fluency.test_count_rate":655365.0}
2016-11-06 02:19:58.300677181 +0000 fluentd.traffic: {"fluency.test_count":567983,"fluency.test_count_rate":567983.0}
2016-11-06 02:19:59.315438195 +0000 fluentd.traffic: {"fluency.test_count":611674,"fluency.test_count_rate":611674.0}
2016-11-06 02:20:00.380847843 +0000 fluentd.traffic: {"fluency.test_count":699056,"fluency.test_count_rate":699056.0}
2016-11-06 02:20:01.381652543 +0000 fluentd.traffic: {"fluency.test_count":567983,"fluency.test_count_rate":567983.0}
2016-11-06 02:20:02.417514798 +0000 fluentd.traffic: {"fluency.test_count":611674,"fluency.test_count_rate":611674.0}
2016-11-06 02:20:03.426788269 +0000 fluentd.traffic: {"fluency.test_count":611674,"fluency.test_count_rate":611674.0}
2016-11-06 02:20:04.469399175 +0000 fluentd.traffic: {"fluency.test_count":655365,"fluency.test_count_rate":655365.0}
2016-11-06 02:20:05.044097967 +0000 fluentd.traffic: {"fluency.test_count":305837,"fluency.test_count_rate":305837.0}
2016-11-06 02:20:06.120904836 +0000 fluentd.traffic: {"fluency.test_count":699056,"fluency.test_count_rate":699056.0}
2016-11-06 02:20:07.121689463 +0000 fluentd.traffic: {"fluency.test_count":611674,"fluency.test_count_rate":611674.0}
2016-11-06 02:20:08.247850793 +0000 fluentd.traffic: {"fluency.test_count":699056,"fluency.test_count_rate":699056.0}
2016-11-06 02:20:09.248674406 +0000 fluentd.traffic: {"fluency.test_count":611674,"fluency.test_count_rate":611674.0}
2016-11-06 02:20:10.366464561 +0000 fluentd.traffic: {"fluency.test_count":699056,"fluency.test_count_rate":699056.0}
2016-11-06 02:20:11.367130135 +0000 fluentd.traffic: {"fluency.test_count":300598,"fluency.test_count_rate":300598.0}
2016-11-06 02:20:12.367647807 +0000 fluentd.traffic: {"fluency.test_count":0,"fluency.test_count_rate":0.0}
2016-11-06 02:20:13.368153197 +0000 fluentd.traffic: {"fluency.test_count":0,"fluency.test_count_rate":0.0}

fluent-logger-java

  • handles about 110000 events per seconds
2016-11-06 02:04:19.344848962 +0000 fluentd.traffic: {"fluency.test_count":0,"fluency.test_count_rate":0.0}
2016-11-06 02:04:20.345399003 +0000 fluentd.traffic: {"fluency.test_count":85,"fluency.test_count_rate":85.0}
2016-11-06 02:04:21.347901031 +0000 fluentd.traffic: {"fluency.test_count":94816,"fluency.test_count_rate":94816.0}
2016-11-06 02:04:22.349800614 +0000 fluentd.traffic: {"fluency.test_count":112639,"fluency.test_count_rate":112639.0}
2016-11-06 02:04:23.353173056 +0000 fluentd.traffic: {"fluency.test_count":110056,"fluency.test_count_rate":110056.0}
2016-11-06 02:04:24.364543294 +0000 fluentd.traffic: {"fluency.test_count":108482,"fluency.test_count_rate":108482.0}
2016-11-06 02:04:25.366315229 +0000 fluentd.traffic: {"fluency.test_count":113977,"fluency.test_count_rate":113977.0}
2016-11-06 02:04:26.373115832 +0000 fluentd.traffic: {"fluency.test_count":109079,"fluency.test_count_rate":109079.0}
2016-11-06 02:04:27.389863408 +0000 fluentd.traffic: {"fluency.test_count":112776,"fluency.test_count_rate":112776.0}
2016-11-06 02:04:28.392724477 +0000 fluentd.traffic: {"fluency.test_count":112717,"fluency.test_count_rate":112717.0}
2016-11-06 02:04:29.396089878 +0000 fluentd.traffic: {"fluency.test_count":107696,"fluency.test_count_rate":107696.0}
2016-11-06 02:04:30.399276314 +0000 fluentd.traffic: {"fluency.test_count":114249,"fluency.test_count_rate":114249.0}
2016-11-06 02:04:31.402106532 +0000 fluentd.traffic: {"fluency.test_count":110309,"fluency.test_count_rate":110309.0}
2016-11-06 02:04:32.418428870 +0000 fluentd.traffic: {"fluency.test_count":113091,"fluency.test_count_rate":113091.0}
2016-11-06 02:04:33.427982764 +0000 fluentd.traffic: {"fluency.test_count":114754,"fluency.test_count_rate":114754.0}
2016-11-06 02:04:34.432685253 +0000 fluentd.traffic: {"fluency.test_count":109340,"fluency.test_count_rate":109340.0}
2016-11-06 02:04:35.440723469 +0000 fluentd.traffic: {"fluency.test_count":115124,"fluency.test_count_rate":115124.0}
2016-11-06 02:04:36.444481835 +0000 fluentd.traffic: {"fluency.test_count":108319,"fluency.test_count_rate":108319.0}
2016-11-06 02:04:37.447606709 +0000 fluentd.traffic: {"fluency.test_count":113027,"fluency.test_count_rate":113027.0}
2016-11-06 02:04:38.451001469 +0000 fluentd.traffic: {"fluency.test_count":111686,"fluency.test_count_rate":111686.0}
2016-11-06 02:04:39.454571308 +0000 fluentd.traffic: {"fluency.test_count":110487,"fluency.test_count_rate":110487.0}
2016-11-06 02:04:40.457370433 +0000 fluentd.traffic: {"fluency.test_count":114064,"fluency.test_count_rate":114064.0}
2016-11-06 02:04:41.460379757 +0000 fluentd.traffic: {"fluency.test_count":108129,"fluency.test_count_rate":108129.0}
2016-11-06 02:04:42.475329514 +0000 fluentd.traffic: {"fluency.test_count":114619,"fluency.test_count_rate":114619.0}
2016-11-06 02:04:43.478196584 +0000 fluentd.traffic: {"fluency.test_count":110197,"fluency.test_count_rate":110197.0}
2016-11-06 02:04:44.481318079 +0000 fluentd.traffic: {"fluency.test_count":111138,"fluency.test_count_rate":111138.0}
2016-11-06 02:04:45.488796763 +0000 fluentd.traffic: {"fluency.test_count":114671,"fluency.test_count_rate":114671.0}
2016-11-06 02:04:46.492671046 +0000 fluentd.traffic: {"fluency.test_count":108537,"fluency.test_count_rate":108537.0}
2016-11-06 02:04:47.002237208 +0000 fluentd.traffic: {"fluency.test_count":57988,"fluency.test_count_rate":57988.0}
2016-11-06 02:04:48.010847867 +0000 fluentd.traffic: {"fluency.test_count":111704,"fluency.test_count_rate":111704.0}
2016-11-06 02:04:49.012484602 +0000 fluentd.traffic: {"fluency.test_count":113241,"fluency.test_count_rate":113241.0}
2016-11-06 02:04:50.031867323 +0000 fluentd.traffic: {"fluency.test_count":110009,"fluency.test_count_rate":110009.0}
2016-11-06 02:04:51.055703759 +0000 fluentd.traffic: {"fluency.test_count":117161,"fluency.test_count_rate":117161.0}
2016-11-06 02:04:52.059389129 +0000 fluentd.traffic: {"fluency.test_count":107896,"fluency.test_count_rate":107896.0}
2016-11-06 02:04:53.064862700 +0000 fluentd.traffic: {"fluency.test_count":112550,"fluency.test_count_rate":112550.0}
2016-11-06 02:04:54.071370678 +0000 fluentd.traffic: {"fluency.test_count":112487,"fluency.test_count_rate":112487.0}
2016-11-06 02:04:55.077303445 +0000 fluentd.traffic: {"fluency.test_count":110701,"fluency.test_count_rate":110701.0}
2016-11-06 02:04:56.080112332 +0000 fluentd.traffic: {"fluency.test_count":114282,"fluency.test_count_rate":114282.0}
2016-11-06 02:04:57.082034453 +0000 fluentd.traffic: {"fluency.test_count":107707,"fluency.test_count_rate":107707.0}
2016-11-06 02:04:58.084006214 +0000 fluentd.traffic: {"fluency.test_count":113480,"fluency.test_count_rate":113480.0}
2016-11-06 02:04:59.086899950 +0000 fluentd.traffic: {"fluency.test_count":110390,"fluency.test_count_rate":110390.0}
2016-11-06 02:05:00.089427242 +0000 fluentd.traffic: {"fluency.test_count":110323,"fluency.test_count_rate":110323.0}
2016-11-06 02:05:01.095010541 +0000 fluentd.traffic: {"fluency.test_count":113950,"fluency.test_count_rate":113950.0}
2016-11-06 02:05:02.099165742 +0000 fluentd.traffic: {"fluency.test_count":107906,"fluency.test_count_rate":107906.0}
2016-11-06 02:05:03.109596052 +0000 fluentd.traffic: {"fluency.test_count":114844,"fluency.test_count_rate":114844.0}
2016-11-06 02:05:04.111745720 +0000 fluentd.traffic: {"fluency.test_count":109228,"fluency.test_count_rate":109228.0}
2016-11-06 02:05:05.116105953 +0000 fluentd.traffic: {"fluency.test_count":113690,"fluency.test_count_rate":113690.0}
2016-11-06 02:05:06.120261068 +0000 fluentd.traffic: {"fluency.test_count":112510,"fluency.test_count_rate":112510.0}
2016-11-06 02:05:07.123940407 +0000 fluentd.traffic: {"fluency.test_count":110612,"fluency.test_count_rate":110612.0}
2016-11-06 02:05:08.126763446 +0000 fluentd.traffic: {"fluency.test_count":114280,"fluency.test_count_rate":114280.0}
2016-11-06 02:05:09.128910671 +0000 fluentd.traffic: {"fluency.test_count":107061,"fluency.test_count_rate":107061.0}
2016-11-06 02:05:10.132213361 +0000 fluentd.traffic: {"fluency.test_count":112785,"fluency.test_count_rate":112785.0}
2016-11-06 02:05:11.140327545 +0000 fluentd.traffic: {"fluency.test_count":110941,"fluency.test_count_rate":110941.0}
2016-11-06 02:05:12.146149308 +0000 fluentd.traffic: {"fluency.test_count":110782,"fluency.test_count_rate":110782.0}
2016-11-06 02:05:13.151155419 +0000 fluentd.traffic: {"fluency.test_count":112672,"fluency.test_count_rate":112672.0}
2016-11-06 02:05:14.153957611 +0000 fluentd.traffic: {"fluency.test_count":105781,"fluency.test_count_rate":105781.0}
2016-11-06 02:05:15.156857361 +0000 fluentd.traffic: {"fluency.test_count":112915,"fluency.test_count_rate":112915.0}
2016-11-06 02:05:16.160856444 +0000 fluentd.traffic: {"fluency.test_count":110058,"fluency.test_count_rate":110058.0}
2016-11-06 02:05:17.165900446 +0000 fluentd.traffic: {"fluency.test_count":109361,"fluency.test_count_rate":109361.0}
2016-11-06 02:05:18.177427982 +0000 fluentd.traffic: {"fluency.test_count":114559,"fluency.test_count_rate":114559.0}
2016-11-06 02:05:19.178731200 +0000 fluentd.traffic: {"fluency.test_count":106983,"fluency.test_count_rate":106983.0}
2016-11-06 02:05:20.183183266 +0000 fluentd.traffic: {"fluency.test_count":111761,"fluency.test_count_rate":111761.0}
2016-11-06 02:05:21.186877703 +0000 fluentd.traffic: {"fluency.test_count":109947,"fluency.test_count_rate":109947.0}
2016-11-06 02:05:22.189591462 +0000 fluentd.traffic: {"fluency.test_count":110001,"fluency.test_count_rate":110001.0}
2016-11-06 02:05:23.192359207 +0000 fluentd.traffic: {"fluency.test_count":113362,"fluency.test_count_rate":113362.0}
2016-11-06 02:05:24.195541896 +0000 fluentd.traffic: {"fluency.test_count":108055,"fluency.test_count_rate":108055.0}
2016-11-06 02:05:25.197861885 +0000 fluentd.traffic: {"fluency.test_count":113515,"fluency.test_count_rate":113515.0}
2016-11-06 02:05:26.200665813 +0000 fluentd.traffic: {"fluency.test_count":108277,"fluency.test_count_rate":108277.0}
2016-11-06 02:05:27.219515068 +0000 fluentd.traffic: {"fluency.test_count":112612,"fluency.test_count_rate":112612.0}
2016-11-06 02:05:28.251292031 +0000 fluentd.traffic: {"fluency.test_count":116191,"fluency.test_count_rate":116191.0}
2016-11-06 02:05:29.258427551 +0000 fluentd.traffic: {"fluency.test_count":108604,"fluency.test_count_rate":108604.0}
2016-11-06 02:05:30.261239674 +0000 fluentd.traffic: {"fluency.test_count":114326,"fluency.test_count_rate":114326.0}
2016-11-06 02:05:31.264015484 +0000 fluentd.traffic: {"fluency.test_count":105783,"fluency.test_count_rate":105783.0}
2016-11-06 02:05:32.267798933 +0000 fluentd.traffic: {"fluency.test_count":112382,"fluency.test_count_rate":112382.0}
2016-11-06 02:05:33.283144392 +0000 fluentd.traffic: {"fluency.test_count":113276,"fluency.test_count_rate":113276.0}
2016-11-06 02:05:34.286692097 +0000 fluentd.traffic: {"fluency.test_count":109123,"fluency.test_count_rate":109123.0}
2016-11-06 02:05:35.306888528 +0000 fluentd.traffic: {"fluency.test_count":114506,"fluency.test_count_rate":114506.0}
2016-11-06 02:05:36.309123822 +0000 fluentd.traffic: {"fluency.test_count":107274,"fluency.test_count_rate":107274.0}
2016-11-06 02:05:37.312276707 +0000 fluentd.traffic: {"fluency.test_count":112195,"fluency.test_count_rate":112195.0}
2016-11-06 02:05:38.315595572 +0000 fluentd.traffic: {"fluency.test_count":111117,"fluency.test_count_rate":111117.0}
2016-11-06 02:05:39.332111245 +0000 fluentd.traffic: {"fluency.test_count":111888,"fluency.test_count_rate":111888.0}
2016-11-06 02:05:40.335366288 +0000 fluentd.traffic: {"fluency.test_count":112894,"fluency.test_count_rate":112894.0}
2016-11-06 02:05:41.339459997 +0000 fluentd.traffic: {"fluency.test_count":106800,"fluency.test_count_rate":106800.0}
2016-11-06 02:05:42.341225637 +0000 fluentd.traffic: {"fluency.test_count":112821,"fluency.test_count_rate":112821.0}
2016-11-06 02:05:43.344020274 +0000 fluentd.traffic: {"fluency.test_count":110440,"fluency.test_count_rate":110440.0}
2016-11-06 02:05:44.359836466 +0000 fluentd.traffic: {"fluency.test_count":110671,"fluency.test_count_rate":110671.0}
2016-11-06 02:05:45.364213889 +0000 fluentd.traffic: {"fluency.test_count":113015,"fluency.test_count_rate":113015.0}
2016-11-06 02:05:46.367071561 +0000 fluentd.traffic: {"fluency.test_count":106783,"fluency.test_count_rate":106783.0}
2016-11-06 02:05:47.369633304 +0000 fluentd.traffic: {"fluency.test_count":112761,"fluency.test_count_rate":112761.0}
2016-11-06 02:05:48.386806921 +0000 fluentd.traffic: {"fluency.test_count":110552,"fluency.test_count_rate":110552.0}
2016-11-06 02:05:49.390268764 +0000 fluentd.traffic: {"fluency.test_count":110707,"fluency.test_count_rate":110707.0}
2016-11-06 02:05:50.395138005 +0000 fluentd.traffic: {"fluency.test_count":113821,"fluency.test_count_rate":113821.0}
2016-11-06 02:05:51.495659955 +0000 fluentd.traffic: {"fluency.test_count":49633,"fluency.test_count_rate":49633.0}
2016-11-06 02:05:52.496124861 +0000 fluentd.traffic: {"fluency.test_count":0,"fluency.test_count_rate":0.0}
2016-11-06 02:05:53.496638076 +0000 fluentd.traffic: {"fluency.test_count":0,"fluency.test_count_rate":0.0}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment