Skip to content

Instantly share code, notes, and snippets.

View maciej's full-sized avatar

Maciej Biłas maciej

61 followers · 16 following
View GitHub Profile
@maciej
maciej / Roaring go 1.10 to 1.11
Last active September 17, 2018 11:12
# benchcmp go1.10.txt go1.11.txt
benchmark old ns/op new ns/op delta
BenchmarkRealDataParOr/census-income_srt-8 248593 180973 -27.20%
BenchmarkRealDataParOr/census-income-8 367601 237989 -35.26%
BenchmarkRealDataParOr/census1881_srt-8 476522 420031 -11.85%
BenchmarkRealDataParOr/census1881-8 600368 453043 -24.54%
BenchmarkRealDataParOr/dimension_003-8 2385498 2064527 -13.46%
BenchmarkRealDataParOr/dimension_008-8 1023859 879303 -14.12%
BenchmarkRealDataParOr/dimension_033-8 381929 326806 -14.43%
BenchmarkRealDataParOr/uscensus2000-8 1477582 1188959 -19.53%
@maciej
maciej / par2-benchcmp-rev1.txt
Last active April 10, 2018 08:31
benchmark old ns/op new ns/op delta
BenchmarkRealDataParOr/census-income_srt-8 269673 194486 -27.88%
BenchmarkRealDataParOr/census-income-8 395797 310505 -21.55%
BenchmarkRealDataParOr/census1881_srt-8 723821 402359 -44.41%
BenchmarkRealDataParOr/census1881-8 718247 573550 -20.15%
BenchmarkRealDataParOr/dimension_003-8 7466247 2197374 -70.57%
BenchmarkRealDataParOr/dimension_008-8 3062717 833368 -72.79%
BenchmarkRealDataParOr/dimension_033-8 474489 302080 -36.34%
BenchmarkRealDataParOr/uscensus2000-8 1912128 1092854 -42.85%
BenchmarkRealDataParOr/weather_sept_85_srt-8 370585 178577 -51.81%
@maciej
maciej / bechcmp-par2-fixed.txt
Last active April 8, 2018 16:59
Recent benchmark results showing improvements in new parallel OR aggregation
benchmark old ns/op new ns/op delta
BenchmarkRealDataParOr/census-income_srt-8 268487 183819 -31.54%
BenchmarkRealDataParOr/census-income-8 388319 290276 -25.25%
BenchmarkRealDataParOr/census1881_srt-8 704961 612338 -13.14%
BenchmarkRealDataParOr/census1881-8 667567 915398 +37.12%
BenchmarkRealDataParOr/dimension_003-8 7162034 1278775 -82.15%
BenchmarkRealDataParOr/dimension_008-8 3195418 553927 -82.66%
BenchmarkRealDataParOr/dimension_033-8 470188 400405 -14.84%
BenchmarkRealDataParOr/uscensus2000-8 1909054 1284590 -32.71%
BenchmarkRealDataParOr/weather_sept_85_srt-8 373981 158308 -57.67%
@maciej
maciej / Java Roaring RealData benchmark results.txt
Created January 31, 2018 16:05
Benchmark (dataset) (immutable) (type) Mode Cnt Score Error Units
o.r.realdata.RealDataBenchmarkWideOrNaive.wideOr_naive census-income false roaring avgt 20 678.057 ± 33.607 us/op
o.r.realdata.RealDataBenchmarkWideOrNaive.wideOr_naive census1881 false roaring avgt 20 1438.469 ± 92.990 us/op
o.r.realdata.RealDataBenchmarkWideOrNaive.wideOr_naive dimension_008 false roaring avgt 20 1604.814 ± 77.209 us/op
o.r.realdata.RealDataBenchmarkWideOrNaive.wideOr_naive dimension_003 false roaring avgt 20 4846.242 ± 310.511 us/op
o.r.realdata.RealDataBenchmarkWideOrNaive.wideOr_naive dimension_033 false roaring avgt 20 2009.061 ± 131.559 us/op
o.r.realdata.RealDataBenchmarkWideOrNaive.wideOr_naive uscensus2000 false roaring avgt
@maciej
maciej / roaring-heap-Swap.s
Created January 16, 2018 21:46
TEXT %22%22.(*bitmapContainerHeap).Swap(SB) gofile..<autogenerated>
gofile..<autogenerated>:1 0x39f81 65488b0c2500000000 MOVQ GS:0, CX [5:9]R_TLS_LE
gofile..<autogenerated>:1 0x39f8a 483b6110 CMPQ 0x10(CX), SP
gofile..<autogenerated>:1 0x39f8e 0f8640010000 JBE 0x3a0d4
gofile..<autogenerated>:1 0x39f94 4883ec58 SUBQ $0x58, SP
gofile..<autogenerated>:1 0x39f98 48896c2450 MOVQ BP, 0x50(SP)
gofile..<autogenerated>:1 0x39f9d 488d6c2450 LEAQ 0x50(SP), BP
gofile..<autogenerated>:1 0x39fa2 488b5920 MOVQ 0x20(CX), BX
gofile..<autogenerated>:1 0x39fa6 4885db TESTQ BX, BX
gofile..<autogenerated>:1 0x39fa9 0f852f010000 JNE 0x3a0de
@maciej
maciej / roaring-122-benchmarks.txt
Created December 29, 2017 17:19
Roaring #122 benchmarks
# columns:
# old – master branch
# new – rle-len branch
benchmark old ns/op new ns/op delta
BenchmarkMarshalMsgarrayContainer-8 32.2 32.7 +1.55%
BenchmarkAppendMsgarrayContainer-8 8.91 8.98 +0.79%
BenchmarkUnmarshalarrayContainer-8 26.0 26.3 +1.15%
BenchmarkEncodearrayContainer-8 17.9 17.9 +0.00%
BenchmarkDecodearrayContainer-8 51.3 51.0 -0.58%
@maciej
maciej / benchcmp.txt
Created December 8, 2017 11:12
Comparing Roaring Benchmarks between go1.9 and go1.10beta1 (Retina MBP, 13-inch, Early 2015, dual core Intel Core i5 2,7GHz)
benchmark old ns/op new ns/op delta
BenchmarkMarshalMsgarrayContainer-4 37.9 35.0 -7.65%
BenchmarkAppendMsgarrayContainer-4 10.3 9.88 -4.08%
BenchmarkUnmarshalarrayContainer-4 29.9 28.6 -4.35%
BenchmarkEncodearrayContainer-4 20.4 19.3 -5.39%
BenchmarkDecodearrayContainer-4 61.5 55.9 -9.11%
BenchmarkIntersectionBitset-4 12523 10656 -14.91%
BenchmarkIntersectionRoaring-4 1101 1067 -3.09%
BenchmarkIntersectionCardinalityRoaring-4 258 257 -0.39%
BenchmarkUnionBitset-4 7441033 6834360 -8.15%
@maciej
maciej / RandomMapGenerator result.md
Last active July 25, 2017 10:25
HPPC LongIntMap memory usage

After a single run of RandomMapGenerator the reported retained size by the Map is ~1.6GiB. YourKit profiler was used.

@maciej
maciej / RankBug.scala
Created March 6, 2017 16:16
import java.io.DataInputStream
import org.roaringbitmap.buffer.MutableRoaringBitmap
object RankBug {
def main(args: Array[String]): Unit = {
val in = new DataInputStream(this.getClass.getClassLoader.getResourceAsStream("buggy-rank.bitmap"))
try {
val bitmap = new MutableRoaringBitmap()
@maciej
maciej / transfer.fish
Last active December 6, 2016 10:58 — forked from nl5887/transfer.fish
Bash and zsh alias for transfer.sh. Transfers files and directories to transfer.sh.
function transfer
if test (count $argv) -eq 0
echo -e "No arguments specified. Usage:\necho transfer /tmp/test.md\ncat /tmp/test.md | transfer test.md"
return 1
end
## get temporarily filename, output is written to this file show progress can be showed
set tmpfile ( mktemp -t transferXXX )
## upload stdin or file