Skip to content

Instantly share code, notes, and snippets.

View nevi-me's full-sized avatar

Wakahisa nevi-me

  • Roodepoort, South Africa
View GitHub Profile

failures:

---- sql::explain_analyze::csv_explain stdout ----
thread 'sql::explain_analyze::csv_explain' panicked at 'assertion failed: `(left == right)`
  left: `[["logical_plan", "Projection: #aggregate_test_100.c1\n  Filter: #aggregate_test_100.c2 > Int64(10)\n    TableScan: aggregate_test_100 projection=[c1, c2], partial_filters=[#aggregate_test_100.c2 > Int64(10)]"], ["physical_plan", "ProjectionExec: expr=[c1@0 as c1]\n  CoalesceBatchesExec: target_batch_size=4096\n    FilterExec: CAST(c2@1 AS Int64) > 10\n      RepartitionExec: partitioning=RoundRobinBatch(NUM_CORES)\n        CsvExec: files=[ARROW_TEST_DATA/csv/aggregate_test_100.csv], has_header=true, limit=None, projection=[c1, c2]\n"]]`,
 right: `[["logical_plan", "Projection: #aggregate_test_100.c1\n Filter: #aggregate_test_100.c2 > Int64(10)\n TableScan: aggregate_test_100 projection=[c1, c2], partial_filters=[#aggregate_test_100.c2 > Int64(10)]"], ["physical_plan", "ProjectionExec: expr=[c1@0 as c1]\n CoalesceBatchesExec: target_batch_s
@nevi-me
nevi-me / datagen_py_errors.py
Created July 6, 2020 10:55
archery integration datagen.py errors
PS D:\work\oss\arrow> archery integration --with-rust=1 --with-java=1
Traceback (most recent call last):
File "C:\Users\nevi\anaconda3\Scripts\archery-script.py", line 11, in <module>
load_entry_point('archery', 'console_scripts', 'archery')()
File "C:\Users\nevi\anaconda3\lib\site-packages\click\core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "C:\Users\nevi\anaconda3\lib\site-packages\click\core.py", line 782, in main
rv = self.invoke(ctx)
File "C:\Users\nevi\anaconda3\lib\site-packages\click\core.py", line 1259, in invoke
@nevi-me
nevi-me / benchmarks.txt
Created April 24, 2020 16:22
apache-arrow-0.17.0-benchmarks
Running target/release/deps/arithmetic_kernels-7e3bd642dd080b65
add 512 time: [16.508 us 16.651 us 16.832 us]
Found 12 outliers among 100 measurements (12.00%)
3 (3.00%) high mild
9 (9.00%) high severe
add 512 simd time: [15.454 us 15.727 us 16.069 us]
Found 18 outliers among 100 measurements (18.00%)
1 (1.00%) high mild
17 (17.00%) high severe
@nevi-me
nevi-me / arrow-4853.rs
Created March 19, 2019 07:07
ARROW-4914 and ARROW-4853 snippets
#[test]
fn test_list_array_slice() {
// Construct a value array
let value_data = ArrayData::builder(DataType::Int32)
.len(8)
.add_buffer(Buffer::from(&[0, 1, 2, 3, 4, 5, 6, 7].to_byte_slice()))
.build();
// Construct a buffer for value offsets, for the nested array:
// [[0, 1, 2], [3, 4, 5], [6, 7]]
@nevi-me
nevi-me / notebook.md
Created March 14, 2019 10:56
alltypes_plain.parquet output
import pyarrow as pa
import pyarrow.parquet as pq
import pandas as pd
@nevi-me
nevi-me / README.md
Created October 22, 2018 14:04
periodically sending messages to NATS server

What I am trying to do

I am trying to periodically poll a database (every 7 seconds) and get a list of values, which I pass to a NATS server.

The overall process is that I run an Interval stream, and each time I get a result from the stream, I call a function that returns a stream/iterator over values that I pass to NATS.

I've been doing it inside a loop {} so that if my overall process fails, the loop is restarted.

I have tried the suggestion from @OtaK, but I get an error with moving the client into my closure, because temporary value gets outlived. I can't clone the client, so the only thing that worked was to create a connection per instance of my loop.

Period Capital InterestRate Repayment
201601 0.00 0.10 0.00
201602 1000.00 0.00 0.00
201603 2000.00 0.10 0.00
201604 0.00 0.10 -200.00
201605 0.00 0.10 -200.00
201606 0.00 0.10 -200.00
201607 0.00 0.10 -200.00
201608 0.00 0.00 -200.00
201609 0.00 0.10 -200.00
@nevi-me
nevi-me / keybase.md
Last active July 31, 2023 06:06
keybase proof

Keybase proof

I hereby claim:

  • I am nevi-me on github.
  • I am nevi_me (https://keybase.io/nevi_me) on keybase.
  • I have a public key whose fingerprint is F1B2 4352 7422 AE12 8B9F 4B0D CD98 7B1C D161 9AF0

To claim this, I am signing this object: