Skip to content

Instantly share code, notes, and snippets.

{
"cols": 6,
"rowheight": "4:3",
"tiles": [
{
"span": {
"col": 4,
"row": 4,
"x": 0,
"y": 0
Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
64 GB RAM
SSD, lvm w/ crypt
Ingestion rate comparison using the same data source: 'documents-2.json' from the esrally benchmarking tool, which is based on http://download.geonames.org/export/dump/allCountries.zip
Gravwell Results:
JSON Full Indexing strategy:
Completed in 1m54.227479463s (3.29 GB)
@remasis
remasis / timeDiff.anko
Last active October 3, 2018 04:44
Example Gravwell anko script for calculating the time difference between entries in nanoseconds.
# Example Gravwell anko script for calculating the time difference between entries in nanoseconds.
# Example usage to view the ms between entries might look like this:
# tag=syslog sort by time asc | anko timeDiff | eval setEnum("ms", toFloat(timeDiff)/1000000.0) | table ms
# Note: `sort by time` is required to ensure proper ordering. Gravwell is time-indexed but for sub-granular differences
# in time, order is not guaranteed. This is what enables distributed pipeline execution.
# Note: This script is uploaded as a resource called "timeDiff" in the above query example
# Further docs about Gravwell scripting can be found at https://dev.gravwell.io/docs/#!search/anko/anko.md
var lastTime = 0
@remasis
remasis / fcc-scraper.js
Created October 2, 2017 23:29
FCC comment scraper
//Yes, this scraper sucks but it worked and we have 44 gigs of comments
var https = require('https');
var fs = require('fs');
var pagesize = 100;
var offset = 0;
var stop = 300;
var outfile = fs.createWriteStream("./fcc-comments-" + offset + ".json");
@remasis
remasis / mcast.py
Created June 8, 2015 16:35
python udp multicast
#!/usr/bin/env python
import socket
import binascii
payload = "4141414141"
payload = binascii.unhexlify(payload)
MCAST_GRP = '224.0.0.22'
MCAST_PORT = 4444
sock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM, socket.IPPROTO_UDP)

Keybase proof

I hereby claim:

  • I am remasis on github.
  • I am remasis (https://keybase.io/remasis) on keybase.
  • I have a public key whose fingerprint is EFDE 28CE 86AE 202D 53DE CB4B 8FB8 F094 0260 BC5D

To claim this, I am signing this object:

@remasis
remasis / three_eyed_fish.js
Created April 22, 2013 05:20
javascript strace parser for plaidctf three_eyed_fish: "three_eyed_fish 100 binary This binary is totally legit we promise" .- -. -.. ----- ..- ----- -.. .. -.. -. - ----- . ...- . -. ----- -. . . -.. ----- .- -. ----- .- .-. -.. ..- .. -. ---
var fs = require('fs'),
readline = require('readline');
var rd = readline.createInterface({
input: fs.createReadStream('strace.log'),
output: process.stdout,
terminal: false
});
var morse = "";