Skip to content

Instantly share code, notes, and snippets.

CREATE TABLE `results` (
`id` INTEGER PRIMARY KEY AUTOINCREMENT,
-- This can be one of "websites", "im", "performance", "middlebox".
`test_group_name` VARCHAR(255),
-- We use a different start_time and runtime, because we want to also have
-- data to measure the overhead of creating a report and other factors that
-- go into the test.
-- That is to say: `SUM(runtime) FROM measurements` will always be <=
-- `runtime FROM results` (most times <)
`start_time` DATETIME,
@hellais
hellais / Mining+OONI+Data.ipynb
Created February 19, 2018 12:37
Mining OONI Data Notebook
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@hellais
hellais / mk-api-docs.md
Last active February 22, 2018 15:21
MK API Docs

Measurement Kit API

This directory contains Measurement Kit API. It is composed of the following C/C++ header files (in alphabetic order):

@hellais
hellais / query.sql
Created November 29, 2017 11:40
Tor failure rate around the world
SELECT
probe_cc,
probe_asn_count,
success_count,
failure_count,
total_count,
ROUND(
(CAST(success_count AS FLOAT) / CAST(total_count AS FLOAT))::numeric
, 3) AS percentage,
test_runtime_avg
@hellais
hellais / probe_asn_counts.csv
Created November 8, 2017 09:33
SELECT COUNT(report_id), probe_asn FROM report GROUP BY probe_asn;
count probe_asn
2 2848
112 32780
763 30873
4 25643
2 48023
3 61145
7 33785
92 31252
30 4323
We can't make this file beautiful and searchable because it's too large.
test_runtime,report_id,probe_cc,probe_asn,test_name,test_start_time
5.747074,20170426T005821Z_AS35141_pVtxTOYaSA9s5eDz5ObNHwVI5mgLoFezA9yRI6qu62vbWmrlt5,BG,35141,vanilla_tor,2017-04-26 06:58:21.000000
44.195904,20170426T012318Z_AS45595_KEh7Zf0st0juaDbebp77J5rziT277Mec1f3HP5Mhy910XbUcqo,PK,45595,vanilla_tor,2017-04-26 07:23:16.000000
65.92859,20170426T090656Z_AS17974_IaxB7EKscRgAMk4eZYBMc3233dLJvkG6xYo7dNZE53uh9z3I0v,ID,17974,vanilla_tor,2017-04-26 15:06:55.000000
4.9648743,20170426T092402Z_AS15557_pWDzGILzls0F0rqopVvAXNcAnXtR5St1HNCzUIH3WpprbO0RzB,FR,15557,vanilla_tor,2017-04-26 15:24:05.000000
10.37127,20170426T104928Z_AS0_UNWhg8vpY7vgEYewOedVNLbXJZcCP0WuwCbnMeFdlSbrsLQWsR,ZZ,0,vanilla_tor,2017-04-26 16:49:28.000000
10.554186,20170426T110311Z_AS1267_ijN4eJJAAxfZ57ONAPjs3Ct63BBkM4ojRls67emiWkDbK5jAQJ,IT,1267,vanilla_tor,2017-04-26 17:03:11.000000
8.645699,20170426T174451Z_AS1267_yZ7NZFkNMqKO2gKh3SwPu81Sn248jXlN0FL2rPcCU24BFJOVBq,IT,1267,vanilla_tor,2017-04-26 23:44:51.000000
10.551572,20170426T183821Z_AS1267_
@hellais
hellais / instructions.md
Last active July 20, 2017 10:36
ooniprobe custom deck

How to setup custom decks

1. Discover where the deck should be written to by running:*

$ ooniprobe --info

(The path you care about is the one for "decks available directory")

Keybase proof

I hereby claim:

  • I am hellais on github.
  • I am hellais (https://keybase.io/hellais) on keybase.
  • I have a public key ASBedJ38ARWbpirB4XyaDdcTngu8LURz57-tUUscmn-4zAo

To claim this, I am signing this object:

@hellais
hellais / bridge_reachability.yaml
Last active December 18, 2016 16:56
Running bridge reachability
---
name: Bridge reachability deck
description: "This deck runs tor bridge reachability tests (WARNING: this requires obfs4proxy and obfsproxy installed and ooniprobe version 2.1.0)"
schedule: "@daily"
tasks:
- name: Does a bridge reachability test
ooni:
test_name: bridge_reachability
file: "$tor_bridge_lines"
@hellais
hellais / web_connectivity_anomalies.sql
Created November 11, 2016 13:47
find anomalies for web_connectivity
SELECT
id,
input,
probe_cc,
probe_asn,
report_id,
measurement_start_time,
test_start_time,
test_runtime,
test_keys->'blocking' AS blocking,