lemon24

"""
Say you have a SQLite connection to database `main`
with attached database `attached`.

Does a long insert on the `attached` database in a similar connection
lock the `main` database in this connection?

No, it only locks `attached`.

Output:

lemon24

This gist tracks the creation of an almost fully functional sqlite3 server in Python 3, using only the multiprocessing.managers standard library module.

But why?

• To see if it can be done.
• To learn about multiprocessing managers.
• Aside from whole-database locking, SQLite (maybe, see below) supports table-level locking between multiple connections in the same process to the same database. A "SQLite server" makes it possible for users in different processes to use SQLite connections that live in the same process.

---

lemon24

"""
...in which we use property-based / model-based testing to find 
an eventually consistent way of synchronizing entries
from the main reader storage to an (unrelated) search index,
without coupling the storage and search with transactions / triggers.

A real model checker like TLA+ or Alloy may have been a better tool for this,
but I don't know how to use them.

This is the first step in https://github.com/lemon24/reader/issues/323.

lemon24

lemon24

import shutil

import mutagen

shutil.copy('original.mp4', 'new.mp4')

# mutagen.File knows how to open any file (works with both MP4 and MP4):
#
# https://mutagen.readthedocs.io/en/latest/user/gettingstarted.html    
# https://mutagen.readthedocs.io/en/latest/api/base.html#mutagen.File

lemon24

-- fts5

CREATE VIRTUAL TABLE entries USING fts5(
    id UNINDEXED,
    content
);

INSERT INTO entries
VALUES
    ('one', 'one'),

lemon24

"""
Distributed key-value store prototype, with no kind of consistency.

---

A demo (from before we had bootstapping): https://asciinema.org/a/616231

On one machine:

>>> d = dkv.DKV()

lemon24

"""
measure how much time it takes for requests to make many localhost requests

try do so some optimizations


initial results on on an old mac:

$ python req.py http 100  
itrg              0.3003

lemon24

"""
(Broken?) MinHash implementation attempting to optimize Jaccard similarity
for https://github.com/lemon24/reader/issues/202 (reader.entry_dedupe plugin).

---

Current state:

It kinda works, but no matter how much I increase LOOPS, 
the result doesn't seem to converge to the real similarity

lemon24

"""
stricter typing 
for https://github.com/lemon24/reader/blob/master/src/reader/_parser.py
for https://github.com/lemon24/reader/issues/271

"""
from typing import *
import io
from dataclasses import dataclass
from random import choice