Skip to content

Instantly share code, notes, and snippets.

View IllDepence's full-sized avatar

Tarek Saier IllDepence

32 followers · 18 following
View GitHub Profile
@IllDepence
IllDepence / util.py
Created August 2, 2020 08:08
Anki 2.1.29 DB change adjustment for anki_add_pitch_plugin
""" Utility functions.
"""
import json
import re
import time
from aqt import mw
from aqt.utils import chooseList
from anki.utils import stripHTML
@IllDepence
IllDepence / kanji_fit.py
Created September 28, 2019 20:38
import numpy as np
from scipy.optimize import curve_fit
from matplotlib import pyplot as plt
# checkpoints
x = np.array([0,1,2])
# delta in days
y = np.array([115,489,1020])
fit_e = curve_fit(lambda t, a, b, c: a+b*np.exp(c*t), x, y)
@IllDepence
IllDepence / draw_pitch.py
Created May 11, 2019 18:40
""" Draw pitch accent patterns in SVG
Example:
python3 draw_pitch.py はな 010 > 花.html
firefox 花.html
"""
import sys
@IllDepence
IllDepence / mag_fos_annot_eval.txt
Created November 23, 2018 21:50
- 8808 citation contexts, 100 words each
- ground truth:
given a document, for all its FoS in PaperFieldsOfStudy.txt
get highest level FoS by FieldsOfStudyChildren.txt
- prediction:
for all annotated FoS
get highest level FoS by FieldsOfStudyChildren.txt
- accuracy:
if the intersection of ground truth and prediction is non empty: 1
otherwise: 0
@IllDepence
IllDepence / 1538950953.md
Created October 7, 2018 22:22
existing software
  • plastex — largish, last commit 1y ago, python
    • in addition to requirements.txt also $ pip install Pillow Unidecode for less noisy output
    • TEST: neat output when it works, but failed on all tested arXiv papers and it's own documentation
  • TexSoup — smallish, recent commits, python
    • doesn't handle definitions (\dev) source
    • stackoverflow question specifically asking about arXiv TeX (by someone using TeXSoup)
    • TEST: works on most tested; fails with e.g. 1607.00138
  • find citations
@IllDepence
IllDepence / jsonkeeper_migration.md
Last active July 9, 2018 09:18

JSONkeeper database migration

old DB schema

CREATE TABLE "JSON_document" (
	id VARCHAR(64) NOT NULL, 
	access_token VARCHAR(255), 
	json_string TEXT, 
	created_at DATETIME DEFAULT CURRENT_TIMESTAMP, 
	updated_at DATETIME,
@IllDepence
IllDepence / jsonkeeper_migrate.py
Created July 7, 2018 06:50
""" Migrate JSON documents from JSONkeeper 2017-12 to the most recent version
"""
import configparser
import firebase_admin
import json
import os
import requests
import sys
from firebase_admin import auth as firebase_auth
@IllDepence
IllDepence / token.html
Created June 27, 2018 03:02
web ui for getting firebase id tokens for testing
<!doctype html>
<html>
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<script src="https://cdn.firebase.com/libs/firebaseui/2.5.1/firebaseui.js"></script>
<link type="text/css" rel="stylesheet" href="https://cdn.firebase.com/libs/firebaseui/2.5.1/firebaseui.css" />
</head>
<body>
@IllDepence
IllDepence / facets.json
Created May 17, 2018 07:37
{
"facets": [
{
"label": "テーマ",
"value": [
{
"label": "顔貌",
"value": 5835,
"agent": "human"
}
@IllDepence
IllDepence / config.ini
Last active May 16, 2018 04:06
[shared]
db_uri = sqlite:////home/tarek/repos/canvasindexer/canvasindexer/index.db
[crawler]
as_sources = http://localhost/JSONkeeper/as/collection.json
[api]
facet_label_sort_top = テーマ,性別,向き,制作年,所蔵,原典,原典ID
facet_label_sort_bottom = tag
facet_value_sort_frequency = テーマ,性別,身分,向き,所蔵,原典
facet_value_sort_alphanum = 制作年,原典ID
[facet_value_sort_custom_1]