Skip to content

Instantly share code, notes, and snippets.

View Vivswan's full-sized avatar
☣️
Nothing is True, Everything is Permitted

Vivswan Shah Vivswan

☣️
Nothing is True, Everything is Permitted
View GitHub Profile
@Vivswan
Vivswan / SqliteDeDuplicationDict.py
Last active June 8, 2023 07:51
Sqlite + DeDuplicationDict, low memory nosql on Sqlite (json on Sqlite)
import pickle
import sqlite3
import zlib
from typing import TypeVar, MutableMapping, Iterator
import numpy as np
from deduplicationdict import DeDuplicationDict
from sqlitedict import SqliteDict
KT = TypeVar('KT') # Key type.
@Vivswan
Vivswan / gpu_operation_benchmark.py
Created May 7, 2023 10:05
Benchmark GPU Operations
from timeit import default_timer as timer
import numpy as np
import torch
import torch.nn as nn
import torch.utils.benchmark as benchmark
from torch.profiler import profile, ProfilerActivity
@torch.no_grad()