Skip to content

Instantly share code, notes, and snippets.

View Phylliida's full-sized avatar

Phylliida Dev Phylliida

View GitHub Profile
@Phylliida
Phylliida / automataAnalysis.ipynb
Last active November 13, 2020 22:56
Analysis of 1 layer 1 head transformers learning the 12 2-state and 2 1-state DFAs
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Phylliida
Phylliida / ngram Feedback Modeling.ipynb
Last active February 16, 2021 18:06
NGram Feedback Modeling Notebook
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Phylliida
Phylliida / cryptoTaxCompute.py
Last active May 7, 2021 21:31
Simple FIFO Tax Compute for Coinbase History
from os import walk
import os
import json
import pandas as pd
from decimal import Decimal
MAX_DATE = "2022-01-01 00:00:00+0000"
def formatAsDollars(x):
return '${:,.2f}'.format(x)
@Phylliida
Phylliida / noise.py
Created February 20, 2024 23:50
Noising mamba
from einops import rearrange
import torch
from functools import partial
from jaxtyping import Float
from transformer_lens.hook_points import HookPoint
import tqdm
import pandas as pd
import plotly.express as px
from mamba_lens import HookedMamba
from test_data import greater_than_data_generator, IOI_generator, ABC_TEMPLATES, BAC_TEMPLATES, BABA_TEMPLATES, BABA_LONG_TEMPLATES, BABA_LATE_IOS, BABA_EARLY_IOS