Skip to content

Instantly share code, notes, and snippets.

View MrQuartz99's full-sized avatar

Mostafa Essam MrQuartz99

View GitHub Profile
@MrQuartz99
MrQuartz99 / poc.py
Created May 8, 2026 15:54
Sub quadratic LLM
import torch
import torch.nn as nn
import torch.nn.functional as F
import random
# -------------------------
# 1. Tiny real-text dataset
# -------------------------