Skip to content

Instantly share code, notes, and snippets.

View wenitte's full-sized avatar

Wenitte wenitte

View GitHub Profile
@wenitte
wenitte / convert_archive.py
Created November 17, 2024 20:27 — forked from deepfates/convert_archive.py
Convert your twitter archive into a training dataset and markdown files
import argparse
import json
import logging
import os
import re
import shutil
from concurrent.futures import ProcessPoolExecutor, as_completed
from dataclasses import dataclass
from datetime import datetime
from typing import Any, Callable, Dict, List, Literal, Optional, Tuple