Skip to content

Instantly share code, notes, and snippets.

@krzkz94
krzkz94 / train.py
Created February 6, 2025 21:31 — forked from ddh0/train.py
Janky pretraining script for small llama models using HF fineweb - modify according to your needs
import os
import torch
import psutil
import datasets
import glob
from transformers import (
AutoTokenizer, LlamaConfig, LlamaForCausalLM, Trainer, TrainingArguments,
DataCollatorForLanguageModeling
)
[
{
"leagueId": 61,
"leagueName": "Ligue 1",
"country": "France",
"fixtureId": 1213935,
"id": "Nice - Lens - 08/02/25 - 18:00",
"homeTeam": "Nice",
"homeLogo": "https://media.api-sports.io/football/teams/84.png",
"awayTeam": "Lens",
@hanxiao
hanxiao / project_config.json
Created February 6, 2025 21:31
Projector Meta Files
{"embeddings":[{"tensorName":"jina-clip-v2","tensorShape":[571,1024],"tensorPath":"https://gist.githubusercontent.com/hanxiao/7d8d7be99fe083e4c256f2fbc5ff08b9/raw/d2a302200d16fdb2e3ec938f0e04d32f7702f7da/tensor.tsv","metadataPath":"https://gist.githubusercontent.com/hanxiao/7d8d7be99fe083e4c256f2fbc5ff08b9/raw/1ad2ca8f8f883c645b28d5c6f01dfcfa0030695f/metadata.tsv"}]}
@hanxiao
hanxiao / metadata.tsv
Created February 6, 2025 21:31
Projector Data Files
We can make this file beautiful and searchable if this error is corrected: No tabs found in this TSV file in line 0.
# API:Hauptseite
```
Diese Seite ist Teil der Dokumentation der MediaWiki action API.
```
Diese Seite bietet einen Überblick der MediaWiki **Action API** , die durch den Endpunkt api.php repräsentiert wird.
Diese Seite ist für technische Mitwirkende und Softwareentwickler gedacht, die die MediaWiki Action API verstehen
und verwenden wollen.
Hole dir den Inhalt eines Artikels auf der englischen Wikipedia in HTML:
**api.php? action=parse&page=Pet_door &format=json (https://en.wikipedia.org/w/api.php?action=parse&p
age=Pet_door&format=json)** [In der ApiSandbox ausprobieren] (https://en.wikipedia.org/wiki/Special:ApiSandbox#ac
/*
‎Duet Display 2.18
DuetAir 1.2.12
数据拷贝于YU9191
需登录
[rewrite_local]
<?xml version="1.0" encoding="UTF-8"?>
<?mso-application progid="Excel.Sheet"?>
<Workbook xmlns="urn:schemas-microsoft-com:office:spreadsheet"
xmlns:o="urn:schemas-microsoft-com:office:office"
xmlns:x="urn:schemas-microsoft-com:office:excel"
xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet"
xmlns:html="http://www.w3.org/TR/REC-html40">
<Worksheet ss:Name="Financial Analysis">
<Table>
<Row>
@HugsLibRecordKeeper
HugsLibRecordKeeper / output_log.txt
Created February 6, 2025 21:29
Rimworld output log published using HugsLib
Log uploaded on Thursday, February 6, 2025, 10:29:41 PM
Loaded mods:
Harmony(brrainz.harmony)[mv:2.3.1.0]: 0Harmony(2.3.3), HarmonyMod(2.3.1)
Core(Ludeon.RimWorld): (no assemblies)
[FSF] Filth Vanishes With Rain And Time(FrozenSnowFox.FilthVanishesWithRainAndTime): (no assemblies)
Multiplayer(rwmt.Multiplayer): 0MultiplayerAPI(av:0.5.0,fv:0.5.0), 0PrepatcherAPI(1.2.0), LiteNetLib(1.0.0), MultiplayerLoader(1.0.0), RestSharp(av:106.12.0,fv:106.12.0), System.IO.Compression(av:4.1.2,fv:4.6.24705.1), Multiplayer(0.10.5 [no FileVersionInfo]), MultiplayerCommon(1.0.0 [no FileVersionInfo])
HugsLib(UnlimitedHugs.HugsLib)[ov:11.0.4]: 0Harmony(av:2.3.3,fv:1.2.0.1), HugsLib(av:1.0.0,fv:11.0.4)
Allow Tool(UnlimitedHugs.AllowTool): AllowTool(av:3.6.0,fv:3.13.1)
Camera+(brrainz.cameraplus)[mv:3.2.0.0]: CameraPlus(3.2.0), CrossPromotion(1.1.2)
Categorized Bill Dropdown(FluffyKittens.BillCategories): BillCategories(1.4.0)
@Alistair1231
Alistair1231 / Dockerfile
Last active February 6, 2025 22:46
arch linux distrobox with systemd
FROM archlinux:latest
ARG USER
# make sure pacman works, also install basic packages: sudo, dbus, systemd
RUN curl -s "https://archlinux.org/mirrorlist/?country=DE&country=AT&country=CH&protocol=https&use_mirror_status=on&sort=rate" | sed -e 's/^#Server/Server/' -e '/^#/d' | tee /etc/pacman.d/mirrorlist && \
curl -L https://pkgbuild.com/~morganamilo/pacman-static/x86_64/bin/pacman-static -o /tmp/pacman-static && chmod +x /tmp/pacman-static && pacman-key --init && pacman-key --populate archlinux && \
/tmp/pacman-static -Sy archlinux-keyring pacman-contrib sudo dbus systemd --noconfirm && \
curl -s "https://archlinux.org/mirrorlist/?country=DE&country=AT&country=CH&protocol=https&use_mirror_status=on" | sed -e 's/^#Server/Server/' -e '/^#/d' | rankmirrors -n 5 - | tee /etc/pacman.d/mirrorlist && \
pacman -Syu --noconfirm
@DolphinOfficial
DolphinOfficial / PostShutdownFullLog.txt
Created February 6, 2025 21:29
Text file created by Roblox
-- AH POST-SERVER LOGS --
-- ServerID: b602b8aa-1be1-42a9-815f-5908d879e9d5
-- Server started: February 06, 2025 08:18 PM UTC | Server uptime: 3946 seconds
------------------ LOADB LOGS ------------------
{
}