Skip to content

Instantly share code, notes, and snippets.

View Phate334's full-sized avatar
🐱

Phate Phate334

🐱
View GitHub Profile
@Phate334
Phate334 / compose.yaml
Last active May 16, 2025 09:22
Mistral 3.1 chat template for llama.cpp, including tools and support for multiple images. modify from vllm https://github.com/vllm-project/vllm/blob/main/examples/tool_chat_template_mistral.jinja
services:
llm:
image: ghcr.io/ggml-org/llama.cpp:server-cuda-b5391
ports:
- "7071:8080"
volumes:
- ./models:/models
env_file:
- llm.env
deploy:
@Phate334
Phate334 / llamacpp-bench.sh
Last active May 13, 2025 03:10
A simple script to bench GGUF base and draft models
#!/bin/bash
set -e
set -u
if [ $# -lt 1 ]; then
echo "Usage: $0 BASE_MODEL [DRAFT_MODEL] [--skip-base] [--skip-draft] [--skip-sd]"
exit 1
fi
BASE_MODEL="$1"
@Phate334
Phate334 / backup-docker-compose.sh
Last active April 23, 2025 01:47
Simple script to backup volumes in docker compose env.
#!/bin/bash
set -euo pipefail
# Function to get Docker API version
get_docker_api_version() {
docker version --format '{{.Server.APIVersion}}'
}
# Function to get volume paths from docker compose and backup
backup_volumes() {
import os
import sys
import uuid
import time
import math
import multiprocessing
from abc import ABC, abstractmethod
from typing import (
List,
Optional,
@Phate334
Phate334 / Translated-Whisper.md
Last active January 22, 2025 17:01
Faster Whisper + Google translate

Install

!pip install faster-whisper
!pip install googletrans==3.1.0a0
!pip install pysubs2
@Phate334
Phate334 / slim-python.omp.json
Created January 31, 2023 08:03
oh-my-posh python style
{
"$schema": "https://raw.githubusercontent.com/JanDeDobbeleer/oh-my-posh/main/themes/schema.json",
"blocks": [
{
"alignment": "left",
"segments": [
{
"background": "#2f2f2f",
"foreground": "#26C6DA",
"leading_diamond": "\ue0c7\u2593",
@Phate334
Phate334 / docker-compose.yml
Last active August 18, 2025 14:48
JanusGraph and OpenSearch
version: "3"
services:
janusgraph:
image: janusgraph/janusgraph:0.6.2
container_name: jce-janusgraph
env_file:
- janusgraph.env
ports:
- "8182:8182"
@Phate334
Phate334 / fb-copy.js
Last active January 30, 2022 10:12
bookmarklet for removing Click identifier
javascript: (() => {
const blocked = new Set(['fbclid', 'utm_source', 'utm_medium', 'utm_campaign', 'ref_src', 'ref_url']);
let url = new URL(document.URL);
let params = new URLSearchParams(url.searchParams);
for (let key of params.keys()) {
if (blocked.has(key)) {
url.searchParams.delete(key);
}
}
let result = `${url.origin}${url.pathname}${url.searchParams.toString() ? '?' + url.searchParams.toString() : ''}${url.hash}`;
@Phate334
Phate334 / youtube-copy.js
Last active January 23, 2022 16:15
bookmarklet
javascript: (() => {
const vid = new URL(document.URL).searchParams.get('v');
navigator.clipboard.writeText("https://youtu.be/" + vid);
})();
@Phate334
Phate334 / parameter.py
Last active December 11, 2020 17:03
pydantic and decorator
from pydantic import BaseModel
def func_helper(parameter_type, return_type=None):
def decorator(function):
def wrapper(*args, **kwargs):
result = function(parameter_type(**kwargs))
return return_type(**result) if return_type else result
return wrapper