tristandruyen

{
  "chart": {
    "type": "area",
    "panning": false,
    "spacingTop": 0,
    "spacingRight": 20,
    "spacingBottom": 20,
    "height": 250
  },
  "title": {

tristandruyen

Keybase proof

I hereby claim:

• I am tristandruyen on github.
• I am tristandruyen (https://keybase.io/tristandruyen) on keybase.
• I have a public key ASBUFddtECkJRKy_6v_GiY1vgEcLrTgccqrAYZ_KKmWimQo

To claim this, I am signing this object:

tristandruyen

#!/usr/bin/env fish

# Invoke like './autoquant-hf-bf16.fish meta-llama/Meta-Llama-3-8B-Instruct'

# TODOS:
# TODO Just a rough outline of automatic script atm, mostly example commands, no real automation done, needs params etc
# TODO Create hf repo automatically using CLI
# TODO Select good quant types
# TODO Decide repo name template (IQ-Imatrix, iMat.GGUF and more seem to be in use)
# TODO Parallelize upload while still quanting