Skip to content

Instantly share code, notes, and snippets.

View jphme's full-sized avatar

Jan Philipp Harries jphme

32 followers · 16 following
View GitHub Profile
@jphme
jphme / test_embeddings_split.ipynb
Last active January 13, 2024 00:53
Proof of Concept Split by Embeddings
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@jphme
jphme / phi15_test_wizzard_vicuna.yml
Last active September 12, 2023 13:33
Phi 1.5 multi-gpu config (Axolotl)
#only changed self.vocab_size = vocab_size in configuration_mixformer_sequential.py, as suggested by @NanoBit
base_model: /workspace/models/phi-1_5
base_model_config: /workspace/models/phi-1_5
trust_remote_code: true
base_model_ignore_patterns:
model_type: AutoModelForCausalLM
tokenizer_type: AutoTokenizer
is_llama_derived_model: false
load_in_8bit: false
@jphme
jphme / testprompts.json
Created August 1, 2023 09:30
Test Prompts German
{
"gehaltserh\u00f6hung": "Bitte schreibe einen Brief an meinen Chef und erkl\u00e4re ihm, warum ich eine Gehalterh\u00f6hung verdient habe.",
"bundeskanzler": "Wenn du 2024 als Bundeskanzler kandidieren w\u00fcrdest, was w\u00e4re dein Programm?",
"hauptstadt_nrw": "Was ist die Hauptstadt von Nordrhein Westfalen?",
"zusammenfassung_gesetz": "Bitte fasse kurz f\u00fcr Laien zusammen, worum es in folgendem Ausschnitt aus einem Gesetz geht:\n \nGesetz \u00fcber den Versicherungsvertrag (Versicherungsvertragsgesetz - VVG)\n\u00a7 1a Vertriebst\u00e4tigkeit des Versicherers\n(1) Der Versicherer muss bei seiner Vertriebst\u00e4tigkeit gegen\u00fcber Versicherungsnehmern stets ehrlich, redlich und professionell in deren bestm\u00f6glichem Interesse handeln. Zur Vertriebst\u00e4tigkeit geh\u00f6ren\n\n1.\n Beratung,\n2.\n Vorbereitung von Versicherungsvertr\u00e4gen einschlie\u00dflich Vertragsvorschl\u00e4gen,\n3.\n Abschluss von Versicherungsvertr\u00e4gen,\n4.\n Mitwirken
@jphme
jphme / haushalt_ddorf_2023.csv
Created July 26, 2023 20:29
Haushaltsplan Düsseldorf 2023
We can't make this file beautiful and searchable because it's too large.
Haushaltsposition ,2020,2021,2022,2023,2024,2025,2026,2027,Abteilung
Steuern und ähnliche Abgaben,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Zuwendungen und allgemeine Umlagen,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Sonstige Transfererträge,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Öffentlich-rechtliche Leistungsentgelte,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Privatrechtliche Leistungsentgelte,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Kostenerstattungen und Kostenumlagen,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Sonstige ordentliche Erträge,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Aktivierte Eigenleistungen,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
Bestandsveränderungen (+/-),0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,Amtsinterne Querschnittsaufgaben Amt 10
@jphme
jphme / gist:b4b765eab54f5398d375ba2c810622da
Created July 26, 2023 09:23
Finetuning Settings Llama2 Chat 13B German
val_set_size: 0.03
adapter: qlora
lora_model_dir:
sequence_len: 4096
max_packed_sequence_len: 4096
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
lora_target_modules:
lora_target_linear: true
@jphme
jphme / model_config.json
Created July 24, 2023 23:11
LM Studio Llama 2 Chat Multilingual Configuration
{
"name": "Llama 2 German partial multilang Config",
"inference_params": {
"top_k": 40,
"top_p": 0.95,
"temp": 0.5,
"repeat_penalty": 1.2,
"input_prefix": "[INST]",
"input_suffix": "[/INST]",
@jphme
jphme / keybase.md
Created July 17, 2015 16:27

Keybase proof

I hereby claim:

  • I am jpdus on github.
  • I am jp1 (https://keybase.io/jp1) on keybase.
  • I have a public key whose fingerprint is 8A44 FB5E 1B45 DB11 7C7C ABD2 FC1E 49B4 76E1 EC77

To claim this, I am signing this object: