gengwg@gengwg-mbp:~$ git clone https://github.com/ggerganov/llama.cpp.git
Cloning into 'llama.cpp'...
remote: Enumerating objects: 5267, done.
remote: Counting objects: 100% (2065/2065), done.
remote: Compressing objects: 100% (320/320), done.
remote: Total 5267 (delta 1878), reused 1870 (delta 1745), pack-reused 3202
Receiving objects: 100% (5267/5267), 4.24 MiB | 13.48 MiB/s, done.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
{ | |
"model_type": "mlm", | |
"tamm_id": "afm-text-30b-instruct-v5-astc-6x6-20240709", | |
"checkpoint": "model.mlm", | |
"tokenizer": "afm-text-instruct-multilingual-100k-20240701", | |
"original_checkpoint": "bolttorchmodel://x5bhyxgsn7/440", | |
"export_date": "07/22/2024-11:36:33", | |
"mlm_config": { | |
"model_name": "ajax", | |
"backend": "metal", |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from typing import Optional, Any | |
import torch | |
from transformers.utils import is_accelerate_available, is_bitsandbytes_available | |
from transformers import ( | |
AutoTokenizer, | |
AutoModelForCausalLM, | |
GenerationConfig, | |
pipeline, |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Clone llama.cpp | |
git clone https://github.com/ggerganov/llama.cpp.git | |
cd llama.cpp | |
# Build it | |
LLAMA_METAL=1 make | |
# Download model | |
export MODEL=llama-2-13b-chat.ggmlv3.q4_0.bin | |
wget "https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML/resolve/main/${MODEL}" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
##################################### | |
# | |
# php:7.4-apache setup | |
# | |
##################################### | |
FROM php:7.4-apache | |
USER root | |
WORKDIR /var/www/html |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1561572401,horse-uat,Ubuntu,16,16.04,xenial | |
1561572405,moose-uat,Ubuntu,16,16.04,xenial | |
1561572408,duck-uat,Ubuntu,16,16.04,xenial | |
1561572413,goat-uat,Ubuntu,16,16.04,xenial | |
1561572415,horse-dev,Ubuntu,16,16.04,xenial | |
1561571759,moose-dev,Amazon,2016,NA,NA | |
1561572422,duck-dev,Ubuntu,16,16.04,xenial | |
1561572426,goat-dev,Ubuntu,14,14.04,trusty |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
--- | |
# Name: ansible-aws-inventory-main.yml | |
# Description: this is the main file that calls the worker file (ansible-aws-inventory-worker.yml) to create an inventory of all the | |
# specific aws resources. | |
# Below are the resources that will be inventoried | |
# - vpc | |
# - subnet | |
# - igw | |
# - cgw | |
# - vgw |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
To check whether it is installed, run ansible-galaxy collection list. | |
To install it, use: ansible-galaxy collection install purestorage.flasharray. | |
To use it in a playbook, specify: purestorage.flasharray.purefa_volume. | |
name: Create new volume named foo with a QoS limit | |
purefa_volume: | |
name: foo |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
set -euo | |
TEMPLATE=$1 | |
yttFolder="ckd-capsule-app/" | |
helmFolder="capsule" | |
pushd $yttFolder |
NewerOlder