Skip to content

Instantly share code, notes, and snippets.

View nctiggy's full-sized avatar
💫

Craig J Smith nctiggy

💫
  • E.verything M.ust C.hange
  • Lake Tapps, WA
View GitHub Profile
4 ounces frozen strawberries
½ cup white sugar
½ cup lemon juice
⅛ cup lime juice
¾ cup rum
¼ cup lemon-lime flavored carbonated beverage
6 cups ice, or as needed
½ fresh pineapple, peeled, cut into 1½" pieces
6 oz. sweetened cream of coconut (preferably Coco López; well shaken before measuring)
83fqt}>,c{B9W823$H;YK[sX467%F.G7a/x
root@cnvrg-job-notebooksession-cx4mdtm3m6bwfbvaesss-1-5b9dbf979pzxs5:/intel-extension-for-transformers/optimum-habana/examples# python3 gaudi_spawn.py --world_size 2 --use_deepspeed language-modeling/run_lora_clm.py --model_name_or_path meta-llama/Llama-2-7b-hf --dataset_name tatsu-lab/alpaca --bf16 True --output_dir ./model_peft_output --num_train_epochs 1 --per_device_train_batch_size 2 --per_device_eval_batch_size 2 --gradient_accumulation_steps 4 --evaluation_strategy no --save_strategy steps --save_steps 2000 --save_total_limit 1 --learning_rate 1e-4 --logging_steps 1 --dataset_concatenation --do_train --use_habana --distribution_strategy fast_ddp --use_lazy_mode --throughput_warmup_steps 3
[WARNING|utils.py:185] 2024-04-02 16:22:51,269 >> optimum-habana v1.9.0.dev0 has been validated for SynapseAI v1.12.0 but habana-frameworks v1.14.0.493 was found, this could lead to undefined behavior!
[WARNING|utils.py:198] 2024-04-02 16:22:51,671 >> optimum
https://app.cnvrg-prd.pg.wwtatc.ai/users/sign_up?email=craig.smith%40cnvrg.io&invite_code=pPzxpptz5hJefL5Rxn9M
HF_TOKEN="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" python3 gaudi_spawn.py --world_size 8 --use_deepspeed language-modeling/run_lora_clm.py \
--model_name_or_path meta-llama/Llama-2-7b-hf \
--dataset_name tatsu-lab/alpaca \
--bf16 True \
--output_dir ./model_peft_output \
--num_train_epochs 1 \
--per_device_train_batch_size 2 \
--per_device_eval_batch_size 2 \
@nctiggy
nctiggy / gist:e58a20aa9bd65fce934fb5d530fc54b6
Last active February 1, 2024 07:57
generic_writeup.md

https://github.com/nctiggy/cnvrg_endpoint_binary

Problem statement

Customers love the flexibility and power that Kubernetes gives cnvrg. While strongly opinionated containerization enables customers to get started quickly and with minimal pre-reqs, it does limit the scope in which the platform can be used. As the AI/ML space continues to rapidly evolve, customers needs are shifting as well. Customers want to try new languages to serve their models, they want to bring new/obscure UI's to their data and models, in some cases they just want to run long running processes that are neither apps, or endpoints. In a larger platform, cnvrg is well positioned to be the work horse right in the heart of a larger system. Enabling generic containers to execute in cnvrg will help in opening new opportunities

@nctiggy
nctiggy / printer.cfg
Created December 6, 2021 18:10
klipper config
# This file contains common pin mappings for the BIGTREETECH SKR
# MINI 2.0. To use this config, the firmware should be compiled for
# the STM32F103 with a "28KiB bootloader". Also select "enable extra
# low-level configuration options" and configure "GPIO pins to set
# at micro-controller startup" to "!PA14".
# The "make flash" command does not work on the SKR mini. Instead,
# after running "make", copy the generated "out/klipper.bin" file to a
# file named "firmware.bin" on an SD card and then restart the SKR
# mini with that SD card.
@nctiggy
nctiggy / gist:6bcff00a871b3119234a3496d9a96e52
Last active October 22, 2020 15:05
setup k8s w/containerd
yum install -y nfs-utils
systemctl enable rpcbind
systemctl start rpcbind
systemctl stop lia
systemctl disable lia
cat <<EOF | sudo tee /etc/modules-load.d/containerd.conf
overlay
br_netfilter
EOF
sudo modprobe overlay
@nctiggy
nctiggy / keepalived
Last active October 19, 2020 18:03
slave2
! /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
router_id LVS_DEVEL
}
vrrp_script check_apiserver {
script "/etc/keepalived/check_apiserver.sh"
interval 3
weight -2
fall 10
@nctiggy
nctiggy / keepalived.conf
Last active October 19, 2020 18:03
Slave1
! /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
router_id LVS_DEVEL
}
vrrp_script check_apiserver {
script "/etc/keepalived/check_apiserver.sh"
interval 3
weight -2
fall 10
@nctiggy
nctiggy / keepalived.conf
Created October 19, 2020 17:24
Master Node
! /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
router_id LVS_DEVEL
}
vrrp_script check_apiserver {
script "/etc/keepalived/check_apiserver.sh"
interval 3
weight -2
fall 10