Skip to content

Instantly share code, notes, and snippets.

View Barafu's full-sized avatar

Barafu Albino Cheetah Barafu

View GitHub Profile
@Barafu
Barafu / balance.ps1
Last active July 14, 2024 01:56
A Powershell script to find the maximum gpulayer value for a given model.
$min = 1
$max = 100
$exitCode = 0
if ($args.Length -lt 2) {
Write-Host "Usage: .\balance.ps1 <model> <contextSize>"
exit 1
}
$model = $args[0]