Skip to content

Instantly share code, notes, and snippets.

View alex4o's full-sized avatar

Alexander Bonin alex4o

View GitHub Profile
vw = 100
vl = 0
vm = 100
vls = 100
ratio = 1
step = 0.00001
while vls > 0:
if vw == 0:
break
vw = vw - (vw/100) * step
> ./main -m ../phi-2-orange.Q4_K_M.gguf -ngl 33 -i -cml
Log start
main: build = 22 (277fad3)
main: built with clang version 17.0.6 for aarch64-unknown-linux-android24
main: seed = 1707123971
ggml_vulkan: Using Mali-G78 | uma: 1 | fp16: 1 | warp size: 16
llama_model_loader: loaded meta data with 21 key-value pairs and 325 tensors from ../phi-2-orange.Q4_K_M.gguf (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv 0: general.architecture str = phi2
llama_model_loader: - kv 1: general.name str = Phi2
@alex4o
alex4o / VulkanPhi2.ipynb
Created February 4, 2024 10:20
Vulkan Phi 2 Android
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Log start
main: build = 22 (277fad3)
main: built with clang version 17.0.6 for aarch64-unknown-linux-android24
main: seed = 1707038499
ggml_vulkan: Using Mali-G78 | uma: 1 | fp16: 1 | warp size: 16
llama_model_loader: loaded meta data with 21 key-value pairs and 325 tensors from ../phi-2-orange.Q4_K_M.gguf (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv 0: general.architecture str = phi2
llama_model_loader: - kv 1: general.name str = Phi2
llama_model_loader: - kv 2: phi2.context_length u32 = 2048
@alex4o
alex4o / llama_cpp_main_vulkan_android_logs.txx
Created February 4, 2024 08:35
llama.cpp pixel6pro vulkan logs
./main -m ../phi-2-orange.Q4_K_M.gguf
Log start
main: build = 22 (277fad3)
main: built with clang version 17.0.6 for aarch64-unknown-linux-android24
main: seed = 1707035493
ggml_vk_init()
ggml_vk_find_queue_family_index()
ggml_vk_find_queue_family_index()
ggml_vulkan: Using Mali-G78 | uma: 1 | fp16: 1 | warp size: 16
@alex4o
alex4o / gist:20f949910574295c22f951f64e1d421d
Created February 4, 2024 08:29
vulkaninfo-pixel-6-pro
~/llama.cpp $ vulkaninfo
'DISPLAY' environment variable not set... skipping surface info
==========
VULKANINFO
==========
Vulkan Instance Version: 1.3.276
Instance Extensions: count = 13
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
import axios from 'axios'
import { writeFileSync } from 'fs';
import { Parser } from 'json2csv'
import _ from "lodash"
let exampleDoc = {
REG_ID: '12427',
SHOPNAME: '-',
OWNER_INFO: 'Наименование: БУУСТ КОМПЮТЪРС<br/>ЕИК: 203316062',
DOMAIN: '-',
#/bin/sh
set -e
CC=${CC:-clang}
for source_file in *.c; do
echo "lib${source_file%.c}.so"
${CC} ${source_file} -fPIC -Wno-parentheses-equality -shared -glldb -lm -o lib${source_file%.c}.so
done
[info] Loading global plugins from /home/alex4o/.sbt/0.13/plugins
[info] Loading project definition from /home/alex4o/Projects/test/scala_native/gobject_introspect_scala/project
[info] Set current project to gobject_introspect_scala (in build file:/home/alex4o/Projects/test/scala_native/gobject_introspect_scala/)
[info] Compiling 1 Scala source to /home/alex4o/Projects/test/scala_native/gobject_introspect_scala/target/scala-2.11/classes...
[info] Linking (2604 ms)
[info] Discovered 2638 classes and 17036 methods
scala.collection.parallel.CompositeThrowable: Multiple exceptions thrown during a parallel computation: scala.scalanative.util.UnsupportedException: can't cast from Class(Top(java.lang.Object)) to Ptr
scala.scalanative.util.package$.unsupported(package.scala:20)
scala.scalanative.optimizer.pass.AsLowering.onInst(AsLowering.scala:15)
scala.scalanative.optimizer.Pass$$anonfun$onInsts$1