eruo005-dev
eruo005-dev
/ turkish-llama-8b-instruct-v01-Q4_K_M-turkishmmlu.tmp.log
Created
May 28, 2026 19:33
runlocalai_turkish-llama-8b-instruct-v01-Q4_K_M-turkishmmlu
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| === runlocalai TurkishMMLU run (generative) === | |
| model: turkish-llama-8b-instruct-v01 (Turkish Llama 8B Instruct v0.1) | |
| quant: Q4_K_M | |
| runtime: ollama-0.24 | |
| hardware: rtx-3080-16gb-mobile | |
| task: turkishmmlu-generative | |
| n_fewshot: 5 | |
| started: 2026-05-28T18:52:34.246Z | |
| finished: 2026-05-28T19:33:54.532Z | |
| wall: 41.3 min |
eruo005-dev
/ mbpp-full.combined.log
Created
May 27, 2026 23:52
runlocalai_evalplus_trendyol_asure_12b_mbpp_plus
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ��D o w n l o a d i n g d a t a s e t f r o m h t t p s : / / g i t h u b . c o m / e v a l p l u s / m b p p p l u s _ r e l e a s e / r e l e a s e s / d o w n l o a d / v 0 . 2 . 0 / M b p p P l u s . j s o n l . g z | |
| D a t a s e t : m b p p | t a s k s : 3 7 8 | r e s u m e : 0 d o n e | |
| S a m p l e s : . h u m a n e v a l - r u n s \ t r e n d y o l - l l m - a s u r e - 1 2 b - Q 4 _ K _ M - m b p p - 1 7 7 9 9 1 8 7 3 6 9 7 6 . j s o n l | |
| R a w : . h u m a n e v a l - r u n s \ t r e n d y o l - l l m - a s u r e - 1 2 b - Q 4 _ K _ M - m b p p - 1 7 7 9 9 1 8 7 3 6 9 7 6 . r a w . j s o n l | |
| [ 1 / 3 7 8 ] g e n e r a t e M b p p / 2 | |
| w r o t e 7 6 c h a r s i n 8 . 9 s | E T A 5 6 . 1 m i n | |
| [ 2 / 3 7 8 ] g e n e r a t e M b p p / 3 | |
| w r o t e 3 3 8 c h a r s i n 4 . 6 s | E T A 4 2 . 5 m i n | |
| [ 3 / 3 7 8 ] g e n e r a t e M b p p / 4 | |
| w r o t e 4 2 9 c h a r |
eruo005-dev
/ trendyol-asure-12b-q4km-ctx8192-run1.log
Created
May 27, 2026 23:25
runlocalai_speed_trendyol_asure_12b_q4km_ctx8192
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| total duration: 11.04s | |
| load duration: 6453.047ms | |
| prompt eval count: 47 token(s) | |
| prompt eval duration: 57.103ms | |
| prompt eval rate: 823.07 tokens/s | |
| eval count: 256 token(s) | |
| eval duration: 4.157s | |
| eval rate: 61.58 tokens/s | |
| prompt: |
eruo005-dev
/ humaneval-full.combined.log
Created
May 27, 2026 23:23
runlocalai_evalplus_trendyol_asure_12b_humaneval_plus
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| �� | |
| = = = H u m a n E v a l + r u n = = = | |
| m o d e l : T r e n d y o l L L M A s u r e 1 2 B ( s l u g : t r e n d y o l - l l m - a s u r e - 1 2 b ) | |
| q u a n t : Q 4 _ K _ M | |
| r u n t i m e : o l l a m a - 0 . 2 4 . 0 | |
| h a r d w a r e : r t x - 5 0 8 0 | |
| e n d p o i n t : h t t p : / / l o c a l h o s t : 1 1 4 3 4 / v 1 | |
| d a t a s e t : h u m a n e v a l | |
| m o d e l i d : a l i b a y r a m / T r e n d y o l - L L M - A s u r e - 1 2 B : l a t e s t |
eruo005-dev
/ trendyol-llm-asure-12b-Q4_K_M-turkishmmlu.tmp.log
Created
May 27, 2026 22:15
runlocalai_trendyol-llm-asure-12b-Q4_K_M-turkishmmlu
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| === runlocalai TurkishMMLU run (generative) === | |
| model: trendyol-llm-asure-12b (Trendyol LLM Asure 12B) | |
| quant: Q4_K_M | |
| runtime: ollama-0.24.0 | |
| hardware: rtx-5080 | |
| task: turkishmmlu-generative | |
| n_fewshot: 5 | |
| started: 2026-05-27T19:44:46.536Z | |
| finished: 2026-05-27T20:45:30.675Z | |
| wall: 60.7 min |
eruo005-dev
/ turkish-llama-8b-instruct-v01-Q4_K_M.log
Created
May 26, 2026 15:25
runlocalai_turkish-llama-8b-instruct-v01_Q4_K_M_turkishmmlu
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| === runlocalai TurkishMMLU run (generative) === | |
| model: turkish-llama-8b-instruct-v01 (Turkish Llama 8B Instruct v0.1) | |
| quant: Q4_K_M | |
| runtime: ollama-0.24 | |
| hardware: rtx-3080 | |
| task: turkishmmlu-generative | |
| n_fewshot: 5 | |
| started: 2026-05-26T13:01:40.778Z | |
| finished: 2026-05-26T14:30:34.316Z | |
| wall: 88.9 min |