This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
/* | |
Reliability and Flow Control Example | |
From "Networking for Game Programmers" - http://www.gaffer.org/networking-for-game-programmers | |
Author: Glenn Fiedler <gaffer@gaffer.org> | |
*/ | |
#include <iostream> | |
#include <fstream> | |
#include <string> | |
#include <vector> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#pragma once | |
#include "util/types.hpp" | |
#include "util/std.hpp" | |
#include "util/ndarray.hpp" | |
#include "util/collections.hpp" | |
#include "util/rand.hpp" | |
#include "util/hash.hpp" | |
#include "util/assert.hpp" | |
#include "util/bitset.hpp" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
mkfifo /tmp/gfifo | |
./xdp-screen-cast-ffmpeg.py & # or run in another terminal | |
# Note the gstreamer pipeline | |
# 'pipewiresrc fd=%d path=%u ! videorate ! video/x-raw,framerate=60/1 ! videoconvert ! filesink location=/tmp/gfifo' | |
# I specified a 60/1 frameerate. You can do other pre-processing here, or offload it to ffmpeg. | |
# Encode the stream and pipe to netcat | |
# note: must specify correct resolution here | |
# we can now use h264_nvenc, mpegts, and anything else ffmpeg has |
Good question! I am collecting human data on how quantization affects outputs. See here for more information: ggerganov/llama.cpp#5962
In the meantime, use the largest that fully fits in your GPU. If you can comfortably fit Q4_K_S, try using a model with more parameters.
See the wiki upstream: https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix