This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
You will need the following two files, be sure to change the IP address in both sections, the `hostfile_contents` | |
as well as the ansible inventory section to reflect your configuration | |
Rest of the steps should run parallely across the different machines, for any updates to this script, | |
check this thread: https://github.com/ggerganov/llama.cpp/issues/2164#issuecomment-1639640846 | |
If you want an automated way to do this in the future and would like an opionated setup procedure, | |
check this repo: https://github.com/theycallmeloki/edith-cli |