The problem with large language models is that you can’t run these locally on your laptop. Thanks to Georgi Gerganov and his llama.cpp project, it is now possible to run Meta’s LLaMA on a single computer without a dedicated GPU.
There are multiple steps involved in running LLaMA locally on a M1 Mac after downloading the model weights.
| 2.hours.ago # => Fri, 02 Mar 2012 20:04:47 JST +09:00 | |
| 1.day.from_now # => Fri, 03 Mar 2012 22:04:47 JST +09:00 | |
| Date.today.to_time_in_current_zone # => Fri, 02 Mar 2012 22:04:47 JST +09:00 | |
| Date.current # => Fri, 02 Mar | |
| Time.zone.parse("2012-03-02 16:05:37") # => Fri, 02 Mar 2012 16:05:37 JST +09:00 | |
| Time.zone.now # => Fri, 02 Mar 2012 22:04:47 JST +09:00 | |
| Time.current # Same thing but shorter. (Thank you Lukas Sarnacki pointing this out.) | |
| Time.zone.today # If you really can't have a Time or DateTime for some reason | |
| Time.zone.now.utc.iso8601 # When supliyng an API (you can actually skip .zone here, but I find it better to always use it, than miss it when it's needed) | |
| Time.strptime(time_string, '%Y-%m-%dT%H:%M:%S%z').in_time_zone(Time.zone) # If you can't use Time#parse |
| require 'bundler/setup' | |
| require 'active_record' | |
| include ActiveRecord::Tasks | |
| db_dir = File.expand_path('../db', __FILE__) | |
| config_dir = File.expand_path('../config', __FILE__) | |
| DatabaseTasks.env = ENV['ENV'] || 'development' |
| #!/usr/bin/ruby | |
| require 'rubygems' | |
| require 'active_support/all' | |
| require 'digest/sha1' | |
| def leftrotate(value, shift) | |
| return ( ((value << shift) | (value >> (32 - shift))) & 0xffffffff) | |
| end | |
| # FIPS 180-2 -- relevant section #'s below |
Because loading gems can take longer than you think
$ curl -fsSL https://gist.github.com/jherdman/5025684/raw/a3ccd4b5308723245706b4ae315845fe951b4473/benchmark.rb | ruby
............................................................[DONE]
Gem Time(sec) Pct %
--------------------------------------------------
| # example | |
| # date = Date.today | |
| # ExchangeWithFallback.new( | |
| # SynchronizedRates.new( | |
| # DoubleConvertThrough.new('RUB', | |
| # InverseRatesFor.new( {from: 'RUB'}, | |
| # RatesUpdatedWithFallback.new( | |
| # ActiveRecordRates.new(CurrencyRate.where(date: date, bank: 'cbr')), | |
| # LazyRates.new { CentralBankOfRussia.new.update_rates(date) } ))))) |
| #################################### | |
| # BASIC REQUIREMENTS | |
| # http://graphite.wikidot.com/installation | |
| # http://geek.michaelgrace.org/2011/09/how-to-install-graphite-on-ubuntu/ | |
| # Last tested & updated 10/13/2011 | |
| #################################### | |
| cd | |
| sudo apt-get update | |
| sudo apt-get upgrade |
| (The MIT License) | |
| Copyright (c) 2011 Tan Shiaw Uen <shiawuen@gmail.com> | |
| Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the 'Software'), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: | |
| The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. | |
| THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CO |
This installs a patched ruby 1.9.3-p327 with various performance improvements and a backported COW-friendly GC, all courtesy of funny-falcon.
You will also need a C Compiler. If you're on Linux, you probably already have one or know how to install one. On OS X, you should install XCode, and brew install autoconf using homebrew.
