Skip to content

Instantly share code, notes, and snippets.

@PaperHS
PaperHS / llama-7b-m1.md
Created June 7, 2023 03:32 — forked from cedrickchee/llama-7b-m1.md
4 Steps in Running LLaMA-7B on a M1 MacBook with `llama.cpp`

4 Steps in Running LLaMA-7B on a M1 MacBook

The large language models usability

The problem with large language models is that you can’t run these locally on your laptop. Thanks to Georgi Gerganov and his llama.cpp project, it is now possible to run Meta’s LLaMA on a single computer without a dedicated GPU.

Running LLaMA

There are multiple steps involved in running LLaMA locally on a M1 Mac after downloading the model weights.

{
"chains": ["zinc-2019-05-17", "argon", "bromine", "titanium"]
}
{
"appPk":"zs3ivFi2NPXNasLTR89nfwo3R6tMS69zEFksNjx2dA4u",
"authInfo":"eyJhbGciOiJFRDI1NTE5IiwidHlwIjoiSldUIn0.eyAiYXBwSW5mbyI6IHsgImRlc2NyaXB0aW9uIjogInBhcGVyIHRlc3QiLCAiaWNvbiI6ICJodHRwOi8vMTAuMTEzLjEwLjE2Njo4ODA3L2ltYWdlcy9sb2dvQDJ4LnBuZyIsICJuYW1lIjogIuaXoOiJr-WluOWVhiIsICJzdWJ0aXRsZSI6IG51bGwgfSwgImNoYWluSW5mbyI6IHsgImNoYWluSG9zdCI6ICIgaHR0cDovLzEwLjE2NS4xMTAuMTM6ODIxMC9hcGkvIiwgImNoYWluSWQiOiAiZm9yZ2UiLCAiY2hhaW5Ub2tlbiI6ICJBQlQiLCAiY2hhaW5WZXJzaW9uIjogIjAuMzIuMiIsICJkZWNpbWFscyI6IDE4fSwgInJlcXVlc3RlZENsYWltcyI6IFsgeyAidHlwZSI6ICJzd2FwIiwgIm1ldGEiOiB7ICJkZXNjcmlwdGlvbiI6ICJZb3UgYXJlIG1ha2luZyBhIHN3YXAgdHJhZGUuIiB9LCAib2ZmZXJBc3NldHMiOiBbInpqZGZQTUVyVVYxUXUyanBZcExOYTJ6Y3JER3pxcGJ6UThjUSJdLCAib2ZmZXJDaGFpbiI6Imh0dHBzOi8vdGVzdC5hYnRuZXR3b3JrLmlvL2FwaSIsICJkZW1hbmRUb2tlbiI6IDMsICJkZW1hbmRDaGFpbiI6Imh0dHBzOi8vemluYy5hYnRuZXR3b3JrLmlvL2FwaSIsICJzd2FwX2FkZHIiOiIiIH0gXSwgInVybCI6ICJodHRwOi8vMjExLjE1OS4xNTUuNjY6ODAwMC8iLCAid29ya2Zsb3ciOiB7ICJkZXNjcmlwdGlvbiI6ICJzd2FwIiB9LCJleHAiOiAiMTU3MjgxMjk4MiIsICJpYXQiOiAiMT

Keybase proof

I hereby claim:

  • I am paperhs on github.
  • I am paperhs (https://keybase.io/paperhs) on keybase.
  • I have a public key ASCIfhNll9XMON4DdvGRr74B_E_S5u_8N-5I9YPJpqtM9Qo

To claim this, I am signing this object:

@PaperHS
PaperHS / Dockerfile
Created January 9, 2019 02:40 — forked from teamon/Dockerfile
elixir + phoenix + node dockerfile
########################################
# 1. Build nodejs frontend
########################################
FROM node:10.9-alpine as build-node
# prepare build dir
RUN mkdir -p /app/assets
WORKDIR /app
# set build ENV
@PaperHS
PaperHS / millon_money.py
Created August 29, 2018 12:50
百万游戏
#!/usr/bin/python
import random
'''排除一些牌后 在剩下的牌中随机产生'''
def randomExcept(tn,cn):
allnums = [0,1,2,3]
allnums.remove(tn)
if(cn != tn):
@PaperHS
PaperHS / PageScrollHelper
Created April 25, 2017 10:34
PageScrollHelper
/**
* 实现RecycleView分页滚动的工具类
* Created by zhuguohui on 2016/11/10.
*/
public class PagingScrollHelper {
RecyclerView mRecyclerView = null;
private MyOnScrollListener mOnScrollListener = new MyOnScrollListener();
@PaperHS
PaperHS / 判断是否有虚拟按键
Created September 9, 2015 06:26
判断是否有虚拟按键
@TargetApi(Build.VERSION_CODES.ICE_CREAM_SANDWICH)
private boolean hasNavBar(Context context) {
Resources res = context.getResources();
int resourceId = res.getIdentifier("config_showNavigationBar",
"bool","android");
if (resourceId != 0) {
boolean hasNav = res.getBoolean(resourceId);
String sNavBarOverride = null;
if (Build.VERSION.SDK_INT >= Build.VERSION_CODES.KITKAT) {
try {
@PaperHS
PaperHS / gist:8a994f4b706f40f237cb
Created November 22, 2014 03:32
onCreate中获取View属性
ViewTreeObserver vto = mScrollView.getViewTreeObserver();
vto.addOnGlobalLayoutListener(new ViewTreeObserver.OnGlobalLayoutListener() {
@Override
public void onGlobalLayout() {
if (Build.VERSION.SDK_INT < Build.VERSION_CODES.JELLY_BEAN) {
mScrollView.getViewTreeObserver().removeGlobalOnLayoutListener(this);
} else {
mScrollView.getViewTreeObserver().removeOnGlobalLayoutListener(this);
mScrollView.scrollTo(0, 400);
#Tue Jun 24 17:44:39 GMT+08:00 2014