Skip to content

Instantly share code, notes, and snippets.

View techwithanirudh's full-sized avatar
😀
I'm creating a few projects right now

Anirudh techwithanirudh

😀
I'm creating a few projects right now
View GitHub Profile
@techwithanirudh
techwithanirudh / hftg_demo_guanaco-33b-merged_qlora.py
Created June 23, 2023 07:59 — forked from xsa-dev/hftg_demo_guanaco-33b-merged_qlora.py
This quanaco model for LangChain integration. Subscribe me back =)
import os
import dotenv
from langchain import HuggingFaceTextGenInference
dotenv.load_dotenv()
os.environ[
"HUGGINGFACEHUB_API_TOKEN"
] = os.getenv("HF_API_TOKEN")