Fadamiro Catherine katiie
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import * as routes from "./routes"; | |
| const app: express.Application = express(); |
katiie
/ run_model_locally.py
Last active
July 4, 2024 22:54
Running Model locally with any model available on HuggingFace
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from transformers import pipeline | |
| modelname = ( | |
| input("Enter model name: ") or "TinyLlama/TinyLlama-1.1B-Chat-v1.0") | |
| print(f"Using model: {modelname}") | |
| model_name = "TinyLlama/TinyLlama-1.1B-Chat-v1.0" | |
| pipe = pipeline("text-generation", model=model_name) |