Skip to content

Instantly share code, notes, and snippets.

@StarDuster

StarDuster/LMDeploy 的量化和部署 作业.md

Created January 14, 2024 11:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save StarDuster/a80cb2fa2c2b8285349822d7afee35d4 to your computer and use it in GitHub Desktop.
Save StarDuster/a80cb2fa2c2b8285349822d7afee35d4 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
LMDeploy 的量化和部署 作业.md
Snipaste_2024-01-14_17-50-13

命令行部署

Snipaste_2024-01-14_18-39-12

web 部署

Snipaste_2024-01-14_18-39-56

小故事

遇到了一个插曲……想试试让 Internlm 讲一个华为笑话，结果他打环了，而且 gradio 没有重复惩罚参数

image

还是 GPT 会讲地狱笑话

image
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment