Conrad Lippert-Zajaczkowski conradlz
conradlz
/ handler.py
Created
June 25, 2023 16:06
HuggingFace Inference API Handler for RWKV-4-World-7B-v1-OnlyForTest_84%_trained-20230618-ctx4096.pth
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ######################################################################################################## | |
| # The RWKV Language Model - https://github.com/BlinkDL/RWKV-LM | |
| ######################################################################################################## | |
| # import os | |
| # import copy | |
| import os, gc | |
| # os.environ["CUDA_VISIBLE_DEVICES"] = "0,1,2,3" | |
| os.environ["RWKV_JIT_ON"] = '1' | |
| os.environ["RWKV_CUDA_ON"] = '1' # if '1' then use CUDA kernel for seq mode (much faster) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // for developer comfort | |
| ember-cli-emblem | |
| ember-cli-sass | |
| // for best practice code-styling | |
| eslint-plugin-ember | |
| eslint-plugin-ember-suave | |
| eslint-plugin-promise | |
| // for good testing |