I hereby claim:
- I am veritas83 on github.
- I am vtstech (https://keybase.io/vtstech) on keybase.
- I have a public key ASCIgxHBXf_NtNTs02HkHJFQQh7WBlJlb_jJS0glcMDnnQo
To claim this, I am signing this object:
### Keybase proof | |
I hereby claim: | |
* I am VTSTech on github. | |
* I am vtstech (https://keybase.io/vtstech) on keybase. | |
* I have a public key whose fingerprint is 008C AB70 8D0F F529 C091 26BC 53D6 76EE 6E7D 4CCC | |
To claim this, I am signing this object: |
# Program: VTSTech-PERP.py 2023-04-17 6:14:21PM | |
# Description: Python script that computes perplexity on GPT Models | |
# Author: Written by Veritas//VTSTech (veritas@vts-tech.org) | |
# GitHub: https://github.com/VTSTech | |
# Homepage: www.VTS-Tech.org | |
# Use a 'train.txt' for it to predict with. Any large english text will do | |
# pip install torch argparse transformers colorama | |
import torch | |
import argparse | |
import time |
# Program: VTSTech-GPT.py 2023-04-10 8:22:36PM | |
# Description: Python script that generates text with Cerebras GPT pretrained and Corianas finetuned models | |
# Author: Written by Veritas//VTSTech (veritas@vts-tech.org) | |
# GitHub: https://github.com/VTSTech | |
# Homepage: www.VTS-Tech.org | |
# Dependencies: transformers, colorama, Flask | |
# pip install transformers colorama flask | |
# Models are stored at C:\Users\%username%\.cache\huggingface\hub | |
import argparse | |
import time |
#Moved to GitHub https://github.com/Veritas83/VTSTech-COVID19.py |
#NLTK Script v0.43 2020-03-14 12:16:31 AM | |
#Written by VTSTech (veritas@vts-tech.org) | |
#Various functions inspired by code from sentdex/pythonprogramming.net | |
#https://pythonprogramming.net/tokenizing-words-sentences-nltk-tutorial/ | |
#Various functions inspired by code from Natural Language Processing with Python | |
#by Steven Bird, Ewan Klein and Edward Loper - http://www.nltk.org/book/ch01.html | |
import sys, nltk, os, string, random | |
from nltk import pos_tag | |
from nltk.tokenize import sent_tokenize, word_tokenize, SpaceTokenizer, PunktSentenceTokenizer |
I hereby claim:
To claim this, I am signing this object: