Skip to content

Instantly share code, notes, and snippets.

View VTSTech's full-sized avatar

Nigel Todman VTSTech

View GitHub Profile
### Keybase proof
I hereby claim:
* I am VTSTech on github.
* I am vtstech (https://keybase.io/vtstech) on keybase.
* I have a public key whose fingerprint is 008C AB70 8D0F F529 C091 26BC 53D6 76EE 6E7D 4CCC
To claim this, I am signing this object:
@VTSTech
VTSTech / VTSTech-PERP.py
Last active May 3, 2024 01:17
VTSTech-PERP - Python script that computes perplexity on GPT Models
# Program: VTSTech-PERP.py 2023-04-17 6:14:21PM
# Description: Python script that computes perplexity on GPT Models
# Author: Written by Veritas//VTSTech (veritas@vts-tech.org)
# GitHub: https://github.com/VTSTech
# Homepage: www.VTS-Tech.org
# Use a 'train.txt' for it to predict with. Any large english text will do
# pip install torch argparse transformers colorama
import torch
import argparse
import time
@VTSTech
VTSTech / VTSTech-GPT.py
Last active May 3, 2024 01:16
VTSTech-GPT - Generate text with Cerebras GPT pretrained and Corianas finetuned models
# Program: VTSTech-GPT.py 2023-04-10 8:22:36PM
# Description: Python script that generates text with Cerebras GPT pretrained and Corianas finetuned models
# Author: Written by Veritas//VTSTech (veritas@vts-tech.org)
# GitHub: https://github.com/VTSTech
# Homepage: www.VTS-Tech.org
# Dependencies: transformers, colorama, Flask
# pip install transformers colorama flask
# Models are stored at C:\Users\%username%\.cache\huggingface\hub
import argparse
import time
@VTSTech
VTSTech / VTSTech-COVID19.py
Last active March 16, 2020 14:27
COVID-19 JHU.EDU CSSE Data Analytics by VTSTech (www.VTS-Tech.org)
#Moved to GitHub https://github.com/Veritas83/VTSTech-COVID19.py
@VTSTech
VTSTech / VTSTech-NLTK.py
Last active May 3, 2024 01:17
VTSTech-NLTK Script v0.43
#NLTK Script v0.43 2020-03-14 12:16:31 AM
#Written by VTSTech (veritas@vts-tech.org)
#Various functions inspired by code from sentdex/pythonprogramming.net
#https://pythonprogramming.net/tokenizing-words-sentences-nltk-tutorial/
#Various functions inspired by code from Natural Language Processing with Python
#by Steven Bird, Ewan Klein and Edward Loper - http://www.nltk.org/book/ch01.html
import sys, nltk, os, string, random
from nltk import pos_tag
from nltk.tokenize import sent_tokenize, word_tokenize, SpaceTokenizer, PunktSentenceTokenizer
@VTSTech
VTSTech / keybase.md
Created March 8, 2020 20:00
keybase.md

Keybase proof

I hereby claim:

  • I am veritas83 on github.
  • I am vtstech (https://keybase.io/vtstech) on keybase.
  • I have a public key ASCIgxHBXf_NtNTs02HkHJFQQh7WBlJlb_jJS0glcMDnnQo

To claim this, I am signing this object: