Skip to content

Instantly share code, notes, and snippets.

Avatar
🇺🇦
#StandWithUkraine

Ivan Borshchov ivictbor

🇺🇦
#StandWithUkraine
View GitHub Profile
@ivictbor
ivictbor / test_gpt_j_gen_count.py
Created Feb 16, 2022
Gist for benchmarking GPT generating performance with same input (43 tokens)
View test_gpt_j_gen_count.py
import aiohttp
import json
import asyncio
import datetime
import matplotlib.pyplot as plt
text = """
Planning a project is one thing, but making sure deadlines are met and all tasks are completed is a whole other. Falling behind is easy when an entire sequence of events is dependent on the previous being successfully finished.
"""
@ivictbor
ivictbor / test_gpt_j.py
Created Feb 16, 2022
Benchmark GPT-J model generation speed
View test_gpt_j.py
import aiohttp
import json
import asyncio
import datetime
import matplotlib.pyplot as plt
text = """
Planning a project is one thing, but making sure deadlines are met and all tasks are completed is a whole other. Falling behind is easy when an entire sequence of events is dependent on the previous being successfully finished.