Skip to content

Instantly share code, notes, and snippets.

View Beomi's full-sized avatar

Junbum Lee Beomi

View GitHub Profile
@Beomi
Beomi / output.txt
Created April 18, 2024 13:01
InfiniGemma 2B generated text (used 64M tokens trained ckpt)
Input: "Once upon a time,"
Output below:
Once upon a time,<generation starts here> shortly before our present century, a young Punta Clam, Teepee-uh tetnak Mandrillon had a vision, or rather a visioning so fanciful and idealistic that it was poetical and utopian; one he believed to’s enjoy the famed blend of great auster than we refer to today’s New York Yankee Stadium, Tommy Johnbee’s tranquillity that whisked him and many of his Seminole cohorts from the tender world of Sarasota to Nassau, a then newly open and ever-expandable harbor world of desirable prominence.
The city skyline, cira Tiffany Goldstein imagery glazered sweetly upon such a so beautifully streamlined and majestic vista which mesmerized all the Florida youngsters to tire from their artichian Bronzeheaddom and persuaded them to rebel against “Herr Merl;beginner player” Goliath, a Bismarckian Big Bad Wolf, who was the hero lest tyrannically dominate them or scrap Bureaucratic inhumanity from their pot-smoking Jehovah sponsors. Undoubtedly b
@Beomi
Beomi / output.txt
Created April 18, 2024 12:58
InfiniGemma 2B generated text (used 64M tokens trained ckpt)
Once upon a time, in a far away galaxy, there was a speck of blue light. It was encased in a clear, dark, surrounded by stars for as far as the eye could see. One of those stars was surrounded in a perfect starry expanse that was yearning to be seen by mortal eyes. Thus forever, it shone.
That's how far away it was, at least far enough that you could stomp it in your periodum, as if its entire life never ended. You could bask in the glow of starry hues and even starry eyes at infinity where everything deep and dark would seem to be perfect. As if that were in your infancy, it had been that starry stellard that in whose mama's eyes it would have risen interminably. And when you're conjunctivitis from a premature orbiter, even having curvature that bordered on blindness and a certain degree of light sensitivity is way easier than every twilight deep in the southern horizon to be found.
This jubilant space then slowly, spaced itself according to how far away each subject was, darkness drawing it into embraced
@Beomi
Beomi / 2023_05_26_bnb_4bit_koalpaca_v1_1a_on_polyglot_ko_12_8b.ipynb
Last active June 9, 2023 02:34
2023_05_26_bnb_4bit_koalpaca_v1_1a_on_polyglot_ko_12_8b.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Beomi
Beomi / 2023_05_26_bnb_4bit_KoAlpaca_v1_1a_on_Polyglot_ko_12_8B.ipynb
Last active May 31, 2023 08:57
2023_05_26_bnb_4bit_koalpaca_v1_1a_on_polyglot_ko_12_8b.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Beomi
Beomi / get_torch_with_cuda.sh
Created August 30, 2022 01:17
Install PyTorch with currently available system CUDA version
#get cuda version and install torch
if nvcc --version 2&> /dev/null; then
# Determine CUDA version using default nvcc binary
CUDA_VERSION=$(nvcc --version | sed -n 's/^.*release \([0-9]\+\.[0-9]\+\).*$/\1/p');
elif /usr/local/cuda/bin/nvcc --version 2&> /dev/null; then
# Determine CUDA version using /usr/local/cuda/bin/nvcc binary
CUDA_VERSION=$(/usr/local/cuda/bin/nvcc --version | sed -n 's/^.*release \([0-9]\+\.[0-9]\+\).*$/\1/p');
@Beomi
Beomi / exbert_train_result.txt
Created June 10, 2021 05:59
exBERT-transformers sample train results
(exbert-transformers) root@jupyter-beomi:~/exbert-transformers/examples/pytorch/language-modeling# ./exbert_pretrain.sh
2021-06-10 05:57:55.339746: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/local/nvidia/lib:/usr/local/nvidia/lib64
2021-06-10 05:57:55.339796: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do nothave a GPU set up on your machine.
06/10/2021 05:57:58 - WARNING - __main__ - Process rank: -1, device: cuda:0, n_gpu: 1distributed training: False, 16-bits training: False
06/10/2021 05:57:58 - INFO - __main__ - Training/evaluation parameters TrainingArguments(
_n_gpu=1,
adafactor=False,
adam_beta1=0.9,
adam_beta2=0.999,
adam_epsilon=1e-08,
@Beomi
Beomi / fluent-korean.css
Created March 15, 2021 15:14
Typora "Fluent" Theme Korean adaptive CSS
:root {
--side-bar-bg-color: #fafafa;
--control-text-color: #777;
--monospace: "Jetbrains Mono";
}
.title-text {
font-size: 14px;
}
@Beomi
Beomi / 2021-03-15-kcbert-mlm-finetune-with-petition-dataset.ipynb
Last active August 16, 2021 05:42
2021.03.15. KcBERT MLM Finetune with Petition Dataset
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Beomi
Beomi / 2021-03-15-kcbert-mlm-finetune-with-petition-dataset.ipynb
Created March 15, 2021 05:45
2021.03.15. KcBERT MLM Finetune with Petition Dataset
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Beomi
Beomi / kcbert-nsmc.ipynb
Last active July 20, 2020 05:01
kcbert-nsmc (public)
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.