Skip to content

Instantly share code, notes, and snippets.

View Sadik-Hossain's full-sized avatar
❇️
Focusing

MD. Sadik Sadik-Hossain

❇️
Focusing
View GitHub Profile
@Sadik-Hossain
Sadik-Hossain / modal.html
Last active January 17, 2023 17:29
modal pure css with checkbox
<html>
<head>
<style>
/* Hide the modal content by default */
.modal {
display: none;
}
/* hide checkbox logo*/
@Sadik-Hossain
Sadik-Hossain / j6b_train_hf_ds.py
Created December 7, 2022 16:10 — forked from kinoc/j6b_train_hf_ds.py
So now you want to finetune that GPT-J-6B on a 3090/TITAN GPU ... okay, using HF and DeepSpeed too
# So now you want to finetune that GPT-J-6B on a 3090/TITAN GPU ... okay
# More exploratory coding. It uses the Huggingface model port, deepspeed and reads all text/md files from a target directory
# It is a fragment of a larger system with remote editing, but that's another story
# This is the raw, training tester. Items to look out for:
# - uses DeepSpeed and has a DS config
# - to save space uses SGD instead of ADAM
# - uses gradient checkpointing
# - freezes 25% of the layers to fit
# Assumes you can already run https://gist.github.com/kinoc/2d636a68876cd3de7b6e9c9452b61089
import React, { useRef } from "react";
import {
useSendPasswordResetEmail,
useSignInWithEmailAndPassword,
} from "react-firebase-hooks/auth";
import { Link, useLocation, useNavigate } from "react-router-dom";
import auth from "../../../../firebase.init";
import Loading from "../../Shared/Loading/Loading";
import SocialLogin from "../SocialLogin/SocialLogin";