Rohit Trivedi rtrivedi-cubesmart

## LLM.md

      
              2 files
            
          
              0 forks
            
          
                0 comments
              
            
              0 stars
            
          
                rtrivedi-cubesmart
                / LLM.md
            
            
              Created
              March 31, 2023 17:51
                — forked from rain-1/LLM.md
            
              
                LLM Introduction: Learn Language Models
              
          
    Purpose

Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT.
Avoid being a link dump. Try to provide only valuable well tuned information.
Prelude

Neural network links before starting with transformers.

  
## bitarray.js
import { inflateRaw, deflateRaw } from "pako";

// https://en.wikipedia.org/wiki/Run-length_encoding
const Z_RLE = 3;

class BitArray {
  constructor(bitSize) {
    const remainder = Math.min(1, bitSize % 8);
    const byteSize = Math.floor(bitSize / 8) + remainder;
    const buffer = new ArrayBuffer(byteSize);
	import { inflateRaw, deflateRaw } from "pako";

	// https://en.wikipedia.org/wiki/Run-length_encoding
	const Z_RLE = 3;

	class BitArray {
	constructor(bitSize) {
	const remainder = Math.min(1, bitSize % 8);
	const byteSize = Math.floor(bitSize / 8) + remainder;
	const buffer = new ArrayBuffer(byteSize);