Glavin001

import base64
from io import BytesIO

from PIL import Image
import torch
import torch.nn as nn
import ollama
from diffusers import DiffusionPipeline, StableDiffusionPipeline
from safetensors.torch import load_file
from transformers import CLIPProcessor, CLIPModel, AutoImageProcessor, AutoModel

Glavin001

About

This is a demo of https://github.com/Glavin001/Data2AITextbook

Given a raw/unstructured input and produce high quality dataset for training an expert language model.

The following is an example demonstrating only a couple parts:

• Learning objective extraction with order/dependencies
• Lesson generation
• [TODO] Exercise generation

Glavin001

Usage

renderMermaid('graph TB\na-->b')

Output

graph TB

Glavin001

How to update CUDA version for TensorDock

Problem

TensorDock is pre-installed with CUDA 10.1 (old).

For many use-cases, such as Flash Attention 2 require newer versions of CUDA.

One symptom of this is nvcc and nvidia-smi will show different CUDA versions:

Glavin001

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts and experience preferred (super rare at this point).

My own notes from a few months back.

Background

• Survey of LLMS
• Self-attention and transformer networks

Glavin001

If you're using a high-end bluetooth headset on your Macbook Pro it's likely your mac is using an audio codec which favors battery efficiency over high quality. This results in a drastic degradation of sound, the SBC codec is the likely culprit, read more about it here.

Find out what codec you're using

1. Play a song on your headphones
2. Option (⌥) click the Bluetooth button at the top of your screen
3. If you're using AAC or aptX, you can stop here—those are the highest quality codecs.

Change your codec to AAC or aptX

Glavin001

{}

Glavin001

Install ts-node with Node.js v13+ then you can run:

./node_modules/.bin/ts-node -O '{"module":"commonjs"}' list-exports.ts <files...>

The -O '{"module":"commonjs"}' part is to allow using import & export statements: TypeStrong/ts-node#922 (comment)

Demo

Glavin001

Here are several different ways to test a TCP port without telnet.

BASH (man page)

$ cat < /dev/tcp/127.0.0.1/22
SSH-2.0-OpenSSH_5.3
^C

$ cat &lt; /dev/tcp/127.0.0.1/23

Glavin001

class Frame extends Component {
  componentDidMount() {
    this.iframeHead = this.node.contentDocument.head
    this.iframeRoot = this.node.contentDocument.body
    this.forceUpdate()
  }

  render() {
    const { children, head, ...rest } = this.props
    return (