alexrudall

How to add ChatGPT streaming to your Ruby on Rails 7 app!

This guide will walk you through adding a ChatGPT-like messaging stream to your Ruby on Rails 7 app using ruby-openai, Rails 7, Hotwire, Turbostream, Sidekiq and Tailwind. All code included below!

• Follow me on Twitter for more Ruby AI at https://twitter.com/alexrudall
• Released under the MIT License - use as you wish :)

First, add the ruby-openai gem! Needs to be at least version 4. Add Sidekiq too.

kylev

 #!/usr/bin/env ruby

# Some members of ruby community continue to misunderstand the interplay of
# signal handlers and exception handling. This is a brief exploration
# via examples. You can run them by uncommenting the invocations at
# the bottom. You can see their behavior with Ctrl-C.
#
# Some of the examples will require a kill -9 from another terminal to
# stop.
#

h2non

// Under WTFPL license ;)
function ancestors(obj) {
  var hierarchy = [];
  if (['boolean', 'number', 'string', 'undefined'].indexOf(typeof obj) !== -1 || obj === null) { // primitives types
    obj = Object(obj);
  } else if (typeof obj === 'function') {
    hierarchy.push(
      obj.name ||
      (obj.toString().match(/function (\w*)/) ||
      obj.toString().match(/\[object (\w*)\]/))[1] ||

iainconnor

# Built application files
/*/build/

# Crashlytics configuations
com_crashlytics_export_strings.xml

# Local configuration file (sdk path, etc)
local.properties

# Gradle generated files

egonSchiele

import Control.Monad
import Control.Concurrent
import Control.Concurrent.STM
import System.Random
import Text.Printf

-- Forks
type Fork = TMVar Int
 
newFork :: Int -> IO Fork

jpanganiban

#!/usr/bin/env python

from gevent import monkey
monkey.patch_all()  # Patch everything
import gevent
import time


class Hub(object):
    """A simple reactor hub... In async!"""

mattconnolly

module AuthHelper
  def http_login
    user = 'username'
    pw = 'password'
    request.env['HTTP_AUTHORIZATION'] = ActionController::HttpAuthentication::Basic.encode_credentials(user,pw)
  end
end

module AuthRequestHelper
  #

choplin

require 'msgpack'
require 'thread'

class ProcessPool
  def initialize(num_process, args={})
    queue_size, worker_class = parse_args([
      :queue_size, nil,
      :worker_class, Worker,
    ], args)

jboner

Latency Comparison Numbers (~2012)
----------------------------------
L1 cache reference                           0.5 ns
Branch mispredict                            5   ns
L2 cache reference                           7   ns                      14x L1 cache
Mutex lock/unlock                           25   ns
Main memory reference                      100   ns                      20x L2 cache, 200x L1 cache
Compress 1K bytes with Zippy             3,000   ns        3 us
Send 1K bytes over 1 Gbps network       10,000   ns       10 us
Read 4K randomly from SSD*             150,000   ns      150 us          ~1GB/sec SSD

doitian

#!/bin/bash

# refs http://stackoverflow.com/a/1260982/667158

function submodule_rm() {
  [ -z "$1" ] && return 1

  local path="$1"
  local dir=$(dirname ".git/modules/$path")