Skip to content

Instantly share code, notes, and snippets.

@aaronrogers
aaronrogers / AzureLLM.ts
Created April 3, 2023 17:14
A simple, proof-of-concept Azure LLM for [Langchain.js](https://js.langchain.com/docs/).
import { BaseLLM } from 'langchain/llms'
import { CallbackManager } from 'langchain/callbacks'
import { LLMResult } from 'langchain/schema'
import { encoding_for_model, TiktokenModel } from '@dqbd/tiktoken'
export class AzureLLM extends BaseLLM {
name = 'AzureLLM'
batchSize = 20
temperature: number
concurrency?: number