Skip to content

Instantly share code, notes, and snippets.

View grikdotnet's full-sized avatar

Grigori Kochanov grikdotnet

View GitHub Profile
@grikdotnet
grikdotnet / ai-programming-disctionary.md
Last active October 17, 2024 22:01
AI to programming slang dictionary

LLM - a stateless in-memory map/reduce backend service

Vertical LLM - a specialized LLM service optimized for a particular business scenario

RAG (Retrieval Auhmented Retrieval) - an back-end architecture of a service, consisting of a middleware, a database for a full-text or vector serch, and an LLM service

Agents - an architecture, consisting of an LLM, and a middleware that implements business logic, an API, and usually sessions

Multi-agentic system - a microservice implementation of multiple middleware services, and often multiple LLM backends

@grikdotnet
grikdotnet / what-llms-are-not.md
Last active October 2, 2024 19:06
What LLMs are not, a story for javascript programmers.

RealDream Lightning-1919859531

"Attention is all you need" they wrote in 2017, and introduced a transformer architecture implemented in LLMs. The "The Parallelism Tradeoff: Limitations of Log-Precision Transformers" article in 2023 described transformers' constraints.

In a theory transformers are Turing-complete, which means they can solve any computational task. But there are 2 major assumptions: infinite precision, and arbitrary size of models. The limits of computer memory and precision in chips are set in stone. Long story short, there are tasks that transformer LLMs can not solve.

Main limitation.

In programming we are used to the binary logic: AND, OR, NOT, and others, called "gates". They are used to implement operators like IF and FOR loops that are used to branch execution and define the logic of applications.