Today, I bring to you a thought-provoking concept: the amalgamation of technology and psychology, or more specifically, the application of System 1 and System 2 LLMs in AI programming. This idea was born from two main observations I made.
Firstly, there is the revolutionary technology of "embeddings" that has seen its usage skyrocket since 2022. It allows us to create a programmable memory for AI, thus eliminating the need to grapple with prompt engineering. I began to ponder if there could be a more efficient alternative to embeddings, one that utilizes fast and economical LLMs.
Secondly, the theory of System 1 and System 2 in psychology, which speaks about two different decision-making processes in our brain, caught my attention. System 1 corresponds to our intuitive, automatic, often subconscious thought process, like recognizing facial expressions. On the other hand, System 2 is deliberate, slower, and more logical, like solving complex math problems.
Inspired by this theory, I began to explore the po