Skip to content

Instantly share code, notes, and snippets.

View claysauruswrecks's full-sized avatar

claysauruswrecks

  • Shoggoth Search&Rescue
  • Yo crontab
View GitHub Profile
@claysauruswrecks
claysauruswrecks / RP-EA-Generalization.md
Last active February 9, 2024 05:02
Research Proposal – Evolutionary Algorithms and Compression/Generalization of Training Data

Research Proposal – Evolutionary Algorithms and Compression/Generalization of Training Data

Objective

The primary goal of this research is to harness evolutionary algorithms and genomic mappings for the development of efficient, effective, and hopefully sparse deep learning models. This entails two main areas of focus:

  1. Architecture Optimization for Data Compression
    • Identify the most computationally efficient architectures for compressing training data into the model, ensuring perfect recall. This exploration anticipates that different data types or skills might necessitate uniquely optimized architectures.
  2. Application of Neural Growth and Pruning Cycles
  • The methodology involves adding layers, cross-connections, and mutations surrounding the frozen “base-model”, which contains the compressed training data. This model will undergo phased and gated training, initially focusing on data comprehension, followed by cognitive reasoning, and then extrapolation, intuition, and creativity. The
@claysauruswrecks
claysauruswrecks / requirements.txt
Last active April 7, 2024 16:32
Example using LlamaHub loaders to index Github repos into LlamaIndex and query GPTSimpleVectorIndex with GPT-4
# main
llama-index
langchain