Skip to content

Instantly share code, notes, and snippets.

@PtrMan
Last active May 29, 2024 21:30
Show Gist options
  • Save PtrMan/78726c784efbd4e79d96d7cb5c383460 to your computer and use it in GitHub Desktop.
Save PtrMan/78726c784efbd4e79d96d7cb5c383460 to your computer and use it in GitHub Desktop.
https://kajsotala.fi/2007/10/14-objections-against-aifriendly-aithe-singujlarity-answered/
https://www.psychologytoday.com/us/blog/shut-and-listen/201806/humans-cant-plan-long-term-and-heres-why
https://kajsotala.fi/2007/10/14-objections-against-aifriendly-aithe-singularity-answered/
Friendly AI
https://towardsdatascience.com/attention-in-neural-networks-e66920838742
https://www.microsoft.com/en-us/research/blog/ai-for-ai-metareasoning-for-modular-computing-systems/
articles about ML and meta-learning of hyperparameters
### 4.03.2023
https://www.zdnet.com/article/metas-ai-guru-lecun-most-of-todays-ai-approaches-will-never-lead-to-true-intelligence/
* discussion of ML and limits of todays ML
https://medium.com/@jindalkanika02/achieving-artificial-general-intelligence-agi-using-meta-learning-learning-to-learn-51fcaa1f46de
* enumerates some maybe useful ML methods
### 6.03.2023
https://cs.nyu.edu/~davise/papers/GPT3CompleteTests.html
(paper)
* Gary Marcus
* GPT-3 test
https://cs.nyu.edu/~davise/papers/GPT-3-6-22.html
* Gary Marcus
* GPT-3 test
https://glebshev.medium.com/artificial-general-intelligence-will-not-be-4c364df54f50
(AGI) <br />
blog post about misconceptions of AGI <br />
https://medium.com/@jindalkanika02/achieving-artificial-general-intelligence-agi-using-meta-learning-learning-to-learn-51fcaa1f46de <br />
meta learning
https://www.nature.com/articles/d41586-023-00340-6
* LLM in science
### 7.03.2023
https://futurism.com/experts-slam-openais-meaningless-new-promises-about-agi
https://www.reddit.com/r/compsci/comments/oh7fz8/full_article_about_openai_plan_to_reach/
* OpenAI claims that AGI will be archived by 2024
https://andreamiotti.substack.com/p/agi-in-sight-our-look-at-the-game
* claims that AGI will be archived in short term
https://positivepsychology.com/relational-frame-theory/
* *what is RFT*
https://psycnet.apa.org/fulltext/2014-44008-007.html
* (paper)
* what is RFT
### 9.03.2023
https://garymarcus.substack.com/p/inside-the-heart-of-chatgpts-darkness
* ChatGPT
* discussion of alignment of LM trained on human text
https://garymarcus.substack.com/p/is-it-time-to-hit-the-pause-button
* is it time to halt AI deployment / AI research / etc.
* AI alignment
For the government to play catchup yet again seems foolhardy as we move towards *technologies that may exceed human cognitive capabilities*.
https://bdtechtalks.com/2023/02/27/openai-agi-strategy/
* discussion of AI race
* discussion of AGI safety
https://thegradient.pub/machine-learning-wont-solve-the-natural-language-understanding-challenge/
* discussion of difference between NLP and NLU
(I think the opinion of the author is slightly wrong, interpretations are always subjective)
https://arxiv.org/pdf/2302.03494.pdf?trk=public_post_comment-text
* on ChatGPT "failures" (is not a professional paper)
https://aligned.substack.com/p/a-proposal-for-importing-societys-values
* philosophical discussion of alignment of ML
## 12.3.2023
https://en.wikipedia.org/wiki/Computer_vision#History
## 13.3.2023
https://twitter.com/emollick/status/1627161768966463488
* Bing Chat LM
## 20.3.2023
https://nostalgebraist.tumblr.com/post/182837607539/any-opinions-on-gpt-2
* opinion on GPT-2
https://writings.stephenwolfram.com/2023/03/will-ais-take-all-our-jobs-and-end-human-history-or-not-well-its-complicated/
* computational irreducibility
https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/#what-is-a-model?
* what is chatGPT doing
https://people.idsia.ch/~juergen/deep-learning-history.html
* history of deep learning
* singularity from the opinion of Schmidhuber
https://jamesblaha.medium.com/agi-doesnt-need-understanding-or-consciousness-in-order-to-kill-us-only-intelligence-ad1cdfcf2e5c
* discussion of AGI
https://news.ycombinator.com/item?id=35299071
* discussion of xGPTy for coding
https://promptmuse.com/gpt-5-could-release-by-year-end-unprecedented-power-and-the-path-to-artificial-general-intelligence/
* GPT-5 may be AGI
https://news.ycombinator.com/item?id=35392288
* anti Sam Altman conversation log
https://www.marktechpost.com/2023/04/06/8-potentially-surprising-things-to-know-about-large-language-models-llms/
* about LM's
https://users.sussex.ac.uk/~philh/pubs/CowanInterview.pdf
* interview with AI piorneer
https://www.paepper.com/blog/posts/intelligent-agents-guided-by-llms/
https://medium.com/@vinbhalerao/chatgpt-isnt-agi-it-is-ausi-472630739b9e
* blog post about chatGPT (low qualtity)
https://news.ycombinator.com/item?id=35512938
* GPT3.5 - prompt idea to suggest improvements to code
https://slatestarcodex.com/2020/06/10/the-obligatory-gpt-3-post/
* GPT-3 + nonsense extrapolation
https://intelligence.org/2013/06/19/what-is-intelligence-2/
* working definition of intelligence "Intelligence measures an agent’s ability to achieve goals in a wide range of environments" (they call it "optimization power")
http://joschu.net/blog/opinionated-guide-ml-research.html
https://twitter.com/BlancheMinerva/status/1644177571628699649?s=20
* ML
* answers: How much training data is available?
https://aiindex.stanford.edu/wp-content/uploads/2023/04/HAI_AI-Index-Report_2023.pdf
* AI ML report 2023
https://www.paepper.com/blog/posts/intelligent-agents-guided-by-llms/
* ML > LMt
* "agent"
https://legrandcontinent.eu/fr/2023/04/28/limites-dun-systeme-comment-debloquer-lia/
* Gary Marcus vs DL
http://togelius.blogspot.com/2023/04/is-elden-ring-existential-risk-to.html
* discussion of ASI
* criticism of AI/ML
* about "intelligence"
## 29.05.2023
https://web.stanford.edu/class/cs224n/slides/cs224n-2023-lecture11-prompting-rlhf.pdf
* AI > ML > RLHF
## 11.06.2023
https://www.deviantart.com/precia-t/art/AI-IS-this-the-end-of-art-939997519
* discussion of AI "art"
## 20.06.2023
https://web.archive.org/web/20000817022232/http://singinst.org/CaTAI.html
* Yudkowsky's "Coding a transhuman AI"
https://www.reddit.com/r/LocalLLaMA/wiki/models/
* LLM's + prompts
https://www.alignmentforum.org/posts/kpPnReyBC54KESiSn/optimality-is-the-tiger-and-agents-are-its-teeth
https://www.cyberark.com/resources/threat-research-blog/chatting-our-way-into-creating-a-polymorphic-malware?ref=bounded-regret.ghost.io
* GPT-3.5 for malware generation
https://bounded-regret.ghost.io/future-ml-systems-will-be-qualitatively-different/
* ML systems will be qualitativly different
### 24.06.2023
https://pyimagesearch.com/2021/07/19/pytorch-training-your-first-convolutional-neural-network-cnn/
* toturial to create CNN with pytorch
https://wiki.opencog.org/wikihome/images/b/b7/MeTTa_Specification.pdf
* MeTTa programming language specification
### 23.07.2023
https://erichartford.com/uncensored-models
https://medium.com/pytorch/colossalchat-an-open-source-solution-for-cloning-chatgpt-with-a-complete-rlhf-pipeline-5edf08fb538b
claims
'Large AI models and applications like ChatGPT and GPT-4 have become extremely popular worldwide, serving as a foundation for the technological industrial revolution and the development of AGI (Artificial General Intelligence).'
### 25.06.2023
https://astralcodexten.substack.com/p/somewhat-contra-marcus-on-ai-scaling?s=r
* "Gary Marcus is wrong"
https://www.lesswrong.com/posts/83cXhEy2X8zkucjcs/a-crazy-hypothesis-gpt-4-already-is-agentic-and-is-trying-to
https://ai.meta.com/llama/license/
* llama2 licence for the model, code, etc.
https://www.sciencesnail.com/science/synthesis-of-ibuprofen-from-benzene
https://central.edu/writing-anthology/2019/04/11/ibuprofen-synthesis/
### 27.06.2023
https://www.heise.de/news/LLaMA-Nachbau-RedPajama-erste-dezentrale-Open-Source-KI-mit-offenem-Datensatz-8971752.html
* article about LLM under Apache2.0 license
### 12.08.2023
https://www.mic.com/impact/artificial-intelligence-development-is-starting-to-slow-down-facebook-head-of-ai-says-19424331#:~:text=In%20fact%2C%20some%20experts%20believe%20that%20AI%20in,machine%20learning%20is%20about%20to%20%22hit%20the%20wall.%22
(AI about to hit the wall) (2019)
https://time.com/6300942/ai-progress-charts/
(ML not soon to hit a wall)
### 15.08.2023
https://www.meteoblue.com/de/wetter/historyclimate/climatemodelled/molat_kroatien_3216598
wetter auf Kroatien Molat
### 13.09.2023
https://www.eveonline.com/news/view/a-history-of-eve-database-server-hardware
https://andydote.co.uk/2023/09/19/tracing-is-better/?utm_source=tldrnewsletter
programming > tracing
### 5.10.2023
https://blog.opensource.org/metas-llama-2-license-is-not-open-source/
https://www.reddit.com/r/StableDiffusion/comments/15etxir/sdxl_styles/
* SDXL different styles
### 07.10.2023
https://twitter.com/GrantSlatton/status/1703913578036904431?s=20
* GPT can play chess with 1800 ELO
https://www.reddit.com/r/singularity/comments/121tc48/gpt4_fails_to_solve_coding_problems_it_hasnt_been/
* discussion of GPT-4 and reasoning, some mentioning of AGI
https://www.wired.com/story/what-is-artificial-general-intelligence-agi-explained/
### 14.10.2023
https://bdtechtalks.com/2018/12/03/jeremy-howard-ai-deep-learning-myths/
"Deep learning is just a fad—next year it’ll be something else"
### 2.11.2023
https://medium.com/@radiomonkeys/from-here-to-proto-agi-what-might-it-take-and-what-might-happen-89ee2db3b2f1
### 13.11.2023
https://www.vox.com/the-highlight/23447596/artificial-intelligence-agi-openai-gpt3-existential-risk-human-extinction
https://www.arte.tv/de/videos/106719-000-A/flash-wars/
arte doku
### 15.11.2023
https://mindmatters.ai/2022/12/large-learning-models-are-an-unfortunate-detour-in-ai/
blog post
* dream of AGI stated in 1970 by minsky
* claim: "LLMs is not a road to AGI"
https://the-decoder.com/why-large-ai-language-models-dont-lead-to-human-like-ai/
* claim: LLM don't lead to AGI
https://deepgram.com/learn/mmlu-llm-benchmark-guide#
* GLUE
* SuperGLUE
* HellaSwag
* MMLU
### 21.11.2023
https://www.nytimes.com/2023/11/21/technology/openai-altman-board-fight.html?unlocked_article_code=1.AU0.0Zli.ur35-H19FBLR&smid=url-share&utm_source=tldrnewsletter
https://thegradient.pub/has-ai-found-a-new-foundation/
* foundation models are not a foundation
### 20.2.2024
https://ourworldindata.org/grapher/artificial-intelligence-training-computation?time=2001-12-08..latest
https://ea.rna.nl/2018/04/04/something-is-still-rotten-in-the-kingdom-of-artificial-intelligence/
* Blog post entry about lack of intelligence in field of AI
### 12.3.2024
https://onlinelibrary.wiley.com/doi/10.1609/aaai.12026
### 5.4.2024
https://plato.stanford.edu/entries/type-theory/
* what is type theory?
### 10.4.2024
https://stats.stackexchange.com/questions/320698/deriving-posterior-conditionals-for-gibbs-sampling#320707
bayesian probability theory: how to derive conditional posterior distribution for Gibbs sampler?
### 10.4.2024
https://askubuntu.com/questions/1189174/how-do-i-use-ffmpeg-and-rav1e-to-create-high-quality-av1-files#1190778
---
https://www.youtube.com/watch?v=7y5HtMIj_8c
* huhntot Vorlesung
https://www.youtube.com/watch?v=YpruA5mC7wg F16 flight computer
https://www.youtube.com/watch?v=QHL2nTFPdpg nuclear weapons
https://www.youtube.com/watch?v=G8t-XPDaiUc drugs (german)
### 9.5.2024
https://www.forbes.com/sites/gilpress/2016/12/21/artificial-intelligence-pioneers-peter-norvig-google/?sh=4f3633ce38c6
* quote of Peter Norvig who is anti AGI
https://www.technologyreview.com/2020/02/25/906083/artificial-intelligence-destroy-civilization-canaries-robot-overlords-take-over-world-ai/
* anti Bostrom
https://stackoverflow.blog/2023/12/28/self-healing-code-is-the-future-of-software-development/
* use of LLM for coding
29.5.2024
https://uk.pcmag.com/news/146481/yes-machines-make-mistakes-the-10-biggest-flaws-in-generative-ai
* problems with generative ML
https://nautil.us/deep-learning-is-hitting-a-wall-238440/
* symbol manipulation vs connectionism
(written account of Hinton hostility against symbol manipulation)
> Hinton told a gathering of European Union leaders that investing any further money in symbol-manipulating approaches was “a huge mistake,” likening it to investing in internal combustion engines in the era of electric cars.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment