Skip to content

Instantly share code, notes, and snippets.

Daniel Murfet dmurfet

Block or report user

Report or block dmurfet

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
@dmurfet
dmurfet / talk-s2-2019.md
Last active Aug 2, 2019
Plan for 2019 S2 seminar
View talk-s2-2019.md

S2 2019

According to the history of logic in the Encyclopaedia Britannica, logic emerged from the study of philosophical arguments, and the realisation that were general patterns by which one could distinguish valid and invalid forms of argumentation. The systematic study of logic was begun by Aristotle, who established a system of formal rules and strategy for reasoning. The use of the word strategy is intentional:

The practice of such techniques in Aristotle’s day was actually competitive, and Aristotle was especially interested in strategies that could be used to “win” such “games.” Naturally, the ability to predict the “answer” that a certain line of questioning would yield represented an important advantage in such competitions. Aristotle noticed that in some cases the answer is completely predictable—viz., when it is (in modern terminology) a logical consequence of earlier answers. Thus, he was led from the study of interrogative techniques to

@dmurfet
dmurfet / opt_alg.md
Last active May 9, 2019
Optimisation algorithms
View opt_alg.md

Optimisation algorithms for deep RL

The optimisation algorithm used in most of DeepMind's deep RL papers is RMSProp (e.g in the Mnih et al Atari paper, in the IMPALA paper, in the RL experiments of the PBT paper, in the Zambaldi et al paper). I have seen speculation online that this is because RMSProp may be well-suited to deep learning on non-stationary distributions. In this note I try to examine the RMSProp algorithm and specifically the significance of the epsilon hyperparameter. The references are

Often in the literature RMSProp is presented as a variation of AdaGrad (e.g. in the deep learning textbook and in Karpathy's class). However, I think this is misleading, and that the explanation in Hinton's lecture is (not surprisingl

@dmurfet
dmurfet / working-ainfmf.md
Last active Mar 20, 2019
Working notes for "Constructing A-infinity categories of matrix factorisations"
View working-ainfmf.md

Constructing A-infinity categories of matrix factorisations

I am making publicly available my hand-written working notes for the paper "Constructing A-infinity categories of matrix factorisations" in the same spirit that I made available the other notes on my webpage The Rising Sea. Obviously you should not expect these notes to be as coherent, or readable, as the final paper, but those marked on the first page as (checked) are indeed checked, to the same level of rigour that I apply to any of my published papers. And they often contain more details than the paper. I hope you find them useful!

Notes directly used in writing the paper

The main references, written in the same notation and from the same outlook as the final paper, are given below. You should probably start with (ainfmf28). Some of these PDF files are large, you have been warned.

@dmurfet
dmurfet / growing-comprehension.md
Last active Jan 13, 2019
Growing Comprehension
View growing-comprehension.md

Growing Comprehension

In early 2019 I decided to try to understand the University of Melbourne a little better. I have recorded some observations here in case they are useful for other academics. The notes are taken from various University of Melbourne (UoM) official documents, primarily

To a first approximation, if you want to understand the University I think you should read the report, ignore the glossy bits, and pay close attention to the statistics on p.13 and the financial data reported beginning on p.124. All references in this section are to the report, unless specified otherwise.

  • (Student Demographics) The percentage of international students has increased from 28.9% in 2013 to 39.8% in 2017. The overall number of students has increased from 40,455 in 2013 (median ATAR 94.30) to 50,270 in 2017 (median ATAR 93.65). Australian Te
View supervision-owen.md

Notes

The rough area at the moment is moduli of A-infinity structures in geometry.

  • Homological algebra, category theory
    • General category theory (Borceux, Mitchell, Stenstrom, Maclane-Moerdijk)
    • General homological algebra (Weibel, Hilton-Stammbach)
    • Hochschild homology and cohomology (Loday, Lipman)
    • Coalgebras (Sweedler)
    • Triangulated categories (Neeman)
@dmurfet
dmurfet / supervision.md
Last active Sep 14, 2018
Philosophy of supervision
View supervision.md

Some thoughts on supervision

As a PhD student you are optimising for a goal with a long time horizon (in the first case to complete a PhD, but then perhaps also to obtain a permanent research position, which could take much longer) and it is hard to determine the correlation between any given intermediate action and eventual success (whatever you define that to be, but two large components could be prove beautiful theorems and get a job). This brute fact lies at the root of much stress and uncertainty. How does one prove beautiful theorems? How does one get a job?

Well, who knows, but certainy not by trying to directly optimise for a goal with a decade long time horizon, and this degree of uncertainty! You have to develop shorter term proxy goals, and it seems to me that part of the job of a supervisor is to assist in that development. If you want to prove beautiful theorems and get a job, then since it is difficult to infer from first principles the algorithm for doing either of those things, a r

@dmurfet
dmurfet / mast30026-student-interest.md
Last active Aug 10, 2018
MAST30026 Student areas of interest
View mast30026-student-interest.md

Student areas of interest MAST30026 S2 2018

  • Physics, pure and applied maths, chemistry
  • Computer science, AI, physics
  • Physics
  • Pure math, fluid mechanics
  • Mathematical physics, puremaths
  • Physics, quantum physics, abstract algebra, category theory
  • Physics
  • Pure math, applied math, biology
@dmurfet
dmurfet / synthesis.md
Last active Dec 5, 2018
Spaces of programs
View synthesis.md

Spaces of programs and synthesis

The practical development of deep learning and its associated infrastructure has initiated a broad re-examination of the practice of computer programming. In this document we briefly survey how this discussion has evolved over the past few years, and then describe our point of view on the underlying mathematics.

Program synthesis

We begin with some appeals to authority, in the form of the following references:

  1. P. Norvig, "Deep Learning and Understandability versus Software Engineering and Verification", March 2016.
  2. P. Norvig, "As we may program", May 2017.
@dmurfet
dmurfet / Videos
Last active Jun 10, 2019
Interesting videos on AI
View Videos
General
=======
https://www.youtube.com/watch?v=1X7Koxx4qJE (from 16:40 Hassabis on why DeepMind is unusual)
https://www.youtube.com/watch?v=PW09L6-75ig (Shklyarov)
Higher education
================
https://www.youtube.com/watch?v=yUGn5ZdrDoU (Clayton Christensen on disruption in higher ed)
@dmurfet
dmurfet / usinggit.md
Last active Dec 3, 2016
Using Git and GitHub for collaboration on writing scientific papers
View usinggit.md

Getting started

First you'll have to install the Git command line tool on your machine, following these instructions. Then find the repository that you want to contribute to, copy its address from the green "Clone or Download" button, and on your local machine run e.g.

git clone https://github.com/dmurfet/difflinearlogic.git

Committing changes

To see a list of what has changed (optional) run git status. Then

You can’t perform that action at this time.