Skip to content

Instantly share code, notes, and snippets.

View janvv's full-sized avatar

Jan janvv

View GitHub Profile
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@janvv
janvv / gist:acb875d53e3f31e58a65ca1f53d70b83
Created November 5, 2017 23:13
Bayesian Treatment of the Predictive Distribution
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Background\n",
"In one of the previous posts, we looked at the maximum likelihod estimate (MLE) for a linear regression model. Instead of using the deterministic model directly, we have also looked at the predictive distribution. In the previous post, we used this stoachstic model to include information about the data uncertainty into the prediction process. \n",
"When using the MLE paramter (or the least square estimate in the case of a linear model), all other parameters with smaller likelihood are automatically being discarded. This is problematic because the maximum likelihood parameter, must not be necessarily be correct or even be close to the true parameter value. It simply has the highest data likelihood for the given data. If we have little data points, supporting our hypothesis, the likelihood function becomes very flat. Then, other parameters show very similar likelihood values and the true parameter mig
@janvv
janvv / Predictive+Distribution+of+the+Least+Square+Estimate.ipynb
Last active October 15, 2017 19:33
Predictive Distribution of the Least Square Estimate
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@janvv
janvv / Data+Likelihood.ipynb
Last active May 6, 2021 23:05
Numerical Maximum Likelihood Estimation
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.