Skip to content

Instantly share code, notes, and snippets.

View madvn's full-sized avatar

Madhavun madvn

View GitHub Profile
@madvn
madvn / entropy_benchmark.py
Last active July 1, 2019 21:21
Infotheory benchmarks - entropy
###############################################################################
# Entropy baseline
#
# Madhavun Candadai
# Dec, 2018
#
# Entropy of a coin flip for different probabilities of HEADS ranging from 0 to
# 1 should give an inverted-U shaped curve
###############################################################################
@madvn
madvn / mi_demo.cpp
Last active July 1, 2019 21:20
A C++ demonstration of using #infotheory to estimate mutual information between two variables
//**************************************************************************//
// Infotheory demo to estimate MI between two 2D random vars
// https://github.com/madvn/infotheory
//
// C++ demo
//
// Madhavun Candadai
// Nov 2018
//
//**************************************************************************//
@madvn
madvn / mi_demo.py
Last active February 2, 2019 15:35
A Python demonstration of using ''infotheory'' to estimate mutual information under various conditions
###############################################################################
# Mutual Information demo for Python package - infotheory
# https://github.com/madvn/infotheory
#
# Madhavun Candadai
# Dec, 2018
#
# Mutual information should be high for identical variables, slightly lower for
# noisy identical variables and low for random variables
###############################################################################