Skip to content

Instantly share code, notes, and snippets.

@inkredabull

inkredabull/ab_testing_requirements.md

Last active January 4, 2016 03:39
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save inkredabull/8562820 to your computer and use it in GitHub Desktop.
Save inkredabull/8562820 to your computer and use it in GitHub Desktop.
Download ZIP
A/B Testing Solution Requirements
Raw
ab_testing_requirements.md

For Rails

(No warranty provided on information accuracy; corrections appreciated.)

Vanity A/Bingo Bandit Split
Provides mechanism to see which experiment is assigned to which user for analytics purposes out-of-the-box x
Easy to install x x x x
Well-written dev docs x x x
Allows for weighted assignment (percentages) of experiment variations * x x
Supports use of a bandit algorithm x x x x
Has ready-made analytics dashboard x x x x
Updated in last six months x x
Allows for setting variation via URL for testing ? x x
Captures time when experiment was assigned
  • : not explicitly supported but achievable

For Django

(No warranty provided on information accuracy; corrections appreciated.)

Gargoyle
Supported for 1.6 No
Provides mechanism to see which experiment is assigned to which user for analytics purposes out-of-the-box
Easy to install
Well-written dev docs
Allows for weighted assignment (percentages) of experiment variations
Supports use of a bandit algorithm
Has ready-made analytics dashboard
Updated in last six months
Allows for setting variation via URL for testing
Captures time when experiment was assigned
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment