Skip to content

Instantly share code, notes, and snippets.

@agos4
agos4 / results_interpreter_normalised_metrics.csv
Created October 13, 2025 11:02
Link to .csv file which has normalised the metrics of a highly successful web experiment
metric segment control variant delta_abs delta_pct ci_low ci_high p_value n direction note
What we measured Who we looked at Old version New version Change (points) Change (%) Low estimate (%) High estimate (%) P-value People counted (n) Direction Notes
Signup rate All 0.045 0.0509 0.0059 13.1 7.0 15.0 0.002 347902 up
Signup rate SMB 0.055 0.0638 0.0088 16.0 10.0 20.0 0.001 92105 up
Signup rate Enterprise 0.032 0.0342 0.0022 6.9 3.0 10.0 0.008 151044 up
CTR All 0.12 0.125 0.005 4.2 2.0 6.0 0.006 347902 up
CTR SMB 0.14 0.147 0.007 5.0 3.0 8.0 0.004 92105 up
CTR Enterprise 0.09 0.0927 0.0027 3.0 1.0 6.0 0.015 151044 up
Trial start (from signup) All 0.28 0.292 0.012 4.3 2.0 6.0 0.01 17047 up
Trial start (from signup) SMB 0.32 0.339 0.019 5.9 3.0 9.0 0.009 5671 up