IPB

Welcome Guest ( Log In | Register )

New version of statistical analysis tool, Removes some limitations, normality assumption
Garf
post Feb 3 2011, 20:54
Post #1


Server Admin


Group: Admin
Posts: 4884
Joined: 24-September 01
Member No.: 13



Some time ago I needed an analysis of some test results and tried to use the bootstrap utility we have used for the listening tests. Unfortunately, the results coming out were bogus. I traced it down to an obscure 64-bit compatibility issue, but going through the code some things bothered me. ff123 improved my initial version significantly, but one of the things that was done was to use a normal distribution approximation for test statistics. If you consider the original version of the utility was exactly written to avoid any assumptions about normality, that's a bit sad.

So I ended up rewriting the whole thing and fixing all outstanding issues. The new version:

  • Works correctly on 64-bit systems
  • Removed all arbitrary limitations of number of samples, codecs, ...
  • p-values are estimated through Monte Carlo resampling instead of normal distribution approximation
  • Blocked and non-blocked analysis fully supported
  • Comparison based on median instead of means supported
  • Possible to (only) compare all samples against the first one
  • Much slower because it's in Python (v2.5+ required)


This is new so it might still contain some bugs. Any feedback appreciated.

Download page
Go to the top of the page
+Quote Post

Posts in this topic


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 22nd August 2014 - 05:15