IPB

Welcome Guest ( Log In | Register )

ABC/HR for Java 0.5a released
schnofler
post Mar 6 2005, 16:47
Post #1


Java ABC/HR developer


Group: Developer
Posts: 175
Joined: 17-September 03
Member No.: 8879



I've just released a new version of ABC/HR for Java. You can get it here:

Binary
Sources

You'll need the JRE 1.5 to run this (download here).
To start the application just click the abchr.jar (on Windows) or run "java -jar abchr.jar" on a command line.

Improvements include better sound output routines, a new ABX component in ABC/HR tests and easier test setup (see next post for details).

This post has been edited by schnofler: Mar 24 2005, 10:04
Go to the top of the page
+Quote Post
 
Start new topic
Replies
schnofler
post Mar 6 2005, 20:03
Post #2


Java ABC/HR developer


Group: Developer
Posts: 175
Joined: 17-September 03
Member No.: 8879



QUOTE (ff123)
The standalone ABX module doesn't allow one the option of "training" or "testing", which I think would be good.

Yes, I'll probably put that in sometime.

QUOTE (ff123)
A complete (but more complex) ABX module would also take into consideration type II error risks, but I think for codec testing, maybe that's an unneccessary complication. See my 1.1 beta 2 version for what that would add to the ABX screen:

Yes, I was aware of your implementation. After all, that's where I copied the idea from tongue.gif . In the end, I decided against showing (and trying to control) type II error, because I think it can give false impressions. As far as I can see, contrary to type I error, the type II error can only sensibly be calculated, if the user participates. That is, he has to make a reasonable guess about the effect size, and then do his best to complete the ABX test successfully. If the test finishes with a very low type II error this can mean that the user really couldn't hear a difference. But it could also mean that the user just hit the buttons without listening to the samples. Calculation of type II error relies on the assumption that the user plays fair.

So, while an ABX test can effectively prove (with some amount of uncertainty) that the user did hear a difference, it cannot prove that he didn't, and I think displaying the type II error along with the type I error can give the false impression that an ABX test could establish the fact that there's no perceivable difference between two samples.

I don't mean to say that type II error is useless in codec testing, but I think it makes most sense in a situation where we can make a good estimation of effect size and can expect that the users really did serious testing. For example, after a group listening test, effect size can reasonably be taken to be the ratio of people who could hear a difference in a sample, and this can be used to calculate meaningful type II errors for some hypotheses on the data.

Or maybe I got that all wrong? (I don't actually know much about statistics)
Go to the top of the page
+Quote Post

Posts in this topic
- schnofler   ABC/HR for Java 0.5a released   Mar 6 2005, 16:47
- - rjamorim   Oh my. Some new development at last Thank-you ve...   Mar 6 2005, 16:52
- - schnofler   It has been a while since I released the last vers...   Mar 6 2005, 16:55
|- - rjamorim   QUOTE (schnofler @ Mar 6 2005, 12:55 PM)Pleas...   Mar 6 2005, 17:13
|- - schnofler   QUOTE (rjamorim @ Mar 6 2005, 08:13 AM)QUOTE ...   Mar 6 2005, 17:34
- - schnofler   QUOTE (rjamorim)Any hope of adding a XML -> TXT...   Mar 6 2005, 16:57
|- - rjamorim   QUOTE (schnofler @ Mar 6 2005, 12:57 PM)Tools...   Mar 6 2005, 17:06
- - schnofler   QUOTE Hrm... it won't work with my Multiformat...   Mar 6 2005, 17:23
|- - rjamorim   QUOTE (schnofler @ Mar 6 2005, 01:23 PM)See m...   Mar 6 2005, 17:33
- - schnofler   QUOTE (rjamorim)I also noticed decrypting key file...   Mar 6 2005, 17:37
|- - rjamorim   QUOTE (schnofler @ Mar 6 2005, 01:37 PM)If yo...   Mar 6 2005, 17:42
|- - schnofler   QUOTE (rjamorim @ Mar 6 2005, 08:42 AM)I...   Mar 6 2005, 18:03
- - ff123   Very nice. I rarely hear more than a small click ...   Mar 6 2005, 18:40
- - schnofler   QUOTE (ff123)The standalone ABX module doesn't...   Mar 6 2005, 20:03
- - guruboolez   I've noticed some bugs: when I restart a te...   Mar 12 2005, 08:28
- - schnofler   Thank you very much for your extensive testing, gu...   Mar 12 2005, 16:32
- - guruboolez   I've also noticed something weird yesterday: ....   Mar 13 2005, 14:38
|- - schnofler   QUOTE (guruboolez @ Mar 13 2005, 05:38 AM)I...   Mar 13 2005, 15:32
- - cabbagerat   QUOTE (guruboolez @ Mar 13 2005, 05:38 AM)I...   Mar 13 2005, 15:10
- - lotr   I have a problem with mp3 files. It says the file ...   Mar 23 2005, 00:50
|- - Skythus   QUOTE (lotr @ Mar 22 2005, 11:50 PM)I have a ...   Mar 23 2005, 04:38
|- - schnofler   QUOTE (Skythus @ Mar 22 2005, 07:38 PM)QUOTE ...   Mar 23 2005, 18:11
- - lotr   I put madplay.exe in the abchr directory, but I st...   Mar 23 2005, 22:42
|- - schnofler   QUOTE (lotr @ Mar 23 2005, 01:42 PM)I put mad...   Mar 24 2005, 00:03
- - lotr   Ok, this is strange. If I install abchr on my desk...   Mar 24 2005, 01:38
- - guruboolez   I have the same problem. I can decode flac files w...   Mar 24 2005, 08:29
- - schnofler   QUOTE (lotr)Ok, this is strange. If I install abch...   Mar 24 2005, 10:07
- - lotr   Thank you Schnofler! It works fine now. The se...   Mar 24 2005, 13:44
- - ff123   schnofler: http://www.hydrogenaudio.org/forums/in...   Mar 24 2005, 15:45
- - guruboolez   mp3 decoding works correctly now. There's sti...   Mar 30 2005, 20:36
- - schnofler   Yes, I saw that bug before. Another solution is to...   Mar 30 2005, 21:03
- - rjamorim   Hey, schnofler So, any news? Is it stable enough ...   Jun 2 2005, 04:19
- - guruboolez   I've a problem with alpha5. I've recently ...   Jun 22 2005, 11:27


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 21st September 2014 - 04:10