Welcome Guest ( Log In | Register )

listening tests help, for an audio codec I developed
post Jun 18 2005, 19:51
Post #1

Group: Members
Posts: 175
Joined: 5-March 05
From: Morelia, Mexico
Member No.: 20386

How can I rate how good or bad will the audio codec be on average?

I'm thinking on doing at least 21 ABX trials on each file and if the subject managed to tell a difference and the guess probability is low I'd also take into account a 1-5 point scale to measure the perceived quality.

So far I have analized one subject, he did pretty well on most tests, except one, where the results where these:
15 out of 29, pval = 0.500

AFAIK, p<0.05 is good to be certain that he didn't know by chance, what about the rest?
How do I interpret that?, is the codec transparent for him at that test?
What are the ranges of the guess probabilities and how should I interpret them?

Thanks in advance.

This post has been edited by Luis G: Jun 18 2005, 19:52

Home page: http://lc.fie.umich.mx/~legg/indexen.php
Go to the top of the page
+Quote Post
Start new topic
post Jun 19 2005, 19:39
Post #2

Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420

Good point smile.gif
I have to be more specific. Are such tests valid (I mean: statistically) or, more precisely, have both kind of tests the same level of validity?

I'm asking because I'm used to publish the results of my test, and always try to avoid criticism. I just fear that a big listening test including 50 or 100 samples without ABX confrontation will be contested. Should I keep this kind of test for private and favour ABX for public one, or would you consider more interesting the publication of ABC/HR only listening test involving much more samples?
Go to the top of the page
+Quote Post

Posts in this topic

Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:


RSS Lo-Fi Version Time is now: 31st January 2015 - 06:47