Skip to main content

Notice

Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Topic: Quality of Decoders in Audio Players (Read 10869 times) previous topic - next topic
0 Members and 1 Guest are viewing this topic.

Quality of Decoders in Audio Players

Have the decoders in the most popular audio players (Winamp, foobar2000, AIMP, iTunes...) ever been tested and have these tests been posted online?

What are some of the ways used to determine the quality of a particular decoder?

P. S. I'm posting this topic here according to greynol's advice. 

Quality of Decoders in Audio Players

Reply #1
Have the decoders in the most popular audio players (Winamp, foobar2000, AIMP, iTunes...) ever been tested and have these tests been posted online?

What are some of the ways used to determine the quality of a particular decoder?

P. S. I'm posting this topic here according to greynol's advice. 


There are several ways to test decoders. Use search and you will find plenty of topics about decoders.

Quality of Decoders in Audio Players

Reply #2
I was actually wondering whether someone has tested the latest versions of these applications.

Quality of Decoders in Audio Players

Reply #3
The reason that you won't find much in the way of testing of decoders is that a decoder pretty much either works or it doesn't. Writing decoder software is actually fairly trivial, at least compared to writing an encoder. The ultimate test of a decoder is that it decodes to pcm audio with an error of no more than one lsb.

Are any of the decoders that you mentioned broken? Not that I am aware of. Will any of them ever produce data that is audibly different from the others? Not very likely.




Quality of Decoders in Audio Players

Reply #7
Quote
Is he a member of this message board?


Yes and he is into audio research. He put forth the original ReplayGain proposal. I have read some of his white papers on a number of different topics before in the past. I highly recommend them for the technical minded. 
budding I.T professional


Quality of Decoders in Audio Players

Reply #9
We should ask 2Bdecided (author of those test results) if he has any later data.
I don't, sorry. I don't even have the files from those tests.

They are simple enough to do, but quite time consuming unless you automate them (I didn't).

e.g. the "sound quality" part...
http://mp3decoders.mp3-tech.org/objective.html
explains how it was done...
Quote
A wave file was created containing music, noise, test tones, silence, dither etc. It was encoded by each encoder, giving 8 mp3 files. Each of these files was decoded by each of the decoders, yielding a total of 216 wave files, 27 from each mp3 file. Each decode from a particular mp3 file was compared with every other decode from that file, by taking the difference between the two files. This gives 729 comparisons per mp3 file, or 5832 in all! Thankfully, trends soon became apparent, and most of these could be skipped.

Examining how the various decodes compared, certain things became obvious. Some decoders gave results that didn't match any of the others. mp3 to wave v1.04 wouldn't synchronise with any of the other decoders, and it was found to be skipping samples. Only two decoders were found to be identical (CEP FhG and Winamp 2.22). Sonique 1.51 always skipped near the start of the file. The difference between l3dec and Winamp 2.22 was only 1-bit, a few times per second - both were clearly based on the same decoding algorithm, but rounding at different points. The difference between Ultra Player, lame, and the Winamp mpg123 plug-in was similar, indicating that these three also had a common origin to each other (mpg123). However, the difference between the l3dec group and the mpg123 group was consistently a 1 sample signal which sounded like the original signal (but obviously very much quieter!). Which one of these two groups is more "correct" it is impossible to say, but for simplicities sake, l3dec was chosen as a reference, and all the other decoders were judged against it. This comparison yields the results shown in the above table. Had lame been chosen as a reference, the straight 6 and 7 results would be reversed, but all others would remain the same.
FWIW I subsequently decided that the l3dec "family" was objectively more accurate than the mpg123 family, at least with the samples I could generate. mp3 encoding dramatically alters the signal, but by using simple signals and high bitrates, I found that the l3dec decode was closer to the original .wav than the mpg123 decode. (IIRC - it was a long time ago!). The difference between scoring "6" and "7" in the objective tests is all in the LSB, so this really is splitting hairs.

Cheers,
David.

Quality of Decoders in Audio Players

Reply #10
Wow!!! That's what I call dedication.


Quality of Decoders in Audio Players

Reply #12
Would it be a problem to test the others as well, possibly when the new version of foobar2000 and possibly Winamp comes out?