IPB

Welcome Guest ( Log In | Register )

Multiformat Listening Test @ 128 kbps - FINISHED
Sebastian Mares
post Jan 14 2006, 22:01
Post #1





Group: Members
Posts: 3633
Joined: 14-May 03
From: Bad Herrenalb
Member No.: 6613



The much awaited results of the Public, Multiformat Listening Test @ 128 kbps are ready.

Here is the results page: http://www.maresweb.de/listening-tests/mf-128-1/results.htm



Edit 1: A description of the mentioned Nero problem can be found here: http://www.maresweb.de/nero-problem

Edit 2: For people who want to decrypt their results, here are the encoder IDs:

1 = iTunes
2 = LAME
3 = Nero
4 = Shine
5 = AoTuV
6 = WMA Professiona

This post has been edited by Sebastian Mares: Jan 14 2006, 23:57


--------------------
http://listening-tests.hydrogenaudio.org/sebastian/
Go to the top of the page
+Quote Post
 
Start new topic
Replies
guruboolez
post Jan 14 2006, 22:32
Post #2





Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420



Great job to everyone who participated to the test - especially to the conducer!

The first immediate lesson of this test is that ~132...135 kbps main encoders are very, very good. Even LAME at -V5 is close to transparency. I hope that -V2/--preset standard will progressively cease to be the automatic recommendation when new members are asking for good quality MP3 encodings: the first step to excellency is below the historical presets!

Developers must be celebrated: Apple's and Nero's developers for leading AAC to the best places; Aoyumi for having resurrecting Vorbis; Microsoft's developers for -at last- offering a very good encoding and free encoding tool; and of course the whole LAME team who are making MP3 better and better even if people are sometimes not realizing it or believing that MP3 couldn't be improved!

Last, people could compare the collective results to my individual test. I've conclude on aoTuV and iTunes superiority, with both Nero and LAME slightly lower. The group results are concluding on exactly the same order, with only less significance and an higher notation. It looks that my hearing thus my listening tests may be very representative from the group's one smile.gif

This post has been edited by guruboolez: Jan 15 2006, 01:35
Go to the top of the page
+Quote Post
Shade[ST]
post Jan 14 2006, 22:38
Post #3





Group: Members
Posts: 1189
Joined: 19-May 05
From: Montreal, Canada
Member No.: 22144



The URL in the image is incorrect (www.maresweb.de/nero-problem.txt) -- might as well make the redirect at /nero-problem, too, anyways...

In any case, It's a shame I misunderstood the testing scenario : I did not know I needed to ABX the codecs before rating them :-/

All my results are invalid :-(

However, it's surprising to learn that all popular codecs around 128 kbps are of high enough quality to be practically imperceptible to everyone.

Great!

edit : de / net, whatever.

This post has been edited by Shade[ST]: Jan 14 2006, 22:41
Go to the top of the page
+Quote Post
Sebastian Mares
post Jan 14 2006, 22:41
Post #4





Group: Members
Posts: 3633
Joined: 14-May 03
From: Bad Herrenalb
Member No.: 6613



QUOTE (Shade[ST] @ Jan 14 2006, 10:38 PM)
The URL in the image is incorrect (www.maresweb.net/nero-problem.txt) -- might as well make the redirect at /nero-problem, too, anyways...
*


maresweb.de is the correct domain. .net and .org are only redirecting to the .de domain. Also, I tested the URL from the picture and Apache redirects the users to the correct file. No problem I guess. smile.gif

QUOTE (Shade[ST] @ Jan 14 2006, 10:38 PM)
In any case, It's a shame I misunderstood the testing scenario : I did not know I needed to ABX the codecs before rating them :-/

All my results are invalid :-(

However, it's surprising to learn that all popular codecs around 128 kbps are of high enough quality to be practically imperceptible to everyone.

Great!
*


No, no, no... You don't have to ABX all files. ABX logs are only required when you ranked a reference.
IIRC, I used a large part of your results. smile.gif

And BTW, this was a funny result:

CODE
ABC/HR for Java, Version 0.5b, 06 december 2005
Testname: DontLetMeBeMisunderstood

Tester:

1R = Sample05\DontLetMeBeMisunderstood_1.wav
2L = Sample05\DontLetMeBeMisunderstood_2.wav
3L = Sample05\DontLetMeBeMisunderstood_3.wav
4L = Sample05\DontLetMeBeMisunderstood_6.wav
5R = Sample05\DontLetMeBeMisunderstood_4.wav
6R = Sample05\DontLetMeBeMisunderstood_5.wav

---------------------------------------
General Comments: Focus on 4.16 - 6.46
---------------------------------------
1L File: Sample05\DontLetMeBeMisunderstood.wav
1L Rating: 4.8
1L Comment:
---------------------------------------
5L File: Sample05\DontLetMeBeMisunderstood.wav
5L Rating: 1.0
5L Comment:
---------------------------------------

ABX Results:


--------------------
http://listening-tests.hydrogenaudio.org/sebastian/
Go to the top of the page
+Quote Post

Posts in this topic
- Sebastian Mares   Multiformat Listening Test @ 128 kbps - FINISHED   Jan 14 2006, 22:01
- - minisu   Great job! *goes decrypting*   Jan 14 2006, 22:05
- - Ivan Dimkovic   Just a quick info regarding the Nero bug - unfortu...   Jan 14 2006, 22:11
- - skelly831   Wow! awesome results, it's interesting to ...   Jan 14 2006, 22:18
- - ff123   How about making a hyperlink to the page describin...   Jan 14 2006, 22:21
- - Sebastian Mares   By the way, results that were invalid (didn't ...   Jan 14 2006, 22:22
|- - sehested   QUOTE (Sebastian Mares @ Jan 14 2006, 01:22 P...   Jan 15 2006, 04:22
- - guruboolez   Great job to everyone who participated to the test...   Jan 14 2006, 22:32
|- - Shade[ST]   The URL in the image is incorrect (www.maresweb.de...   Jan 14 2006, 22:38
|- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:3...   Jan 14 2006, 22:41
|- - Shade[ST]   QUOTE (Sebastian Mares @ Jan 14 2006, 03:41 P...   Jan 14 2006, 22:45
|- - fpi   QUOTE (Sebastian Mares @ Jan 14 2006, 03:41 P...   Jan 14 2006, 23:26
|- - sehested   QUOTE (Sebastian Mares @ Jan 14 2006, 01:41 P...   Jan 15 2006, 02:26
- - Sebastian Mares   By the way, Francis noticed another problem. The s...   Jan 14 2006, 22:37
- - Lyx   Pointing out an old issue with listening-test pres...   Jan 14 2006, 22:38
|- - Shade[ST]   Also a question / comment. Is Itunes' encoder...   Jan 14 2006, 22:42
- - minisu   Ok, so this is one of my decrypted results... http...   Jan 14 2006, 22:45
|- - Shade[ST]   More comments : http://www.maresweb.de/listening-t...   Jan 14 2006, 22:49
|- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:4...   Jan 14 2006, 22:51
- - Sebastian Mares   QUOTE (Shade[ST] @ Jan 14 2006, 10:4...   Jan 14 2006, 22:50
|- - Shade[ST]   QUOTE (Sebastian Mares @ Jan 14 2006, 03:50 P...   Jan 14 2006, 23:31
- - IgorC   First of all great test. Thanks, Sebastian. Howev...   Jan 14 2006, 23:29
|- - guruboolez   QUOTE (IgorC @ Jan 14 2006, 11:29 PM)I've...   Jan 14 2006, 23:45
|- - IgorC   QUOTE (guruboolez @ Jan 14 2006, 02:45 PM)the...   Jan 14 2006, 23:49
- - Sebastian Mares   Ah, damn, you're right. Now I see what you guy...   Jan 14 2006, 23:30
- - JeanLuc   Damn ... looking at the bitrate table and regardin...   Jan 14 2006, 23:46
- - Sebastian Mares   QUOTE (fpi @ Jan 14 2006, 11:26 PM)QUOTE (Seb...   Jan 14 2006, 23:56
|- - kwanbis   QUOTE (Sebastian Mares @ Jan 14 2006, 10:56 P...   Jan 15 2006, 00:18
|- - Sebastian Mares   QUOTE (kwanbis @ Jan 15 2006, 12:18 AM)i agre...   Jan 15 2006, 00:26
|- - kwanbis   QUOTE (Sebastian Mares @ Jan 14 2006, 11:26 P...   Jan 15 2006, 00:54
- - kwanbis   could a ranking based on rating and bitrate be mad...   Jan 15 2006, 00:13
- - mdmuir   When are we reaching the point that further tests ...   Jan 15 2006, 00:13
|- - kwanbis   QUOTE (mdmuir @ Jan 14 2006, 11:13 PM)When ar...   Jan 15 2006, 00:15
|- - guruboolez   QUOTE (mdmuir @ Jan 15 2006, 12:13 AM)When ar...   Jan 15 2006, 00:23
|- - Halcyon   Thanks for the results and work everyone! I c...   Jan 15 2006, 00:35
- - vinnie97   Vorbis' place at the top correlates with it be...   Jan 15 2006, 01:00
- - richard123   Do these results help answer the question: Are the...   Jan 15 2006, 02:50
- - westgroveg   Does the results page state what settings where us...   Jan 15 2006, 03:13
|- - Serge Smirnoff   SoundExpert preliminary results on the same conten...   Jan 15 2006, 03:24
- - Pio2001   Thank you for the results. I was Anon08. Here are ...   Jan 15 2006, 05:47
- - plonk420   i only got thru 10 of the tracks.... but i could o...   Jan 15 2006, 08:27
- - Raptus   Pio, have you automated somehow the process of com...   Jan 15 2006, 08:43
|- - Pio2001   QUOTE (Raptus @ Jan 15 2006, 09:43 AM)Pio, ha...   Jan 15 2006, 11:53
- - Raptus   As I stated in the other topic, I was not very hap...   Jan 15 2006, 09:35
- - Sebastian Mares   QUOTE (westgroveg @ Jan 15 2006, 03:13 AM)Doe...   Jan 15 2006, 10:00
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 01:00 A...   Jan 15 2006, 10:06
- - Garf   On the total results: how much % of the gradings g...   Jan 15 2006, 10:28
- - sehested   Is there a way to see your own results, including ...   Jan 15 2006, 10:31
- - Sebastian Mares   QUOTE (Garf @ Jan 15 2006, 10:28 AM)On the to...   Jan 15 2006, 10:58
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 01:58 A...   Jan 15 2006, 11:10
||- - Sebastian Mares   QUOTE (sehested @ Jan 15 2006, 11:10 AM)QUOTE...   Jan 15 2006, 11:29
|- - Garf   QUOTE (Sebastian Mares @ Jan 15 2006, 11:58 A...   Jan 15 2006, 15:29
- - Sebastian Mares   I received a total of 467 results. Since only 403 ...   Jan 15 2006, 12:25
- - Sebastian Mares   BTW, could someone post the results to Doom9?   Jan 15 2006, 12:45
- - halb27   Wonderful results!   Jan 15 2006, 12:48
- - guruboolez   It may be interesting to observe the performance...   Jan 15 2006, 13:00
- - sehested   Managed to decode my own results: CODE           ...   Jan 15 2006, 13:15
- - Sebastian Mares   What was the mail address you used for testing (yo...   Jan 15 2006, 13:47
- - SirGrey   Thanks for working on the test, Sebastian. As for ...   Jan 15 2006, 13:48
- - Sebastian Mares   sehested, you are anon10. I used your results fo...   Jan 15 2006, 13:55
|- - sehested   QUOTE (Sebastian Mares @ Jan 15 2006, 04:55 A...   Jan 15 2006, 14:18
- - Sebastian Mares   By the way... People who did not enter their (nick...   Jan 15 2006, 14:00
- - bond   thx again for this interesting test, sebastian...   Jan 15 2006, 14:52
|- - minisu   QUOTE (bond @ Jan 15 2006, 03:52 PM)thx again...   Jan 15 2006, 15:05
|- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 02:52 PM)thx again...   Jan 15 2006, 15:12
- - bond   your statement doesnt make any sense for me. what ...   Jan 15 2006, 15:13
|- - guruboolez   QUOTE (bond @ Jan 15 2006, 03:13 PM)your stat...   Jan 15 2006, 15:42
|- - bond   QUOTE (guruboolez @ Jan 15 2006, 04:42 PM)QUO...   Jan 15 2006, 15:46
|- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 03:46 PM)QUOTE (gu...   Jan 15 2006, 15:57
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 04:57 P...   Jan 15 2006, 16:00
- - yulyo!   When can we see the final version of Nero's ne...   Jan 15 2006, 15:35
|- - bond   QUOTE (yulyo! @ Jan 15 2006, 04:35 PM)I a...   Jan 15 2006, 15:40
- - Sebastian Mares   QUOTE (bond @ Jan 15 2006, 03:13 PM)well ok, ...   Jan 15 2006, 15:51
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 04:51 P...   Jan 15 2006, 15:55
- - Sebastian Mares   OK, results page now contains 3 final graphs: non-...   Jan 15 2006, 16:09
|- - bond   QUOTE (Sebastian Mares @ Jan 15 2006, 05:09 P...   Jan 15 2006, 16:13
- - yulyo!   Yes bond, it seems you're right. every time so...   Jan 15 2006, 16:11
|- - IgorC   QUOTE (yulyo! @ Jan 15 2006, 07:11 AM)Yes...   Jan 15 2006, 17:03
|- - guruboolez   QUOTE (IgorC @ Jan 15 2006, 05:03 PM)AAC is t...   Jan 15 2006, 17:27
||- - IgorC   QUOTE (guruboolez @ Jan 15 2006, 08:27 AM)QUO...   Jan 15 2006, 17:33
|||- - guruboolez   For HD-DVD or/and blu ray players AAC will be wis...   Jan 15 2006, 17:43
||- - Busemann   QUOTE (guruboolez @ Jan 15 2006, 08:27 AM)Tha...   Jan 15 2006, 17:59
||- - Mo0zOoH   QUOTE (Busemann @ Jan 15 2006, 07:59 PM)I wou...   Jan 15 2006, 18:07
|||- - Busemann   QUOTE (Mo0zOoH @ Jan 15 2006, 09:07 AM)And an...   Jan 15 2006, 18:21
|||- - guruboolez   QUOTE (Busemann @ Jan 15 2006, 06:21 PM)First...   Jan 15 2006, 18:28
|||- - Busemann   QUOTE (guruboolez @ Jan 15 2006, 09:28 AM)The...   Jan 15 2006, 18:30
||- - guruboolez   QUOTE (Busemann @ Jan 15 2006, 05:59 PM)QUOTE...   Jan 15 2006, 18:07
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 07:03 PM)Maybe so...   Jan 15 2006, 17:30
|- - IgorC   QUOTE (Mo0zOoH @ Jan 15 2006, 08:30 AM)How ma...   Jan 15 2006, 17:36
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 07:36 PM)I didn...   Jan 15 2006, 17:58
- - Alex B   I too would like to thank everyone who contributed...   Jan 15 2006, 16:56
- - yulyo!   IgorC: "I think it's not good idea for ci...   Jan 15 2006, 17:46
|- - bond   QUOTE (guruboolez @ Jan 15 2006, 06:43 PM)For...   Jan 15 2006, 17:51
|- - guruboolez   QUOTE (bond @ Jan 15 2006, 05:51 PM)aac isnt ...   Jan 15 2006, 17:58
|- - IgorC   QUOTE (guruboolez @ Jan 15 2006, 08:58 AM)So ...   Jan 15 2006, 18:09
|- - Mo0zOoH   QUOTE (IgorC @ Jan 15 2006, 08:09 PM)That...   Jan 15 2006, 18:11
|- - guruboolez   QUOTE (IgorC @ Jan 15 2006, 06:09 PM)QUOTE (g...   Jan 15 2006, 18:14
- - guruboolez   I just finished to download the Blu-Ray PDF. Suppo...   Jan 15 2006, 17:51
- - minisu   I don't like WMA, and not many players support...   Jan 15 2006, 17:55
- - bond   well it still shouldnt be forgotten that the ipod ...   Jan 15 2006, 18:07
2 Pages V   1 2 >


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 23rd November 2014 - 05:53