IPB

Welcome Guest ( Log In | Register )

MPC vs VORBIS vs MP3 vs AAC at 180 kbps, 2nd checkup with classical music
guruboolez
post Aug 21 2005, 19:33
Post #1





Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420



Preliminary notes


Last summer I performed a blind listening comparison between three different audio formats, all set for ~175 kbps encodings. The purpose of the test was to investigate about encoding quality with classical music (and only classical) and to see which format would be the most efficient (i.e. the closest to transparency at lowest bitrate possible) for this kind of music. As jumping-off place for bitrate I took MPC –standard preset which was indisputably recognized as the best encoding solution outputing at 175...190 kbps on average. And indeed, the test ended on musepack superiority. MPC was even superior to Vorbis and MP3 at presets presenting higher bitrate (~195 kbps for LAME, ~185 for Vorbis against ~175 for musepack). Consequently, MPC encodings appeared to sound better and to be smaller at the same time. Amazed by the existent gap between all contenders I conclude my specific test with these words: “I didn’t think that MPC –standard was so in advance”.

My vacation are now quite over. I performed during my free time a big checkup of lossy quality at 80 kbps and 96 kbps (this one has to be translated in english dry.gif ), and it’s too late now to complete the 128 kbps I planned to do in the same silly conditions (150+35 tested samples). But I used my small remaining time to do again the listening test at 175 kbps I did last year, with the same 18 samples and the same hardware.



Why doing again the same test?


As a result of constant evolution of most audio encoders I consider my previous results as really outdated. I recall that Vorbis encodings were done with MEGAMIX I (hybrid encoder melting aoTuV beta 2, Garf Tuned 2 and Quantum Knot tunings). This encoder didn't subsist for a long time... and doesn’t exist anymore; it was replaced by MEGAMIX II, then official 1.1 with Impulse Trigger Profile + Impulse Noisetune switches, which was finally followed by aoTuV beta 3 and beta 4. The same goes for LAME: 3.97 alpha 3 was tested, and during this time LAME developers have submitted eight new versions of this alpha and a few other ones (lame_may, lame_june...)! MPC has also changed: from 1.14 beta to 1.15 alpha which is now considered as safe to use.
As a consequence of this evolution, problems audible last years (kind of ringing for LAME, or noise and coarseness for Vorbis) may be corrected or at least be lowered. The first purpose of my test is therefore to check the outcomes of recent tunings done for high bitrate settings.

There’s also a second point which stimulated me to do again the test and this point is called AAC. I haven’t tested AAC last year for technical and moral reasons. Technically, iTunes encoder couldn’t be set to ~175 kbps; Apple's AAC encoder wasn't also gapless and is for my purpose unsuitable for my conception of artefact-free encodings. I also felt as dishonest the inclusion of Nero AAC: it had recognized issues with classical first and a new encoder supposed to solve these problems was announced as imminent. Some readers suggest me to include faac as competitor, but I felt as unfair to test an encoder which was probably not the state of the art of AAC format and to compare it to the most advanced implementation of other formats (MEGAMIX and LAME 3.97).
I never regret my choice. But this absence of AAC frustrated my curiosity for a long time, because I had strictly no idea about comparative performance of this format with other contenders. That’s why I decided to absolutely include AAC this time. WMAPro will also be tested this time if possible.

The purpose of my test is therefore to obtain a fresh photography of the current performance of all modern lossy formats with classical music using the most advanced implementations for each of them.


I. Choosing the encoders


My purpose being to test most advanced encoders the choice of format hasn't to be controversial for most of them:

MP3: LAME 3.97 alpha 11. Release date: July 2005. Note: --vbr-new encoding mode.
MPC: mppenc 1.15v. Release date: march 2005.
Vorbis: aoTuV beta 4. Release date: June 2005, updated in July 2005 (merged with SVN 1.1.1).
WMAPro: no choice here: it's 9.1 or nothing. Release date: during 2004.

Choosing the good AAC encoder is much harder:
Apple AAC: There's still no VBR mode with iTunes. Consequently it's currently impossible to use Apple's AAC encoder unless other contenders will output an average bitrate close to either 160 kbps or 192 kbps. It's unlikely...
Nero Digital AAC: the most advanced VBR AAC encoder and therefore better placed to represent the AAC format. Big problem: should I use the 'high' and defaulted encoder or rather the 'fast' one which is really better at lower bitrate with classical music? The first one is still recommended by all Nero's developers and it's a valid reason to choose it instead of something they don't consider as stable enough (Garf, JohnV and Ivan Dimokovic). But the situation has maybe changed since their recommendation; I wouldn't also discard too quickly the possibility of using an encoder working better for the difficulties proper to the musical genre I'll test. The debate could be endless if a trivial but objective argument hadn't close the debate: the average bitrate of VBR mode of both encoders (see below).
faac AAC: testing faac might also be interesting. And even for fun, it would give me the possibility to oppose four different open-source implementations of four different formats smile.gif But such friendly comparison has a price: increasing the onerousness of the test which is anything but easy at this bitrate...


II. Targeting a bitrate


The purpose of my test is not to see what encoders could do with xxx kbps for each sample; I don't plan to force each encoding reaching a precise bitrate. My purpose is to stay close to the real usage of a vast majority of listeners (if not all...): using for every encoding one fixed setting which should statistically corresponds on average to the desired bitrate. That's why it's really fundamental to precisely know the average bitrate corresponding to a defined preset. And there's only one way to get it: encoding several tracks or albums.
Last year, I used as reference ~20 classical (+3 non-classical) albums. This year, I decided to be more methodical. I’m now using 150 different tracks (I mean full tracks) coming from 150 different CD in order to increase the variety of encoded tracks. It’s important to note that I didn’t choose randomly those tracks. I meticulously worked to get a representative microcosm of my full classical library, balanced between different grand ensemble (vocal, orchestral, chamber, soloist recording). This collection is nothing more than the 150 full tracks from which I’ve extracted 150 short samples in order to build a “catalogue raisonné” of musical situations occurring with classical music (see this test).

I genuinely expect from this methodically constructed library to be a highly representative panel of my classical collection. My assumption could be verified by checking the average bitrate of the entire collection encoded with WavPack -fx5 (all my >1000 CD digital library is encoded with this preset): 642 kbps for the selection of 150 tracks against 635 kbps for a complete set of more than 15000 tracks. The deviation is inferior to 1%! blink.gif Statistics are really magical.


III. Observing bitrates


I started with MPC which must give the reference bitrate. All other competitors have to be set in order to get a similar value.


MPC: --quality 5 corresponds precisely to 184,54 kbps. This is higher from what I expected first (~175 kbps). The 150 reference tracks are maybe not as representative as supposed. I also tried 1.14 (used last year) with the same preset and --xlevel: 176,28 kbps, much closer to the native average bitrate of --standard profile and reassuring me about the representativity of my collection of tracks. The bitrate has therefore inflated by 4.7% from 1.14 to 1.15v with classical.
=> I'll therefore try to get from all other encoders a setting which outputs to 184,5 kbps ±2% (180,5...188,1 kbps).

MP3: I first tried -V2 --vbr-new, which corresponds to the former --preset fast standard. Average bitrate is 181,79 kbps. Now, this value is lower from what I estimated last year (and that's why I tested -V3 in addition to -V2)... Indeed, 3.97alpha3 -V2 would output to 192,99 kbps. Nice gain (-5.80%). Obviously LAME developpers also worked on efficiency. Gain is great enough that LAME --preset standard could now be fairly compared to MPC --standard. But I recall another time that it only applies for classical (I suppose that bitrate is higher with other musical suffering from sb21 issue).

Vorbis: aoTuV beta 4 -q6,00 leads to 181,48 kbps. This is lower than what I expected, and it's also lower than MPC --standard bitrate. I get 186,99 kbps for the old MEGAMIX I. Bitrate has therefore be lowered with latest aoTuV.
-q6,00 could therefore be directly compared to MPC --standard and LAME --preset fast standard (for classical music).

WMAPro: VBR75 leads to 150,24 kbps. The next available preset is VBR90 and it leads to 203,96 kbps. Both are very far for the range I fixed and consequently WMAPro can't compete in this test.

Nero Digital AAC: Like LAME and WMAPro Nero Digital doesn't offer any precise VBR scale but seven presets. -internet leads to ~142 kbps for both 'high' and 'fast' encoders. -streaming high corresponds to 176,14 kbps and -streaming fast to 193,33 kbps. Consequently none of them is inside the fixed range; the closest one is -streaming high and is therefore the less unacceptable solution (I recall that the 'high' encoder is still the recommended one).

faac AAC: this is the only encoder able to fit into the fixed bitrate range (thanks to the precise VBR scale alla vorbis & mpc). AAC faac –q 175 leads to 180,92 kbps. This –q setting won’t probably correspond to 180 kbps with other musical genre and that’s the occasion to recall another time that the whole test is specific to classical music and nothing else.


Recapitulative table

CODE
         bitrate_2004   bitrate_2005     evolution in kbps   ...in %

MPC          176,28         184,54            +8,26 kbps      +4,69 %
MP3          192,99         181,79           -11,20 kbps      -5,80 %  
Vorbis       186,99         181,48            -5,51 kbps      -2,95 %
AAC faac   not tested       180,92              --              --
AAC Nero   not tested       176,14              --              --


=> faac, LAME, aoTuV are very close each others (difference is inferior to 0,9 kbps!). MPC presents a higher bitrate (+3 kbps) and Nero Digital a lower one (-5 kbps). The gap between the extreme is worrying: approximately 5% corresponding to 8 kbps. That's not a huge difference but these eight missing kbps may lead to a significant difference in quality. I could discard Nero Digital for this test but I would consider this choice as a mistake. For my own curiosity I'm also very impatient to see how would perform an advanced implementation of AAC in comparison to other formats, even if bitrate are not fully comparable.

=> As a consequence I decided to test both Nero Digital AAC and faac AAC, and I will consider Nero Digital presence as a "bonus" interesting to watch rather than an entire competitor. That's why my final diagramme (plots) will graphically separate Nero AAC results from other contenders. I hope this will avoid unecessary debate about any kind of unfairness based on bitrate disparity.



SUMMARY

Are going to be test:

AAC: faac 1.24.1. Release date: end 2004 (?). Setting: -q175
AAC: Nero Digital aacenc32 v.3.2.0.15. Release date: June 2005. Setting: -streaming (high/default encoder).
MP3: LAME 3.97 alpha 11. Release date: July 2005. Setting: -V2 --vbr-new
MPC: mppenc 1.15v. Release date: march 2005. Setting: --quality 5
Vorbis: aoTuV beta 4 based on 1.1.1. Release date: July 2005. Setting: -q6,00



IV. Additional information


I performed all my last listening tests on a Creative Audigy 2 soundcard, which resamples everything to 48000 KHz. Some people consider that internal resampling (transparent in my opinion) is treating unfairly musepack and would biased any listening test. To cut the controversial short, I installed my (better) Terratec DMX6Fire 24/96 which doesn't resample 44100 KHz files (I'm not using it anymore for daily listening because of interference with my VIA chipset).

HARDWARE & SOFTWARE SETTINGS:

soundcard: Terratec DMX6Fire 24/96
headphone: BeyerDynamic DT-531
amp: Onkyo MT-5
software player: Java ABC/HR 0.5 beta 5.
software decoder: foobar2000 0.83 (in order to automatically get files free of offset and to solve my incompatibility issues occuring with Vorbis).

TESTING PRINCIPLES:

ABX phase : To limit the listening fatigue and to end the test before I left my appartment, I restricted the ABX tests to the most transparent encodings (note > 4.00).
Number of trials : eight trials as a minimum. I recall that schnofler's ABC/HR software doesn't reveal to score until the test is closed by the user (and it also can't be resume). Therefore the number of trails hasn't to be fixed: as long as score is hidden the pval isn't ruined. That's why I add more trials when I suspect bad results. I never exceed 16 trials: if something is really transparent I didn't persecute the encoding smile.gif
Notation : My notation was very severe last year, with a full dynamic range of notation (a lot of notes were inferior to 2.0). That's why I decided to add 10 points to each score (in order to disconnect the notation from the usual corresponding scale). This year, I tried to respect the ITU scale. When a difference is audible but not really annoying, the notation is at least equal to 4.0 and my hairs must stand on end to allow a notation inferior to 2.0 (from "annoying" to "very annoying"). Notation is still severe (I keep in mind that all encodings were set at 180 kbps) and that's why results I get here can't absolutely not be compared to other listening tests I done, especially those performed for low bitrate settings. By the way, there are no anchors in this test (high anchor is of course unecessary here).
Samples: Same as last year. See this thread.
Gain: I hadn't modify the gain of any file. All were played at their original volume.

This post has been edited by guruboolez: Aug 31 2005, 11:00
Go to the top of the page
+Quote Post
 
Start new topic
Replies
guruboolez
post Aug 21 2005, 19:34
Post #2





Group: Members (Donating)
Posts: 3474
Joined: 7-November 01
From: Strasbourg (France)
Member No.: 420



V. Results and detailed comments







Sample 01: Krall
Short description: the only non-classical sample (Jazz). Cymbals, drums and voice.
Possible problems: smearing on cymbals and drums, distorted cymbals.
replaygain_sample_gain: = -5.50 dB
(indicative only: files were tested at their original volume)

CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1L = E:\SUMMER TESTS 2005\HQ180\01_krall [AAC faac].wav
2L = E:\SUMMER TESTS 2005\HQ180\01_krall [AAC Nero Digital].wav
3L = E:\SUMMER TESTS 2005\HQ180\01_krall [MPC 1.15v].wav
4R = E:\SUMMER TESTS 2005\HQ180\01_krall [vorbis aoTuV].wav
5L = E:\SUMMER TESTS 2005\HQ180\01_krall [MP3 LAME].wav

---------------------------------------
General Comments: This is what I wrote for 4R, before cancelling my notation after a bad ABX test:

"Last file I have to find. After many trials, I found one small distorted passage [3.86 - 5.67]"

failed on ABX -> 5.0 / 5.0
---------------------------------------
1L File: E:\SUMMER TESTS 2005\HQ180\01_krall [AAC faac].wav
1L Rating: 3.0
1L Comment: pre-echo is a bit worrying; it seems to distort the cymbal
---------------------------------------
2L File: E:\SUMMER TESTS 2005\HQ180\01_krall [AAC Nero Digital].wav
2L Rating: 2.3
2L Comment: pre-echo is also very perceptible ; cymbals on the beginning are even more distorted than previous file. They sound false, unatural... something weird.
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\01_krall [MPC 1.15v].wav
3L Rating: 4.0
3L Comment: cymbals sound false, distorted. No pre-echo this time
---------------------------------------
5L File: E:\SUMMER TESTS 2005\HQ180\01_krall [MP3 LAME].wav
5L Rating: 2.7
5L Comment: smearing is really perceptible (probably the worse of the serie) ; cymbals are also suffering from false sounding.
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\01_krall [vorbis aoTuV].wav
7 out of 12, pval = 0.387


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\01_krall [vorbis aoTuV].wav
Playback Range: 03.867 to 05.671
3:39:07 PM f 0/1 pval = 1.0
3:39:10 PM p 1/2 pval = 0.75
3:39:12 PM p 2/3 pval = 0.5
3:39:15 PM f 2/4 pval = 0.687
3:39:18 PM p 3/5 pval = 0.5
3:39:20 PM p 4/6 pval = 0.343
3:40:02 PM p 5/7 pval = 0.226
3:40:04 PM f 5/8 pval = 0.363
3:40:07 PM f 5/9 pval = 0.5
3:40:10 PM f 5/10 pval = 0.623
3:40:15 PM p 6/11 pval = 0.5
3:40:19 PM p 7/12 pval = 0.387


Cymbals are still a problem for lossy encoders at this bitrate: often smeared and sometimes distorted. Nero Digital is the worst¹, followed by LAME which suffers from strongest pre-echo; then faac. Contrary to other encodings MPC doesn’t have any smearing issue, but cymbals don't sound true. aoTuV is the best: I really had to insist in order to unmask the encoding, but I totally missed the ABX phase.
¹ Nero Digital allocate much less bits (150 kbps) than competitors, all at more than 200 kbps.



Sample 02: Fuga
Short description: harpsichord.
Possible problems: pre-echo, out of tune (tremolos, vibrating notes).
replaygain_sample_gain: +14.97 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1R = E:\SUMMER TESTS 2005\HQ180\02_fuga [AAC faac].wav
2L = E:\SUMMER TESTS 2005\HQ180\02_fuga [MP3 LAME].wav
3L = E:\SUMMER TESTS 2005\HQ180\02_fuga [MPC 1.15v].wav
4R = E:\SUMMER TESTS 2005\HQ180\02_fuga [AAC Nero Digital].wav
5R = E:\SUMMER TESTS 2005\HQ180\02_fuga [vorbis aoTuV].wav

---------------------------------------
General Comments:
---------------------------------------
1R File: E:\SUMMER TESTS 2005\HQ180\02_fuga [AAC faac].wav
1R Rating: 3.0
1R Comment: smearing on most harpsichord note.
One is audibly distorted (tremolo between 8.52 - 10.00]
---------------------------------------
2L File: E:\SUMMER TESTS 2005\HQ180\02_fuga [MP3 LAME].wav
2L Rating: 2.5
2L Comment: harpsichord notes are smeared, and sometimes distorted. I suspect LAME, used to have this kind of issue with this instrument.
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\02_fuga [MPC 1.15v].wav
3L Rating: 4.5
3L Comment: no smearing, no 'tremolo' distortion. Very good, excepted on one note [~9.00].

AFTER ABX: slight smearing is also audible
---------------------------------------
4R File: E:\SUMMER TESTS 2005\HQ180\02_fuga [AAC Nero Digital].wav
4R Rating: 2.5
4R Comment: very good encoding; smearing is ultra-slight ; most often there's no distortions. But from ~6.00 to the end, distortions are perceptible, sometimes annoying, and smearing becomes audible too [see between 11.18 - 14.11!].
---------------------------------------
5R File: E:\SUMMER TESTS 2005\HQ180\02_fuga [vorbis aoTuV].wav
5R Rating: 4.5
5R Comment: slight smearing (?)
Hard to ABX
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\02_fuga [MPC 1.15v].wav
15 out of 16, pval < 0.001
Original vs E:\SUMMER TESTS 2005\HQ180\02_fuga [vorbis aoTuV].wav
16 out of 24, pval = 0.075


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\02_fuga [MPC 1.15v].wav
Playback Range: 07.915 to 12.024
3:57:03 PM p 1/1 pval = 0.5
3:57:07 PM p 2/2 pval = 0.25
3:57:11 PM p 3/3 pval = 0.125
3:57:15 PM p 4/4 pval = 0.062
3:57:19 PM f 4/5 pval = 0.187
3:57:25 PM p 5/6 pval = 0.109
3:57:29 PM p 6/7 pval = 0.062
3:57:34 PM p 7/8 pval = 0.035
3:57:39 PM p 8/9 pval = 0.019
3:57:42 PM p 9/10 pval = 0.01
3:57:46 PM p 10/11 pval = 0.0050
3:57:50 PM p 11/12 pval = 0.0030
3:57:56 PM p 12/13 pval = 0.0010
3:58:00 PM p 13/14 pval < 0.001
3:58:03 PM p 14/15 pval < 0.001
3:58:07 PM p 15/16 pval < 0.001

Original vs E:\SUMMER TESTS 2005\HQ180\02_fuga [vorbis aoTuV].wav
Playback Range: 07.463 to 14.285
4:02:43 PM p 1/1 pval = 0.5
4:02:48 PM f 1/2 pval = 0.75
4:02:59 PM f 1/3 pval = 0.875
4:03:04 PM p 2/4 pval = 0.687
4:03:08 PM p 3/5 pval = 0.5
4:03:12 PM p 4/6 pval = 0.343
4:03:19 PM p 5/7 pval = 0.226
Playback Range: 10.290 to 13.645
4:03:29 PM p 6/8 pval = 0.144
4:03:33 PM p 7/9 pval = 0.089
4:03:36 PM p 8/10 pval = 0.054
4:03:38 PM p 9/11 pval = 0.032
4:03:41 PM f 9/12 pval = 0.072
4:03:44 PM p 10/13 pval = 0.046
4:03:47 PM f 10/14 pval = 0.089
4:03:50 PM p 11/15 pval = 0.059
4:04:02 PM f 11/16 pval = 0.105
4:04:05 PM f 11/17 pval = 0.166
4:04:12 PM p 12/18 pval = 0.118
4:04:15 PM f 12/19 pval = 0.179
4:04:18 PM p 13/20 pval = 0.131
4:04:20 PM p 14/21 pval = 0.094
4:04:23 PM p 15/22 pval = 0.066
4:04:25 PM f 15/23 pval = 0.105
4:04:28 PM p 16/24 pval = 0.075


Not a surprise for me: MP3 and especially LAME has still weakness with this instrument, which is distorted by the encoding (notes are trembling) and also has smearing issue. Nero Digital is excellent on the beginning despite of smallest bitrate (163 kbps); but quality suddenly drops on the second half. Faac is a bit better on average. Both aoTuV and MPC are excellent here, with only a very subtle smearing. MPC¹ was easier to ABX due to a distortion occurring on one short moment; for aoTuV, I changed the tested range during the ABX phase in order to catch an easier segment for comparison. Pval is > 0,05 < 0,10 on overall but < 0,05 on the second range I tested.
¹ very high bitrate (230 kbps) for MPC, used to bloat the bitrate with solo harpsichord.



Sample 03: Mahler
Short description: mixed chorus (without instrument). Very tonal (no attacks).
Possible problems: kind of ringing, distortions on sibilant consonant (“s”).
replaygain_sample_gain: +0.87 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1R = E:\SUMMER TESTS 2005\HQ180\03_mahler [MP3 LAME].wav
2R = E:\SUMMER TESTS 2005\HQ180\03_mahler [AAC faac].wav
3L = E:\SUMMER TESTS 2005\HQ180\03_mahler [MPC 1.15v].wav
4L = E:\SUMMER TESTS 2005\HQ180\03_mahler [AAC Nero Digital].wav
5L = E:\SUMMER TESTS 2005\HQ180\03_mahler [vorbis aoTuV].wav

---------------------------------------
General Comments:
---------------------------------------
1R File: E:\SUMMER TESTS 2005\HQ180\03_mahler [MP3 LAME].wav
1R Rating: 3.5
1R Comment: distortions on voice are audible, but not as worrying than 2R or 3L.
---------------------------------------
2R File: E:\SUMMER TESTS 2005\HQ180\03_mahler [AAC faac].wav
2R Rating: 2.0
2R Comment: voices are distorted, with strange 'pop' during the song. I suspect faac, which has this bug (pop/warbling audible on tonal moment) for a long time.
example: 4.16 - 6.07
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\03_mahler [MPC 1.15v].wav
3L Rating: 2.5
3L Comment: There's something ugly in the voice, unstable, wrong. It's not natural
---------------------------------------
4L File: E:\SUMMER TESTS 2005\HQ180\03_mahler [AAC Nero Digital].wav
4L Rating: 4.5
4L Comment: This one was close to be perfect. It was the encoding I unmasked. But there's a small pasage which sounded distorted, not very hard to ABX.
On overall seems to be the less wounded by distortions.
---------------------------------------
5L File: E:\SUMMER TESTS 2005\HQ180\03_mahler [vorbis aoTuV].wav
5L Rating: 3.8
5L Comment: It seems that some 'vocal matter' was removed. Audible for example during 20.56 - 25.16. It distorts the voice, but in a different manner as 3L, and closer to 2R. Slightly better than 1R.
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\03_mahler [AAC Nero Digital].wav
8 out of 8, pval = 0.0030


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\03_mahler [AAC Nero Digital].wav
Playback Range: 22.289 to 25.568
4:22:37 PM p 1/1 pval = 0.5
4:22:41 PM p 2/2 pval = 0.25
4:22:46 PM p 3/3 pval = 0.125
4:22:50 PM p 4/4 pval = 0.062
4:22:56 PM p 5/5 pval = 0.031
4:23:01 PM p 6/6 pval = 0.015
4:23:06 PM p 7/7 pval = 0.0070
4:23:10 PM p 8/8 pval = 0.0030


I recognized faac, which is the only encoder to my knowledge betraying some warbling issues on this kind of (tonal) samples. In addition to this problem voice are distorted (maybe a consequence of low bitrate allocation¹). MPC has serious issue here, already noticed in the past. Voices are not natural, a bit ugly and also unstable. Less annoying are distortions audible with LAME and aoTuV. This last one seems to remove some noise/matter. Nero Digital is the best, close to perfection with problem occurring on a very small portion of the sample (and ABXed without difficulties).
¹ 157 kbps which corresponds to the faac lowest bitrate of the whole test.


Sample 04: Weihnachts-Oratorium (Oratorio de Noël)
Short description: exulting orchestra (period instruments), with brass, percussions and mixed chorus.
Possible problems: loss in details, distorted on voices or instruments (especially brass).
replaygain_sample_gain: -2.62 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1L = E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [AAC Nero Digital].wav
2L = E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [MP3 LAME].wav
3L = E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [MPC 1.15v].wav
4R = E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [vorbis aoTuV].wav
5R = E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [AAC faac].wav

---------------------------------------
General Comments:
---------------------------------------
1L File: E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [AAC Nero Digital].wav
1L Rating: 4.0
1L Comment: Slight distortion on chorus, exactly as if vocal matter was removed (it reminds me distortions I perceived with previous sample).
---------------------------------------
2L File: E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [MP3 LAME].wav
2L Rating: 3.2
2L Comment: orchestra is distorted. Annoying.
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [MPC 1.15v].wav
3L Rating: 4.3
3L Comment: Some details are missing (not annoying). After ABX phase: brass are distorted, a bit wrong
---------------------------------------
4R File: E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [vorbis aoTuV].wav
4R Rating: 4.5
4R Comment: AFTER ABX: I've just lost my previous comment, I've wrote for the reference...
What I've just heard: fatness, coarseness. Would it be Vorbis? Are this problems (typical for this encoder) still audible at this bitrate?
The distortions is nevertheless really subtle (so subtle that I missed it during the ABC/HR phase). It's less annoying in my opinion that the distortion heard with previous file ('wrong color').
---------------------------------------
5R File: E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [AAC faac].wav
5R Rating: 3.0
5R Comment: distortions (a bit more annoying [on brass] than 2R)
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [vorbis aoTuV].wav
8 out of 8, pval = 0.0030
Original vs E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [MPC 1.15v].wav
8 out of 8, pval = 0.0030


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [vorbis aoTuV].wav
Playback Range: 00.769 to 02.102
4:38:40 PM p 1/1 pval = 0.5
4:38:45 PM p 2/2 pval = 0.25
4:38:51 PM p 3/3 pval = 0.125
4:38:56 PM p 4/4 pval = 0.062
4:39:01 PM p 5/5 pval = 0.031
4:39:06 PM p 6/6 pval = 0.015
4:39:13 PM p 7/7 pval = 0.0070
4:39:20 PM p 8/8 pval = 0.0030

Original vs E:\SUMMER TESTS 2005\HQ180\04_Oratorio Noël [MPC 1.15v].wav
Playback Range: 00.769 to 02.102
4:37:47 PM p 1/1 pval = 0.5
4:37:52 PM p 2/2 pval = 0.25
4:37:57 PM p 3/3 pval = 0.125
4:38:01 PM p 4/4 pval = 0.062
4:38:06 PM p 5/5 pval = 0.031
4:38:15 PM p 6/6 pval = 0.015
4:38:17 PM p 7/7 pval = 0.0070
4:38:20 PM p 8/8 pval = 0.0030


faac and LAME are the worse and both have the same kind of distortions altering the orchestral part. Nero AAC was one step better, with minor problems on chorus part. I noticed something I associated to noise reduction. MPC and aoTuV are very good. Brass is slightly distorted with MPC which also removes some details in the background. Vorbis is even better than MPC. So good that I first rated the reference, but the notation was automatically cancelled by ABC/HR after a positive ABX test. It’s important to note that I’ve suspected Vorbis: for the first time I heard coarseness/fatness used to affect this format.



Sample 05: Dom Bedos
Short description: organ, with long continuous tonal notes
Possible problems: kind of ringing (constant tonal part being fluctuating).
replaygain_sample_gain: +5.10 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1L = E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [AAC faac].wav
2L = E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [MP3 LAME].wav
3R = E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [vorbis aoTuV].wav
4L = E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [MPC 1.15v].wav
5L = E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [AAC Nero Digital].wav

---------------------------------------
General Comments:
---------------------------------------
1L File: E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [AAC faac].wav
1L Rating: 2.7
1L Comment: Distortions are perceptible, not really deranging first but more irritating on the second part.
---------------------------------------
2L File: E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [MP3 LAME].wav
2L Rating: 2.7
2L Comment: beginning: very subtle distortion
end (last note): distortion is clearly more annoying
---------------------------------------
3R File: E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [vorbis aoTuV].wav
3R Rating: 4.0
3R Comment: last note has something strange, unconstant, slightly raucous.
---------------------------------------
4L File: E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [MPC 1.15v].wav
4L Rating: 3.7
4L Comment: First part is excellent, but second part (especially last note) is slightly distorted (a bit more irritating than previous file)
---------------------------------------
5L File: E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [AAC Nero Digital].wav
5L Rating: 2.5
5L Comment: The most (immediately) shoking. There are weird disotrtions on tonal moments. Ugly. Last tonal note is nevertheless better, but still distorted.
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [vorbis aoTuV].wav
8 out of 8, pval = 0.0030
Original vs E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [MPC 1.15v].wav
13 out of 16, pval = 0.01


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [vorbis aoTuV].wav
Playback Range: 08.051 to 10.063
9:57:12 PM p 1/1 pval = 0.5
9:57:19 PM p 2/2 pval = 0.25
9:57:23 PM p 3/3 pval = 0.125
9:57:26 PM p 4/4 pval = 0.062
9:57:29 PM p 5/5 pval = 0.031
9:57:32 PM p 6/6 pval = 0.015
9:57:35 PM p 7/7 pval = 0.0070
9:57:38 PM p 8/8 pval = 0.0030

Original vs E:\SUMMER TESTS 2005\HQ180\05_Dom Bedos [MPC 1.15v].wav
Playback Range: 05.344 to 06.524
9:54:41 PM f 0/1 pval = 1.0
9:54:44 PM p 1/2 pval = 0.75
9:54:48 PM p 2/3 pval = 0.5
9:54:51 PM p 3/4 pval = 0.312
9:54:55 PM f 3/5 pval = 0.5
9:54:58 PM p 4/6 pval = 0.343
9:55:02 PM p 5/7 pval = 0.226
9:55:05 PM p 6/8 pval = 0.144
Playback Range: 09.300 to 11.475
9:55:17 PM p 7/9 pval = 0.089
9:55:21 PM p 8/10 pval = 0.054
9:55:27 PM f 8/11 pval = 0.113
9:55:30 PM p 9/12 pval = 0.072
9:55:33 PM p 10/13 pval = 0.046
9:55:36 PM p 11/14 pval = 0.028
9:55:48 PM p 12/15 pval = 0.017
9:55:51 PM p 13/16 pval = 0.01


Nero Digital appears as the worst encoding. Distortions are ugly. The encoding of the problematic last note was better and it preserves Nero AAC from a biting notation¹. Not far from Nero Digital: faac² and LAME³. Both offers a really good sound on beginning but quality drops for each on the end of the sample. Again, MPC and aoTuV are on top. Both are excellent on the first half of this sample. But second half and especially last note is apparently much harder to encode for all encoders. MPC is here distorted. Last year, I heard something wrong but failed on ABX phase; this time, ABX was successful. aoTuV presents a different form of distortion, less annoying: something raucous, unconstant and hard to describe – subtle but not too hard to ABX. Like often with very tonal part encoded by MPC: bloated bitrate.
¹ This is exactly the kind of sample for which Nero ‘fast’ encoder is perfect (but with bloated bitrate as other side of the coin: 233 kbps for this sample with 'fast' encoder and -streaming preset against 165 kbps for the tested encoding!)
² faac bitrate is very low: 150 kbps. It’s 80 kbps less than MPC!
³ LAME quality is now much better than the one tested one year ago (ugly distortions are ringing are gone).



Sample 06: Platée
Short description: orchestra representing a rainstorm (period instruments).
Possible problems: background is detailed due to the presence of instruments ensuring continuo; loss in details is expected
replaygain_sample_gain: -0.07 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1R = E:\SUMMER TESTS 2005\HQ180\06_Platée [AAC Nero Digital].wav
2L = E:\SUMMER TESTS 2005\HQ180\06_Platée [vorbis aoTuV].wav
3L = E:\SUMMER TESTS 2005\HQ180\06_Platée [AAC faac].wav
4L = E:\SUMMER TESTS 2005\HQ180\06_Platée [MP3 LAME].wav
5R = E:\SUMMER TESTS 2005\HQ180\06_Platée [MPC 1.15v].wav

---------------------------------------
General Comments:
---------------------------------------
1R File: E:\SUMMER TESTS 2005\HQ180\06_Platée [AAC Nero Digital].wav
1R Rating: 4.0
1R Comment: harpsichord on background is slightly imprecise, subtly softened. Not irritating. Slightly distorted between 3.83 - 5.40
---------------------------------------
2L File: E:\SUMMER TESTS 2005\HQ180\06_Platée [vorbis aoTuV].wav
2L Rating: 3.5
2L Comment: Details are also missing; harpsichord edges are softened - a bit more than previous file. Not irritating, just imprecise.
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\06_Platée [AAC faac].wav
3L Rating: 2.5
3L Comment: This one is now distorted. The harpsichord in background sounds false and not only imprecise. Irritating.
---------------------------------------
4L File: E:\SUMMER TESTS 2005\HQ180\06_Platée [MP3 LAME].wav
4L Rating: 3.8
4L Comment: Again, I've lost my previous comments, because I've rated first the reference...
I give 4.5 first, but after the ABX phase I have to reconsider this note. First I've only heard a subtle loss in details, but now that I'm listening the good file and after a positive ABX tests this encoding appears as less enjoying: apart missing details (like other encodings) there's also audible distortions on harpsichord.
---------------------------------------
5R File: E:\SUMMER TESTS 2005\HQ180\06_Platée [MPC 1.15v].wav
5R Rating: 4.3
5R Comment: Softened - harpsichord edges are a bit vague.
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\06_Platée [MP3 LAME].wav
14 out of 16, pval = 0.0020


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\06_Platée [MP3 LAME].wav
Playback Range: 01.609 to 03.684
10:11:50 PM p 1/1 pval = 0.5
10:11:54 PM p 2/2 pval = 0.25
10:12:02 PM f 2/3 pval = 0.5
10:12:05 PM f 2/4 pval = 0.687
10:12:10 PM p 3/5 pval = 0.5
10:12:14 PM p 4/6 pval = 0.343
10:12:29 PM p 5/7 pval = 0.226
10:12:33 PM p 6/8 pval = 0.144
10:12:38 PM p 7/9 pval = 0.089
10:12:42 PM p 8/10 pval = 0.054
10:12:46 PM p 9/11 pval = 0.032
10:12:49 PM p 10/12 pval = 0.019
10:12:54 PM p 11/13 pval = 0.011
10:13:02 PM p 12/14 pval = 0.0060
10:13:06 PM p 13/15 pval = 0.0030
10:13:09 PM p 14/16 pval = 0.0020


faac presents the most distorted sound on orchestra again (see sample_04, and later sample_10 & sample_15). Details are either softened or distorted. aoTuV occupies here an unusual last but one place. Sound is too imprecise, and edges of harpsichord are softened. LAME sounds in a similar manner, offering a bit more precisions than aoTuV but also slight distortions on continuo. I discovered the problem during ABX phase, and first rated the reference instead of encoded file. Nero Digital is very good, with a subtle loss in details and located distortions. It’s a remarkable performance for such low bitrate encoding¹. Same goes for MPC but without distortions this time: just a slight smoothing of details in background.
¹ 161 kbps, whereas all other contenders have a bitrate comprise between 194 [aoTuV] and 215 kbps [LAME]!


Sample 07: Marche Royale (00.00 – 12.00)
Short description: Chamber orchestra. First part of a sample divided in two. Here: drums, violin, trumpet, cello, clarinet.
Possible problems: pre-echo (drums) and usual distortions on instruments like violin or clarinet.
replaygain_sample_gain: +1.02 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1R = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MP3 LAME].wav
2R = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MPC 1.15v].wav
3R = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC faac].wav
4L = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [vorbis aoTuV].wav
5L = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC Nero Digital].wav

---------------------------------------
General Comments: The evaluation is based on the first twelve seconds of this sample: drums, violin, trumpet, cello, clarinet.
The second part (cymbals mostly) will be the subject of the next test
---------------------------------------
1R File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MP3 LAME].wav
1R Rating: 3.6
1R Comment: drums are smeared
---------------------------------------
2R File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MPC 1.15v].wav
2R Rating: 3.8
2R Comment: Clearly smeared. Drums are not totally clean. A bit hollowed.
---------------------------------------
3R File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC faac].wav
3R Rating: 3.5
3R Comment: smearing
---------------------------------------
4L File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [vorbis aoTuV].wav
4L Rating: 4.0
4L Comment: Few pre-echo but drums are 'noisy' from within.
---------------------------------------
5L File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC Nero Digital].wav
5L Rating: 2.5
5L Comment: worse pre-echo; drums are also distorted.
---------------------------------------

ABX Results:


Disappointing performance of Nero Digital which presents the worst pre-echo performance. The same issue also appeared on sample_01. faac has the same situation, but annoyance is clearly lower. The encoder is followed by LAME, which seems to be very slightly better, and then MPC, also (slightly) smeared with other minor problems (hollowed drums). aoTuV is the best, with very few pre-echo but rather a distortion coming from within the drums (boosted noise).


Sample 08: Marche Royale (12.00 – 29.00)
Short description: Chamber orchestra – 2nd part. Here: cymbals (orchestral ones, different from those heard in sample_O1) are introduced; I focused my rating on these.
Possible problems: smearing and distortions (swoosh).
replaygain_sample_gain: +1.02 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1L = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [vorbis aoTuV].wav
2R = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC Nero Digital].wav
3L = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC faac].wav
4R = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MP3 LAME].wav
5R = E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MPC 1.15v].wav

---------------------------------------
General Comments: I tried to ABX every file. At one moment I was so confused that I couln't tell which file was distorted, which one was smeared, etc... That's why I started a complete ABX checkup. I only failed for the first one. I'd still say that 1L is the encoded one, but for this test, a bad ABX test imply 5.0 as notation.
---------------------------------------
2R File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC Nero Digital].wav
2R Rating: 3.5
2R Comment: Smeared. Edges are really softened. Cymbals sound a bit wrong
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC faac].wav
3L Rating: 2.5
3L Comment: Slight smearing, but much more annoying are the distortions on cymbals. Brrrrr...
---------------------------------------
4R File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MP3 LAME].wav
4R Rating: 2.1
4R Comment: Cymbals are the most distorted with this encoding
---------------------------------------
5R File: E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MPC 1.15v].wav
5R Rating: 4.5
5R Comment: Distortions are very small. It was the hardest to ABX, apart the first sample for which I failed.
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC Nero Digital].wav
8 out of 8, pval = 0.0030
Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC faac].wav
7 out of 8, pval = 0.035
Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MPC 1.15v].wav
13 out of 16, pval = 0.01
Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MP3 LAME].wav
8 out of 8, pval = 0.0030
Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [vorbis aoTuV].wav
8 out of 16, pval = 0.598


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC Nero Digital].wav
Playback Range: 11.963 to 15.198
10:51:30 PM p 1/1 pval = 0.5
10:51:35 PM p 2/2 pval = 0.25
10:51:39 PM p 3/3 pval = 0.125
10:51:43 PM p 4/4 pval = 0.062
10:51:47 PM p 5/5 pval = 0.031
10:51:51 PM p 6/6 pval = 0.015
10:51:57 PM p 7/7 pval = 0.0070
10:52:01 PM p 8/8 pval = 0.0030

Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [AAC faac].wav
Playback Range: 11.963 to 15.198
10:52:40 PM f 0/1 pval = 1.0
10:53:01 PM p 1/2 pval = 0.75
10:53:05 PM p 2/3 pval = 0.5
10:53:09 PM p 3/4 pval = 0.312
10:53:13 PM p 4/5 pval = 0.187
10:53:17 PM p 5/6 pval = 0.109
10:53:21 PM p 6/7 pval = 0.062
10:53:26 PM p 7/8 pval = 0.035

Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MPC 1.15v].wav
Playback Range: 11.963 to 15.198
10:54:51 PM p 1/1 pval = 0.5
10:54:59 PM p 2/2 pval = 0.25
10:55:08 PM p 3/3 pval = 0.125
10:55:16 PM p 4/4 pval = 0.062
10:55:21 PM p 5/5 pval = 0.031
10:55:27 PM p 6/6 pval = 0.015
10:55:32 PM f 6/7 pval = 0.062
10:55:41 PM p 7/8 pval = 0.035
10:55:48 PM f 7/9 pval = 0.089
10:55:53 PM p 8/10 pval = 0.054
10:55:57 PM f 8/11 pval = 0.113
10:56:01 PM p 9/12 pval = 0.072
10:56:09 PM p 10/13 pval = 0.046
10:56:13 PM p 11/14 pval = 0.028
10:56:18 PM p 12/15 pval = 0.017
10:56:22 PM p 13/16 pval = 0.01

Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [MP3 LAME].wav
Playback Range: 11.963 to 15.198
10:53:49 PM p 1/1 pval = 0.5
10:53:53 PM p 2/2 pval = 0.25
10:53:57 PM p 3/3 pval = 0.125
10:54:01 PM p 4/4 pval = 0.062
10:54:05 PM p 5/5 pval = 0.031
10:54:08 PM p 6/6 pval = 0.015
10:54:11 PM p 7/7 pval = 0.0070
10:54:15 PM p 8/8 pval = 0.0030

Original vs E:\SUMMER TESTS 2005\HQ180\07-08_Marche Royale [vorbis aoTuV].wav
Playback Range: 11.963 to 15.198
10:49:40 PM f 0/1 pval = 1.0
10:49:43 PM f 0/2 pval = 1.0
10:49:45 PM p 1/3 pval = 0.875
10:49:48 PM p 2/4 pval = 0.687
10:49:50 PM f 2/5 pval = 0.812
10:49:53 PM p 3/6 pval = 0.656
10:50:01 PM p 4/7 pval = 0.5
10:50:03 PM f 4/8 pval = 0.636
10:50:06 PM p 5/9 pval = 0.5
10:50:11 PM p 6/10 pval = 0.376
10:50:19 PM f 6/11 pval = 0.5
10:50:22 PM f 6/12 pval = 0.612
10:50:24 PM p 7/13 pval = 0.5
10:50:27 PM f 7/14 pval = 0.604
10:50:30 PM p 8/15 pval = 0.5
10:50:32 PM f 8/16 pval = 0.598


First, short remark: I ABXed everything here, because my feeling became so confuse and imprecise on ABCHR phase that I wasn’t unable anymore to structure the notation and the hierarchy.
LAME is the worse; it wins its worst note for the entire test with this instrument (cymbals). Distorted and really unpleasant. faac also presents worrying distortions (and audible smearing). Nero Digital is much less annoying but smearing as well as distortions are still moderately perceptible. Much better is MPC, harder to ABX (13/16) and barely distorted. I noticed a very small difference for aoTuV during ABCHR phase but I couldn’t confirm it on ABX module (8/16) and I therefore manually cancelled the notation (4.8) I give him first.



Sample 09: Orion II
Short description: trombones –one of the most difficult brass instrument to encode for transform encoders- here meticulously recorded. It corresponds to usual “micro-attacks” problems.
Possible problems: micro-attacks encoded with noise or -in worst case- distorted.
replaygain_sample_gain: -4.80 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1R = E:\SUMMER TESTS 2005\HQ180\09_Orion II [AAC faac].wav
2L = E:\SUMMER TESTS 2005\HQ180\09_Orion II [MPC 1.15v].wav
3L = E:\SUMMER TESTS 2005\HQ180\09_Orion II [MP3 LAME].wav
4L = E:\SUMMER TESTS 2005\HQ180\09_Orion II [vorbis aoTuV].wav
5L = E:\SUMMER TESTS 2005\HQ180\09_Orion II [AAC Nero Digital].wav

---------------------------------------
General Comments:
---------------------------------------
1R File: E:\SUMMER TESTS 2005\HQ180\09_Orion II [AAC faac].wav
1R Rating: 3.3
1R Comment: There's noise covering the microattacks which are slightly blurred.
---------------------------------------
2L File: E:\SUMMER TESTS 2005\HQ180\09_Orion II [MPC 1.15v].wav
2L Rating: 3.8
2L Comment: Noise between micro-attacks. Not really annoying, but clearly perceptible.
AFTER ABX: there's a clear 'pshhhhh-artefact' that identifies this encoding when compared directly to 4L.
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\09_Orion II [MP3 LAME].wav
3L Rating: 3.0
3L Comment: Noise is higher than 1R. Noise reachs a peak somewhere between 3.90 - 6.67.
---------------------------------------
4L File: E:\SUMMER TESTS 2005\HQ180\09_Orion II [vorbis aoTuV].wav
4L Rating: 4.0
4L Comment: Blurring and noise; better than 1R & 3R, very similar to 2L.
AFTER ABX: this one is cleaner compared to 2L. No artefact here, just a slight constant noise.
---------------------------------------
5L File: E:\SUMMER TESTS 2005\HQ180\09_Orion II [AAC Nero Digital].wav
5L Rating: 1.0
5L Comment: Very ugly distortion. Micro-attacks are slaughtered. It's very annoying, and 1.0 isn't severe at all.
---------------------------------------

ABX Results:
E:\SUMMER TESTS 2005\HQ180\09_Orion II [MPC 1.15v].wav vs E:\SUMMER TESTS 2005\HQ180\09_Orion II [vorbis aoTuV].wav
12 out of 12, pval < 0.001
Original vs E:\SUMMER TESTS 2005\HQ180\09_Orion II [MPC 1.15v].wav
14 out of 16, pval = 0.0020
Original vs E:\SUMMER TESTS 2005\HQ180\09_Orion II [vorbis aoTuV].wav
13 out of 16, pval = 0.01


---- Detailed ABX results ----
E:\SUMMER TESTS 2005\HQ180\09_Orion II [MPC 1.15v].wav vs E:\SUMMER TESTS 2005\HQ180\09_Orion II [vorbis aoTuV].wav
Playback Range: 03.875 to 05.639
11:31:21 PM p 1/1 pval = 0.5
11:31:29 PM p 2/2 pval = 0.25
11:31:32 PM p 3/3 pval = 0.125
11:31:35 PM p 4/4 pval = 0.062
11:31:38 PM p 5/5 pval = 0.031
11:31:41 PM p 6/6 pval = 0.015
11:31:43 PM p 7/7 pval = 0.0070
11:31:46 PM p 8/8 pval = 0.0030
11:31:49 PM p 9/9 pval = 0.0010
11:31:52 PM p 10/10 pval < 0.001
11:31:55 PM p 11/11 pval < 0.001
11:31:58 PM p 12/12 pval < 0.001

Original vs E:\SUMMER TESTS 2005\HQ180\09_Orion II [MPC 1.15v].wav
Playback Range: 03.904 to 06.150
11:26:14 PM p 1/1 pval = 0.5
11:26:18 PM f 1/2 pval = 0.75
11:26:22 PM p 2/3 pval = 0.5
11:26:25 PM p 3/4 pval = 0.312
11:26:28 PM p 4/5 pval = 0.187
11:26:30 PM p 5/6 pval = 0.109
11:26:34 PM p 6/7 pval = 0.062
11:26:38 PM p 7/8 pval = 0.035
11:26:42 PM p 8/9 pval = 0.019
11:26:45 PM p 9/10 pval = 0.01
11:26:49 PM p 10/11 pval = 0.0050
11:26:53 PM p 11/12 pval = 0.0030
11:26:58 PM p 12/13 pval = 0.0010
11:27:02 PM f 12/14 pval = 0.0060
11:27:06 PM p 13/15 pval = 0.0030
11:27:10 PM p 14/16 pval = 0.0020

Original vs E:\SUMMER TESTS 2005\HQ180\09_Orion II [vorbis aoTuV].wav
Playback Range: 03.904 to 06.150
11:28:21 PM p 1/1 pval = 0.5
11:28:24 PM p 2/2 pval = 0.25
11:28:27 PM f 2/3 pval = 0.5
11:28:30 PM p 3/4 pval = 0.312
11:28:33 PM p 4/5 pval = 0.187
11:28:39 PM p 5/6 pval = 0.109
11:28:42 PM p 6/7 pval = 0.062
11:28:49 PM p 7/8 pval = 0.035
11:28:51 PM f 7/9 pval = 0.089
11:29:15 PM p 8/10 pval = 0.054
11:29:21 PM p 9/11 pval = 0.032
11:29:27 PM p 10/12 pval = 0.019
11:29:31 PM p 11/13 pval = 0.011
11:29:34 PM p 12/14 pval = 0.0060
11:29:40 PM p 13/15 pval = 0.0030
11:29:44 PM f 13/16 pval = 0.01


Nero Digital is very bad. Artefact is so terrible that I gave (thoughtful decision) the lowest note (1.0) to this sample¹. LAME and faac are much better and they only present noise as defect. MPC is even better (few noise) but presents a short artefact I identified during the ABX phase (14/16). aoTuV sounded similar to MPC but after several listenings it appears as slightly cleaner and without artefact².
¹ This is the only notation inferior to 2.0 for the entire test.
² Direct blind comparison between MPC and aoTuV was easy: 12/12 pval < 0.001. It should be worth noticing that Vorbis has made clear progress in this area (micro-attacks, used to be smeared at this preset) compared to last test including MEGAMIX.




Sample 10: “Dover, giustizia”
Short description: mezzo-soprano voice accompanied by orchestra.
Possible problems: voice can be distorted and instrument may also be softened.
replaygain_sample_gain: -4.73 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 17 août 2005
Testname:

Tester: guruboolez

1R = E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [vorbis aoTuV].wav
2L = E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MPC 1.15v].wav
3L = E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MP3 LAME].wav
4L = E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [AAC faac].wav
5L = E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [AAC Nero Digital].wav

---------------------------------------
General Comments:
---------------------------------------
2L File: E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MPC 1.15v].wav
2L Rating: 3.8
2L Comment: Distortions on voice, clearly audible and easy to ABX. Subtle details in instrumental part are softened.
---------------------------------------
3L File: E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MP3 LAME].wav
3L Rating: 4.5
3L Comment: Slight loss in details and few distortions. Very good.
---------------------------------------
4L File: E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [AAC faac].wav
4L Rating: 3.5
4L Comment: Not perfect. Some problems are a bit annoying (distortions on voice).
---------------------------------------
5L File: E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [AAC Nero Digital].wav
5L Rating: 4.2
5L Comment: Very good. Subtle details are out (harpsichord in continuo), but it needs a direct comparison to be perceived. Slight distortions on harpsichord at the very end.
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MP3 LAME].wav
9 out of 12, pval = 0.072
Original vs E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MPC 1.15v].wav
10 out of 12, pval = 0.019
Original vs E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [vorbis aoTuV].wav
5 out of 12, pval = 0.806


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MP3 LAME].wav
Playback Range: 04.419 to 06.694
11:48:13 PM p 1/1 pval = 0.5
11:48:16 PM p 2/2 pval = 0.25
11:48:19 PM f 2/3 pval = 0.5
11:48:29 PM p 3/4 pval = 0.312
11:48:34 PM f 3/5 pval = 0.5
11:48:37 PM p 4/6 pval = 0.343
11:48:41 PM p 5/7 pval = 0.226
11:48:47 PM p 6/8 pval = 0.144
11:48:57 PM p 7/9 pval = 0.089
11:49:01 PM p 8/10 pval = 0.054
11:49:13 PM p 9/11 pval = 0.032
11:49:16 PM f 9/12 pval = 0.072

Original vs E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [MPC 1.15v].wav
Playback Range: 04.419 to 06.694
11:47:20 PM f 0/1 pval = 1.0
11:47:24 PM p 1/2 pval = 0.75
11:47:28 PM f 1/3 pval = 0.875
11:47:32 PM p 2/4 pval = 0.687
11:47:35 PM p 3/5 pval = 0.5
11:47:38 PM p 4/6 pval = 0.343
11:47:41 PM p 5/7 pval = 0.226
11:47:45 PM p 6/8 pval = 0.144
11:47:48 PM p 7/9 pval = 0.089
11:47:51 PM p 8/10 pval = 0.054
11:47:54 PM p 9/11 pval = 0.032
11:47:56 PM p 10/12 pval = 0.019

Original vs E:\SUMMER TESTS 2005\HQ180\10_Dover, giustizia [vorbis aoTuV].wav
Playback Range: 04.419 to 06.694
11:45:55 PM f 0/1 pval = 1.0
11:45:58 PM f 0/2 pval = 1.0
11:46:02 PM p 1/3 pval = 0.875
11:46:06 PM f 1/4 pval = 0.937
11:46:24 PM p 2/5 pval = 0.812
11:46:27 PM f 2/6 pval = 0.89
11:46:30 PM p 3/7 pval = 0.773
11:46:44 PM f 3/8 pval = 0.855
11:46:48 PM f 3/9 pval = 0.91
11:46:52 PM f 3/10 pval = 0.945
11:46:56 PM p 4/11 pval = 0.886
11:47:01 PM p 5/12 pval = 0.806


faac gets the last place, but with a flattering notation corresponding to a small distortion on voice (3.5). This is the highest note I gave for a worst encoding. Obviously, this sample doesn’t contain anything excessively difficult for ours five competitors. Unusual place for MPC which presents distortion on voice and which smooth subtle details in the background. Then comes Nero Digital which doesn’t distort voice but which softens some details in orchestral background. But Nero Digital also clearly distorts the harpsichord on the very end. LAME is similar to Nero Digital but without the distortions noticed before on harpsichord. aoTuV is transparent to my ears (5/12) despite of its low bitrate (164 kbps).


Sample 11: Trumpet Voluntar
Short description: mezzo trumpet with organ – the recording is very noisy on loud moments only (maybe a consequence of the organ?).
Possible problems: trumpet sometimes trigger artefacts; noise may cause ringing.
replaygain_sample_gain: -4.98 dB
(indicative only: files were tested at their original volume)


CODE

ABC/HR for Java, Version 0.5a, 18 août 2005
Testname:

Tester: guruboolez

1L = E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC Nero Digital].wav
2R = E:\SUMMER TESTS 2005\HQ180\11_trumpet [MP3 LAME].wav
3R = E:\SUMMER TESTS 2005\HQ180\11_trumpet [vorbis aoTuV].wav
4L = E:\SUMMER TESTS 2005\HQ180\11_trumpet [MPC 1.15v].wav
5R = E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC faac].wav

---------------------------------------
General Comments:
---------------------------------------
1L File: E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC Nero Digital].wav
1L Rating: 3.5
1L Comment: Trumpet is slightly distorted. Not bad.
---------------------------------------
2R File: E:\SUMMER TESTS 2005\HQ180\11_trumpet [MP3 LAME].wav
2R Rating: 4.5
2R Comment: Excellent encoding. Distortion is very low (I still wonder how I get this score during ABX phase...)
---------------------------------------
3R File: E:\SUMMER TESTS 2005\HQ180\11_trumpet [vorbis aoTuV].wav
3R Rating: 4.7
3R Comment: No distortion, not irregularities, but a subtle additionnal noise.
---------------------------------------
4L File: E:\SUMMER TESTS 2005\HQ180\11_trumpet [MPC 1.15v].wav
4L Rating: 3.8
4L Comment: Trumpet is irregular, like an additionnal vibrato.
---------------------------------------
5R File: E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC faac].wav
5R Rating: 3.0
5R Comment: This one is the most immediately distorted. Trumpet has something coarse, and sound a bit false. Nothing bad, but audible and slightly annoying.
---------------------------------------

ABX Results:
Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [MPC 1.15v].wav
9 out of 10, pval = 0.01
Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC faac].wav
10 out of 10, pval < 0.001
Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC Nero Digital].wav
9 out of 10, pval = 0.01
Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [MP3 LAME].wav
8 out of 10, pval = 0.054
Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [vorbis aoTuV].wav
8 out of 10, pval = 0.054


---- Detailed ABX results ----
Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [MPC 1.15v].wav
Playback Range: 01.245 to 03.052
12:25:01 AM p 1/1 pval = 0.5
12:25:06 AM p 2/2 pval = 0.25
12:25:14 AM p 3/3 pval = 0.125
12:25:18 AM p 4/4 pval = 0.062
12:25:21 AM p 5/5 pval = 0.031
12:25:24 AM p 6/6 pval = 0.015
12:25:27 AM p 7/7 pval = 0.0070
12:25:32 AM p 8/8 pval = 0.0030
12:25:35 AM f 8/9 pval = 0.019
12:25:38 AM p 9/10 pval = 0.01

Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC faac].wav
Playback Range: 01.245 to 03.052
12:26:04 AM p 1/1 pval = 0.5
12:26:07 AM p 2/2 pval = 0.25
12:26:10 AM p 3/3 pval = 0.125
12:26:13 AM p 4/4 pval = 0.062
12:26:16 AM p 5/5 pval = 0.031
12:26:19 AM p 6/6 pval = 0.015
12:26:21 AM p 7/7 pval = 0.0070
12:26:24 AM p 8/8 pval = 0.0030
12:26:27 AM p 9/9 pval = 0.0010
12:26:30 AM p 10/10 pval < 0.001

Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [AAC Nero Digital].wav
Playback Range: 01.245 to 03.052
12:21:10 AM p 1/1 pval = 0.5
12:21:20 AM p 2/2 pval = 0.25
12:21:30 AM p 3/3 pval = 0.125
12:21:34 AM p 4/4 pval = 0.062
12:21:38 AM p 5/5 pval = 0.031
12:21:50 AM p 6/6 pval = 0.015
12:21:54 AM p 7/7 pval = 0.0070
12:21:59 AM f 7/8 pval = 0.035
12:22:03 AM p 8/9 pval = 0.019
12:22:06 AM p 9/10 pval = 0.01

Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [MP3 LAME].wav
Playback Range: 01.245 to 03.052
12:22:30 AM p 1/1 pval = 0.5
12:22:33 AM f 1/2 pval = 0.75
12:22:36 AM f 1/3 pval = 0.875
12:22:42 AM p 2/4 pval = 0.687
12:22:48 AM p 3/5 pval = 0.5
12:22:53 AM p 4/6 pval = 0.343
12:22:58 AM p 5/7 pval = 0.226
12:23:03 AM p 6/8 pval = 0.144
12:23:09 AM p 7/9 pval = 0.089
12:23:14 AM p 8/10 pval = 0.054

Original vs E:\SUMMER TESTS 2005\HQ180\11_trumpet [vorbis aoTuV].wav
Playback Range: 01.245 to 03.052
12:23:45 AM p 1/1 pval = 0.5
12:23:51 AM p 2/2 pval = 0.25
12:23:55 AM p 3/3 pval = 0.125
12:24:00 AM p 4/4 pval = 0.062
12:24:05 AM f 4/5 pval = 0.187
12:24:12 AM p 5/6 pval = 0.109
12:24:16 AM f 5/7 pval = 0.226
12:24:32 AM p 6/8 pval = 0.144
12:24:37 AM p 7/9 pval = 0.089
12:24:43 AM p 8/10 pval = 0.054


The inconstant noise of the reference file is very disturbing (to be honest, I don’t like this sample). I therefore ABXed everything in order to be sure to not being betray by the weird reference sound.
faac is the worse and offers distortions (trumpet) that were immediately perceptible. Nero Digital and then MPC both present slight problems with trumpet; MPC encodes trumpets with some irregularities (phenomenon already noticed in chorus/sample_03). LAME and aoTuV are really excellent. I heard a very subtle distortion with LAME on ABC/HR ABXed with 8/10. aoTuV has no distortion but it adds a small amount of noise (also noticed with sample_07).


This post has been edited by guruboolez: Dec 29 2005, 22:42
Go to the top of the page
+Quote Post

Posts in this topic
- guruboolez   MPC vs VORBIS vs MP3 vs AAC at 180 kbps   Aug 21 2005, 19:33
- - guruboolez   V. Results and detailed comments Sample 01:...   Aug 21 2005, 19:34
- - guruboolez   Sample 12: Liebestod Short description: Soprano vo...   Aug 21 2005, 19:35
- - guruboolez   VI. Statistical analysis and conclusions It m...   Aug 21 2005, 19:51
|- - Lyx   QUOTE (guruboolez @ Aug 21 2005, 08:51 PM)Vor...   Aug 21 2005, 23:03
- - JeanLuc   Jesus Christ ... now that's one hell of a list...   Aug 21 2005, 19:53
- - guruboolez   Thanks:) Few words to say that I had to split the...   Aug 21 2005, 19:55
- - SirGrey   Wow ! Great work. Very interesting... Especial...   Aug 21 2005, 20:13
- - skelly831   AMAZING Guru! This is the kind of test that m...   Aug 21 2005, 20:25
- - HbG   You're invaluable to this community! And,...   Aug 21 2005, 20:40
- - rjamorim   Awesome! Thank-you very much, Bin Boolez*...   Aug 21 2005, 21:10
- - bug80   I bow, guruboolez. Great test! Now if only m...   Aug 21 2005, 21:19
|- - Yaztromo   Thanks Guru. It's more than obvious you've...   Aug 21 2005, 21:31
- - ff123   Guru, I'm always amazed to read the professio...   Aug 21 2005, 21:37
- - Cyaneyes   Guru.. you've made me very happy I purchased a...   Aug 21 2005, 21:45
- - Lyx   Amazing. When you think he cannot get any better, ...   Aug 21 2005, 21:58
- - CiTay   Well done, guruboolez!   Aug 21 2005, 22:39
- - Busemann   QUOTE • Apple AAC: There's still no VBR mode w...   Aug 21 2005, 22:48
|- - guruboolez   Thanks to you for all support QUOTE (Busemann ...   Aug 22 2005, 02:45
|- - rjamorim   QUOTE (guruboolez @ Aug 21 2005, 10:45 PM)Is ...   Aug 22 2005, 02:59
|- - guruboolez   QUOTE (rjamorim @ Aug 22 2005, 02:59 AM)QUOTE...   Aug 22 2005, 03:09
|- - rjamorim   QUOTE (guruboolez @ Aug 21 2005, 11:09 PM)I...   Aug 22 2005, 03:42
- - NumLOCK   Great work Guruboolez ! It is normal though -...   Aug 21 2005, 23:19
- - vinnie97   holy eff, excellent test, Guru! *not worthy* ...   Aug 21 2005, 23:28
- - kwanbis   excellent guruboolez   Aug 21 2005, 23:47
- - HotshotGG   QUOTE What is the cause of vorbis' noise issue...   Aug 22 2005, 00:09
- - vlada   Great test, thank you. I'm just wondering, how...   Aug 22 2005, 00:19
- - bond   great test! and great work from aoyumi!   Aug 22 2005, 01:34
- - kl33per   Awesome work guru. I don't recall the test one...   Aug 22 2005, 02:08
- - LoFiYo   Great work Mr Guru. Your occasional listening test...   Aug 22 2005, 02:10
- - PabUK   Excellent test, as always. Thanks.   Aug 22 2005, 11:48
- - Sunhillow   Wow! A great test, Guru!   Aug 22 2005, 12:33
- - user   Chapeau Guruboolez ! Congratulations to the p...   Aug 22 2005, 13:02
- - Aoyumi   Thank you for a test and a detailed report, gurubo...   Aug 22 2005, 13:09
|- - arman68   Very good and comprehensive test. Thank you. It c...   Aug 22 2005, 13:25
- - echo   Once again I am impressed by your professional lis...   Aug 22 2005, 13:22
- - Zurman   Impressive ! And quite surprising (vorbis...   Aug 22 2005, 15:20
- - Ivan Dimkovic   Hi, First of all, thanks Guru for your very hard ...   Aug 22 2005, 16:18
|- - Corsair   QUOTE (Ivan Dimkovic @ Aug 22 2005, 04:18 PM)...   Aug 22 2005, 17:16
- - Mr_Rabid_Teddybear   I'm now really happy I recently purchased this...   Aug 22 2005, 16:33
- - HotshotGG   QUOTE Probably, change of ATH, noise/tone masking,...   Aug 22 2005, 17:37
|- - Aoyumi   QUOTE (HotshotGG @ Aug 23 2005, 01:37 AM)QUOT...   Aug 23 2005, 14:43
- - Ivan Dimkovic   QUOTE (Corsair @ Aug 22 2005, 04:16 PM)QUOTE ...   Aug 22 2005, 17:49
- - Digisurfer   Time to play devils advocate. What is the point of...   Aug 22 2005, 21:26
|- - sh1leshk4   QUOTE (Digisurfer @ Aug 23 2005, 03:26 AM)Wha...   Aug 22 2005, 22:05
|- - Lyx   QUOTE (Digisurfer @ Aug 22 2005, 10:26 PM)The...   Aug 22 2005, 22:06
|- - guruboolez   QUOTE (Digisurfer @ Aug 22 2005, 09:26 PM)Tim...   Aug 22 2005, 22:13
|- - rjamorim   QUOTE (Digisurfer @ Aug 22 2005, 05:26 PM)I c...   Aug 22 2005, 22:14
|- - Digisurfer   QUOTE (rjamorim @ Aug 22 2005, 03:14 PM)QUOTE...   Aug 22 2005, 23:20
|- - guruboolez   QUOTE (Digisurfer @ Aug 22 2005, 11:20 PM)Spe...   Aug 22 2005, 23:52
- - germanjulian   thank you for this great test.   Aug 22 2005, 21:35
- - guruboolez   QUOTE (user @ Aug 22 2005, 01:02 PM)Regarding...   Aug 22 2005, 22:02
|- - user   QUOTE (guruboolez @ Aug 22 2005, 10:02 PM)QUO...   Aug 23 2005, 12:04
|- - rjamorim   QUOTE (user @ Aug 23 2005, 08:04 AM)If a (the...   Aug 23 2005, 14:43
||- - guruboolez   QUOTE (rjamorim @ Aug 23 2005, 02:43 PM)QUOTE...   Aug 23 2005, 14:59
||- - rjamorim   QUOTE (guruboolez @ Aug 23 2005, 10:59 AM)Tru...   Aug 23 2005, 15:52
|- - guruboolez   QUOTE (user @ Aug 23 2005, 12:04 PM)The bitra...   Aug 23 2005, 14:49
- - Axon   While I don't doubt that this is a very signif...   Aug 22 2005, 22:08
|- - ching-3   Great work guru, a very good test. I always beli...   Aug 22 2005, 22:13
- - Lyx   I think the flaw in your logic is that you see thi...   Aug 22 2005, 23:33
- - QuantumKnot   It is always very enjoyable and informative to rea...   Aug 23 2005, 00:27
|- - Mo0zOoH   I feel great urge to thank Guruboolez and Aoyumi f...   Sep 2 2005, 00:58
- - vinnie97   I have to agree with Guru. Either these artifacts...   Aug 23 2005, 01:28
- - boiling_ice2k4   nice listening test guruboolez great to see the ...   Aug 23 2005, 03:19
- - HotshotGG   QUOTE What can I say? I am extremely happy with Og...   Aug 23 2005, 05:25
- - DARcode   Awesome piece of work and information, simply awes...   Aug 30 2005, 15:27
- - guruboolez   Here is the bitrate table (based on 150 full track...   Aug 31 2005, 11:19
- - esa372   Wow! Thank you, guruboolez!   Aug 31 2005, 15:26
- - Pio2001   Thank you for the test. I hope it will encourage o...   Sep 1 2005, 22:34
|- - bug80   QUOTE (Pio2001 @ Sep 1 2005, 11:34 PM)And I t...   Sep 1 2005, 22:50
|- - ff123   QUOTE (bug80 @ Sep 1 2005, 01:50 PM)QUOTE (Pi...   Sep 2 2005, 21:37
- - alter4   And in my opinion, the handling pre-echo mechanism...   Sep 2 2005, 06:14
|- - Yaztromo   QUOTE (alter4 @ Sep 2 2005, 06:14 AM)And in m...   Sep 2 2005, 10:34
- - Aoyumi   QUOTE And in my opinion, the handling pre-echo mec...   Sep 3 2005, 04:22
- - alter4   I tested castanets2 with beta4 Now I have no ABX l...   Sep 5 2005, 08:17
|- - Yaztromo   I will test with beta4 in the next couple of days.   Sep 5 2005, 10:02
- - alter4   the first click in castanets2, no comment!   Sep 8 2005, 09:52
|- - Aoyumi   QUOTE (alter4 @ Sep 8 2005, 05:52 PM)the firs...   Sep 8 2005, 14:04
- - alter4   My friends (I ask theirs to help) say that in cast...   Sep 8 2005, 15:23
- - Aoyumi   >alter4 Can the portion which you ABX(ed) be sh...   Sep 11 2005, 07:45
- - liekloo   I know I'm late. Very late even. But I don...   Sep 15 2005, 22:35
|- - zima   Very impressive...I wish I had sometimes this kind...   Sep 16 2005, 19:35
|- - beto   QUOTE (liekloo @ Sep 15 2005, 06:35 PM)I know...   Sep 16 2005, 21:02
- - Seymour   Guruboolez Great test! Thanks. Surely I'l...   Sep 17 2005, 14:39
- - VEG   Wow! Vorbis bested that MPC on 180kbps?! I...   Sep 22 2005, 21:09
|- - kornchild2002   Thanks for the testing. I can't help but thin...   Sep 22 2005, 22:40
|- - stephanV   QUOTE (kornchild2002 @ Sep 22 2005, 11:40 PM)...   Sep 23 2005, 08:42
- - Donunus   I was just wondering if upping lame 3.97 to preset...   Sep 23 2005, 11:37
- - beto   probably yes. but that's an assumption.   Sep 23 2005, 12:23
- - SCIF   Does anybody with good headphones want to abx-test...   Oct 28 2005, 05:47
|- - de Mon   QUOTE (SCIF @ Oct 27 2005, 08:47 PM)Does anyb...   Oct 28 2005, 08:18
|- - SCIF   QUOTE (de Mon @ Oct 28 2005, 05:18 PM)I bet G...   Nov 2 2005, 06:31
- - kuniklo   I just came across this thread today. Thanks to G...   Oct 31 2005, 22:39
- - lextune   Thanks for this interesting and informative post. ...   Jan 6 2006, 21:37
- - Garf   Re-opening so discussion can continue.   Jan 9 2006, 12:13
- - vinnie97   I saw this thread was locked yesterday with no exp...   Jan 9 2006, 23:38
|- - kode54   QUOTE (vinnie97 @ Jan 9 2006, 02:38 PM)I saw ...   Jan 9 2006, 23:49
- - vinnie97   No need to be testy. I didn't see that *other...   Jan 10 2006, 00:30


Closed TopicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 21st September 2014 - 00:43