IPB

Welcome Guest ( Log In | Register )

LAME 3.96 FINAL vs. 3.90.3 Test, Test/Result Thread
tigre
post Apr 13 2004, 16:17
Post #1


Moderator


Group: Members
Posts: 1434
Joined: 26-November 02
Member No.: 3890



This is stolen from here mostly, since only few things have changed...
----------------------------------------------------------------------


The purpose of this thread is to (finally) test LAME 3.96 throughly enough to make it the new recommended LAME version and enhance communication between LAME developers and the HA.org community. The recent confusion about the different LAME versions and compiles (-Qrcd trouble etc.) have led to the decision that moving along with LAME development has been postponed for long enough and LAME 3.90.X can hopefully be declared dead very soon.
Please test as many samples as possible according to the following guidelines and post any results here.


1. Use the following LAME compiles (last updated on 2004/04/13):
lame3.90.3
lame3.96 final

2. The focus of the test should be --alt-preset/--preset standard, since it will allow us to make conclusions regarding the overall performance of the 'code level tweaked' VBR presets. Other VBR/ABR/CBR presets are interesting too, but not as important. If problems with --alt preset standard are detected feel free to compare extreme and insane too. Test the following combinations please:

VBR/ABR
(~256kbps) 3.96 --preset extreme vs. 3.90.3 --alt-preset extreme
(~210kbps) 3.96 --preset standard vs. 3.90.3 --alt-preset standard
(~160kbps) 3.96 -V 4 vs. 3.96 --preset 160 vs. 3.90.3 --alt-preset 160*
(~128kbps) 3.96 -V 5 vs. 3.96 --preset 128 vs. 3.90.3 --alt-preset 128*

CBR
(320kbps) 3.96 --preset insane vs. 3.90.3 --alt-preset insane
3.96 --preset cbr <bitrate> vs. 3.90.3 --alt-preset cbr <bitrate>

If you want, you can additionally test VBR/ABR vs. CBR at comparable bitrates

3. You may use any sample you want, as long as you upload a losslessly compressed version of that (or provide a working link), so others can verify your results. The upload thead is here. Using samples that have been used for testing 3.96beta is a good idea to show progress/regressions.

4. Your test results have to include the following:
  • ABX results for
    3.90.3 vs. Original
    3.96 vs. Original
    3.96 vs. 3.90.3
  • ABC/HR results are appreciated especially at lower bitrates, but shouldn't be considered a requirement.
  • (Short) descriptions of the artifacts/differences
Notes:

*
Since ABR presets decrease gain as workarround against audible clipping on decoding of loud tracks, please use replaygain (trackgain) for decoding to .wav / ABXing, ideally using foobar2000 (apply to the original as well to get matching volume, of course!). On quiet tracks --scale 1 can be added after --(alt-)preset <bitrate> on encoding alternatively. Details see here


There won't be a separate discussion thread for now. To make it easy to find posts containing results, please start such posts (only!) with "
RESULT". Results matching the requirements that have been posted elsewhere will be added to the "Results" post.

-----------------------------------------------
Edit 1 [2004/04/13]: typo fixed (3.96b2 -> 3.96), thanks to Lyx
Edit 2 [2004[04[14]: Replaygain/--scale related comment added. (-> "*")


This post has been edited by tigre: Apr 14 2004, 19:03


--------------------
Let's suppose that rain washes out a picnic. Who is feeling negative? The rain? Or YOU? What's causing the negative feeling? The rain or your reaction? - Anthony De Mello
Go to the top of the page
+Quote Post
 
Start new topic
Replies
Shingetsu
post Apr 16 2004, 20:08
Post #2





Group: Members
Posts: 22
Joined: 15-April 04
Member No.: 13527



and is there some quality loss betwen 3.90.3 and 3.96 which could be audibly in normal music ? this sounds all so complicated.
Go to the top of the page
+Quote Post

Posts in this topic
- tigre   LAME 3.96 FINAL vs. 3.90.3 Test   Apr 13 2004, 16:17
- - tigre   Test results so far: VBR/ABR ~ 256kbps -------...   Apr 13 2004, 17:10
- - Latexxx   QUOTE (Lyx @ Apr 13 2004, 06:19 PM)small typo...   Apr 13 2004, 17:39
- - High Fidelity   RESULT I did a short ABX with fatboy.wav for pre...   Apr 13 2004, 20:18
- - ff123   RESULT My settings: 3.90.3 --alt-preset 128 --sc...   Apr 14 2004, 08:18
- - tigre   Thanks for the results so far. I've performed...   Apr 14 2004, 10:50
- - tigre   The results post should be up-to-date now. Only th...   Apr 14 2004, 14:39
- - ff123   QUOTE (tigre @ Apr 14 2004, 05:39 AM)The resu...   Apr 14 2004, 16:51
- - ff123   I am unable to reproduce the dropout problem in 41...   Apr 14 2004, 17:15
- - Gabriel   QUOTE I am unable to reproduce the dropout problem...   Apr 14 2004, 17:18
- - ff123   QUOTE (Gabriel @ Apr 14 2004, 08:18 AM)QUOTE ...   Apr 14 2004, 17:26
- - tigre   QUOTE (ff123 @ Apr 14 2004, 05:51 PM)BTW, you...   Apr 14 2004, 17:32
- - ff123   QUOTE (tigre @ Apr 14 2004, 08:32 AM)I didn...   Apr 14 2004, 17:48
- - tigre   Thanks for the explanation, ff123. QUOTE --scale ...   Apr 14 2004, 18:07
- - ff123   QUOTE (tigre @ Apr 14 2004, 09:07 AM)Could yo...   Apr 14 2004, 18:18
- - Gabriel   QUOTE Are you talking about the clicking sounds? I...   Apr 14 2004, 18:36
- - Gecko   RESULT Sample: 41_30sec.flac (Which I downloaded ...   Apr 14 2004, 18:53
- - ff123   QUOTE (Gecko @ Apr 14 2004, 09:53 AM)The arti...   Apr 14 2004, 21:56
- - ViPER1313   This whole thing has been blown out of proportion....   Apr 15 2004, 03:44
- - Gabriel   QUOTE What do you mean by "failure?" I m...   Apr 15 2004, 08:41
- - 2Bdecided   QUOTE (Gabriel @ Apr 15 2004, 07:41 AM)Regard...   Apr 15 2004, 09:33
- - tigre   RESULTS Tested settings: Lame 3.90.3 --alt-preset...   Apr 15 2004, 14:42
- - Lyx   I'm not sure if this is off-topic, so if it is...   Apr 15 2004, 15:28
- - ViPER1313   RESULT Layla test sample using v3.90.3 and v3.96 ...   Apr 15 2004, 15:48
- - tigre   Lyx: Could you give some more details please? - H...   Apr 15 2004, 16:09
- - Lyx   I didn't do the test with 3.90.3 myself yet. t...   Apr 15 2004, 16:40
- - Gecko   QUOTE (ff123 @ Apr 14 2004, 10:56 PM)None of ...   Apr 15 2004, 19:03
- - ssamadhi97   QUOTE (2Bdecided @ Apr 15 2004, 09:33 AM)That...   Apr 15 2004, 19:10
- - tigre   RESULTS Tested settings: Lame 3.90.3 --alt-preset...   Apr 15 2004, 23:22
- - ff123   QUOTE (tigre @ Apr 15 2004, 02:22 PM)RESULTS ...   Apr 16 2004, 01:03
- - FatBoyFin   RESULT QUOTE 3.96b2 -V 5 > 3.90.3 --ap 128 :: ...   Apr 16 2004, 12:29
- - tigre   RESULTS Tested settings: Lame 3.90.3 --alt-preset...   Apr 16 2004, 13:22
- - [proxima]   RESULTS Tested settings: Lame 3.90.2 --alt-preset...   Apr 16 2004, 15:48
- - ff123   QUOTE ([proxima),Apr 16 2004, 06:48 AM] Black...   Apr 16 2004, 16:08
- - tigre   RESULTS Tested settings: Lame 3.90.3 --alt-preset...   Apr 16 2004, 16:30
- - [proxima]   QUOTE (ff123 @ Apr 16 2004, 04:08 PM)QUOTE (...   Apr 16 2004, 16:37
- - tigre   I haven't compared directly 3.96 beta vs. 3.96...   Apr 16 2004, 16:57
- - ff123   For tigre, the results of the 12 samples do not in...   Apr 16 2004, 17:00
- - tigre   QUOTE ([proxima),Apr 16 2004, 04:48 PM] @tigr...   Apr 16 2004, 17:01
- - tigre   QUOTE (ff123 @ Apr 16 2004, 06:00 PM)For tigr...   Apr 16 2004, 17:10
- - Hoosierdaddy   "How it sounds like: mostly clicks and pops.....   Apr 16 2004, 19:19
- - Shingetsu   and is there some quality loss betwen 3.90.3 and 3...   Apr 16 2004, 20:08
- - ff123   CODEMeans: 3.96V5   3.96p128 3.90.3 ...   Apr 16 2004, 20:13
- - ff123   BTW, have there been bitrate tests of 3.96 -V5? f...   Apr 16 2004, 20:18
- - tigre   QUOTE (ff123 @ Apr 16 2004, 09:18 PM)BTW, hav...   Apr 16 2004, 20:54
- - Jack Comics   QUOTE (tigre @ Apr 16 2004, 02:54 PM)Only wit...   Apr 16 2004, 21:24
- - tigre   Jack Comics - you're right. I've already f...   Apr 16 2004, 22:17
- - detokaal   16 files 779,114 kb wav Total Time is 75:22 Lame...   Apr 16 2004, 22:19
- - [proxima]   QUOTE Could you please provide links to the sample...   Apr 17 2004, 00:51
- - freakngoat   RESULTS Drone_short, aps, 0-1.2 sec 3.90.3 vs. o...   Apr 17 2004, 01:18
- - freakngoat   In drone_short, the use of alt-preset extreme grea...   Apr 17 2004, 12:35
- - eagleray   Is this size thing, 3.96 -pe being smaller than 39...   Apr 17 2004, 15:18
- - [proxima]   RESULTS Tested settings: Lame 3.90.2 --alt-preset...   Apr 17 2004, 15:27
- - detokaal   Quick questions about ratings before I post result...   Apr 17 2004, 16:02
- - eagleray   Forther to on file sizes: These are the results f...   Apr 17 2004, 16:07
- - tigre   QUOTE (eagleray @ Apr 17 2004, 04:18 PM)Is th...   Apr 17 2004, 16:10
- - Gecko   QUOTE (detokaal @ Apr 17 2004, 05:02 PM)What ...   Apr 17 2004, 18:53
- - ff123   QUOTE (detokaal @ Apr 17 2004, 07:02 AM)What ...   Apr 17 2004, 19:02
- - Gabriel   QUOTE 3.96 --p 128 > 3.90.3 --ap 128 :: fall :...   Apr 18 2004, 13:26
- - tigre   QUOTE (Gabriel @ Apr 18 2004, 02:26 PM)QUOTE ...   Apr 18 2004, 13:48
- - freakngoat   RESULTS Drone_short, 0-1.2 sec 3.96pe vs. Origin...   Apr 19 2004, 02:59
- - freakngoat   Though I think 3.96 beat 3.90.3 overall in both ps...   Apr 19 2004, 03:33
- - freakngoat   RESULTS Verifying fatboy with alt-preset standard...   Apr 19 2004, 05:18
- - tigre   I've repeated the bitrate test with 3.96 final...   Apr 19 2004, 08:45
- - LoFiYo   I'm not sure if this will be qualified as vali...   Apr 20 2004, 04:56
- - 2Bdecided   Not very interesting, but... fatboy_30sec.wav (up...   Apr 20 2004, 13:39
- - 2Bdecided   More interesting... awe32_20sec.wav (I'll upl...   Apr 20 2004, 13:45
- - [proxima]   I think 3.96 with -V 5 quality is good and this is...   Apr 20 2004, 14:44
- - ff123   With proxima's ratings from Apr 17, using the ...   Apr 20 2004, 15:10
- - [proxima]   I just tested and uploaded two more samples provid...   Apr 20 2004, 18:04
- - tigre   New results edited in. [proxima], thanks for you...   Apr 21 2004, 15:37
- - 2Bdecided   Another result... vangelis1.wav 3.90.3 --alt-pres...   Apr 21 2004, 17:52
- - 2Bdecided   Maybe someone else can check guruboolez's samp...   Apr 21 2004, 18:04
- - Lyx   I just got the sample which triggered the gapless-...   Apr 21 2004, 20:40
- - LoFiYo   QUOTE (tigre @ Apr 13 2004, 11:10 AM)--------...   Apr 21 2004, 21:52
- - [proxima]   QUOTE (tigre @ Apr 21 2004, 03:37 PM)but no m...   Apr 21 2004, 23:30
- - freakngoat   CORRECTION: For drone_short, 3.96 -V1 is not bett...   Apr 22 2004, 01:02
- - Jebus   QUOTE (freakngoat @ Apr 21 2004, 04:02 PM)COR...   Apr 22 2004, 02:33
- - freakngoat   QUOTE (Jebus @ Apr 22 2004, 01:33 AM)QUOTE (f...   Apr 22 2004, 04:10
- - Jebus   ah, forgot there was a -V0   Apr 22 2004, 05:21
- - ff123   [proxima]: How does 3.96 -V5 --athaa-sensitivity ...   Apr 22 2004, 15:27
- - [proxima]   QUOTE (ff123 @ Apr 22 2004, 03:27 PM)How does...   Apr 22 2004, 22:33
- - ff123   QUOTE ([proxima),Apr 22 2004, 01:33 PM] QUOTE...   Apr 22 2004, 23:20
- - tigre   Posts discussing technical details about --athaa-s...   Apr 23 2004, 13:33
- - Gabriel   For those sensitive to high freq problems in prese...   Apr 25 2004, 13:57
- - Gabriel   http://www.hydrogenaudio.org/forums/index....ndpos...   Apr 30 2004, 10:47
- - cuan   so were there any conclusions drawn from this test...   May 7 2004, 17:49
- - freakngoat   QUOTE (cuan @ May 7 2004, 04:49 PM)so were th...   May 11 2004, 22:43
- - Jojo   QUOTE (freakngoat @ May 11 2004, 01:43 PM)3.9...   May 12 2004, 13:09
- - Karlosak   QUOTE (Jojo @ May 12 2004, 04:09 AM)QUOTE (fr...   May 12 2004, 15:00
- - Jebus   I'm slowly reencoding my ~300CD collection rig...   May 12 2004, 15:23
- - indybrett   I've encoded a few hundred CD's now with 3...   May 12 2004, 15:55
- - Sunhillow   QUOTE (Karlosak @ May 12 2004, 04:00 PM)I hav...   May 12 2004, 16:02
- - Matyas   So i won't loose anything by switching to 3.96...   May 14 2004, 12:25
- - Jojo   QUOTE (Matyas @ May 14 2004, 03:25 AM)So i wo...   May 14 2004, 13:03
- - xmixahlx   right. faster +better on some samples +worse on o...   May 14 2004, 17:17
- - LordofStars   The only think I have against 3.96. is that I don...   May 15 2004, 02:02
- - bluddnok   Okay, I have a hard-drive full of .wav files just ...   May 15 2004, 03:13
- - LordofStars   Tried and true is all I have to say.   May 15 2004, 05:44
- - Lyx   QUOTE (LordofStars @ May 15 2004, 01:02 AM)Th...   May 15 2004, 13:34
2 Pages V   1 2 >


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 30th August 2014 - 06:03