IPB

Welcome Guest ( Log In | Register )

48 kbps listening test, pretest discussion thread, Pretest thread / Encoder settings
Shade[ST]
post Dec 12 2005, 17:06
Post #1





Group: Members
Posts: 1189
Joined: 19-May 05
From: Montreal, Canada
Member No.: 22144



Hello!

After assisting like many of you on the controversy of guruboolez' tests concerning the Nero AAC encoders and having seen many suggestions towards preparing a listening test around 48kbps - in particular with the different HE encoders, I decided to take matters into my own hands.
I currently have 8 samples testing for tonality, transients and stereo separation. These are generally classical music, but also include electronic music, 80s pop, and I might add a jazz recording for ambience reproduction.
As for encoders, I'm stumped.

Should I also include an old version of nero (old being relative) as to see the progress in a general evaluation ? At this bitrate, many encoders is not really a problem, is it? For now, I was thinking :

-Nero AAC Tape / PNS Enabled / HE / High (Should I enable hint track?)
-Ogg Vorbis, latest AoTuV, q -2 to -4 (whatever's approximately the same bitrates ~42-53)
-Lame ABR 48 (any tunings suggested?)
-mp3pro, probably, at any close bitrate I can achieve (adobe audition's encoder)
-Itunes AAC (HE if available)
-CT encoder (winamp 5.12) 48kbps, HE.

If I should use an older nero as well, where can I find it?

Also, could anyone help me prepare the ABC/HR logs? (eg, Sebastian Mares)
Thanks in advance,
Tristan.
Go to the top of the page
+Quote Post
 
Start new topic
Replies
Ivan Dimkovic
post Dec 13 2005, 17:34
Post #2


Nero MPEG4 developer


Group: Developer
Posts: 1466
Joined: 22-September 01
Member No.: 8



QUOTE
Any word of yet as to how any of these tests are going to be set up?


As for my idea of 48 kbps AAC-only pre-test, I am still waiting for the reply of the person I mentioned (sorry to keep name private, I will of course reveal it as soon as/if he accepts)

My proposal (to be discussed further) would be the following:

#1 - We will have open discussion on HA of the sample set, that should last couple of days - my current idea and proposal would be to use 10-15 samples that scored worst in previous Roberto's 64 and 128 multiformat listening tests. "Worst" means lowest average SDG for all codecs used to code that sample, excluding low-anchors

#2 - Myself and Person X wink.gif will encode files in CT's, Nero's and anchor formats, previously agreeing on the coding modes, and making public verification of the bitrates.

#3 - We will exchange the files and verify they are the same and within the bit-rate criteria

#4 - We will preapre and sign the ABC-HR test sets, upload the file and store the codec list.

This is just my rough idea about the AAC pre-test - I do have very strong belief that testing v1 and v2 HE-AAC modes @48 kbps would have a huge value before the multiformat 48 kbps test.

QUOTE
I think Gabriel has a good idea at comparing various AAC contenders before a multiformat test; Also, organizing many tests might make people feel more enthusiastic about the community, and thus conduce a retour en force of hydrogenaudio.


Agreed completely smile.gif

I also think that it would be good that HA as the whole takes more active role in this - people behind the test organization would surely get the credit, and HA could host the results as unique one-and-only listening test database.

This post has been edited by Ivan Dimkovic: Dec 13 2005, 17:37
Go to the top of the page
+Quote Post
IgorC
post Dec 13 2005, 19:40
Post #3





Group: Members
Posts: 1553
Joined: 3-January 05
From: ARG/RUS
Member No.: 18803



It wil be good to see not only music samples but also movie tracks (for video encoding), (wo)man speech for radio. This way test will be more usefull for different aplications.

Maybe it will be also interesting to see how perform codec with and withoust PS.
48 kbit/s (VBR aprrox 51-52 kbit/s) is highest bitrate when PS is still usefull.

This post has been edited by IgorC: Dec 13 2005, 19:41
Go to the top of the page
+Quote Post
Halcyon
post Dec 13 2005, 21:24
Post #4





Group: Members
Posts: 244
Joined: 6-November 01
Member No.: 416



Before you start any test, I suggest you take the sane advice given already in this thread.

Also, read all the previous pre-test discussion threads very carefully and ask if you don't understand something.

The first question any tester should ask is: why am I doing this test? What do I want to find out.

Define your test question first.
Go to the top of the page
+Quote Post

Posts in this topic
- Shade[ST]   48 kbps listening test, pretest discussion thread   Dec 12 2005, 17:06
- - guruboolez   Is it a collective listening test or a personal ex...   Dec 12 2005, 17:10
|- - Shade[ST]   QUOTE (guruboolez @ Dec 12 2005, 10:10 AM)Is ...   Dec 12 2005, 17:14
- - guruboolez   Isn't it a bit premature to start a new pretes...   Dec 12 2005, 17:16
- - Ivan Dimkovic   If it is a collective test, may I ask for delaying...   Dec 12 2005, 17:16
|- - Shade[ST]   QUOTE (Ivan Dimkovic @ Dec 12 2005, 10:16 AM)...   Dec 12 2005, 17:20
|- - naylor83   QUOTE (Shade[ST] @ Dec 12 2005, 06:2...   Dec 12 2005, 17:46
- - Sebastian Mares   I think the whole thing is too rushed. Personally,...   Dec 12 2005, 17:52
|- - naylor83   QUOTE (Sebastian Mares @ Dec 12 2005, 06:52 P...   Dec 12 2005, 18:22
||- - Sebastian Mares   QUOTE (naylor83 @ Dec 12 2005, 06:22 PM)QUOTE...   Dec 12 2005, 18:24
||- - naylor83   QUOTE (Sebastian Mares @ Dec 12 2005, 07:24 P...   Dec 12 2005, 18:34
||- - Shade[ST]   I was thinking maybe about making LAME the low anc...   Dec 12 2005, 21:20
|- - user   QUOTE (Sebastian Mares @ Dec 12 2005, 05:52 P...   Dec 14 2005, 12:00
- - Sebastian Mares   Regarding the encoders again - personally, I would...   Dec 12 2005, 18:32
|- - Latexxx   I'd personally drop mp3pro because its margina...   Dec 12 2005, 21:35
|- - dimzon   QUOTE (Latexxx @ Dec 13 2005, 12:35 AM) mp3 (...   Dec 13 2005, 09:38
- - Gambit   With all respect, Shade[ST], this is a really bad ...   Dec 12 2005, 21:17
- - rjamorim   QUOTE (Shade[ST] @ Dec 12 2005, 02:2...   Dec 13 2005, 00:46
|- - Shade[ST]   QUOTE (rjamorim @ Dec 12 2005, 05:46 PM)QUOTE...   Dec 13 2005, 04:07
|- - naylor83   QUOTE (Shade[ST] @ Dec 13 2005, 05:0...   Dec 13 2005, 10:10
- - Ivan Dimkovic   QUOTE don't forget about 3GP reference encoder...   Dec 13 2005, 10:42
|- - dimzon   QUOTE (Ivan Dimkovic @ Dec 13 2005, 01:42 PM)...   Dec 13 2005, 17:20
- - Gabriel   My opinions is that it could be a good idea to fir...   Dec 13 2005, 12:51
- - Ivan Dimkovic   But @Gabriel, do you think that the 32kbps resutls...   Dec 13 2005, 13:13
|- - stephanV   QUOTE (Ivan Dimkovic @ Dec 13 2005, 01:13 PM)...   Dec 13 2005, 14:05
- - Ivan Dimkovic   QUOTE You are kidding right? I wish - but reading...   Dec 13 2005, 14:17
|- - Shade[ST]   Any word of yet as to how any of these tests are g...   Dec 13 2005, 16:10
- - Ivan Dimkovic   QUOTE Any word of yet as to how any of these tests...   Dec 13 2005, 17:34
|- - IgorC   It wil be good to see not only music samples but a...   Dec 13 2005, 19:40
|- - Halcyon   Before you start any test, I suggest you take the ...   Dec 13 2005, 21:24
- - Ivan Dimkovic   Gabriel and I discussed these ideas - and we will ...   Dec 14 2005, 12:43
- - fpi   Before testing aoTuV beta 4.51 would be interestin...   Dec 14 2005, 16:45
- - gameplaya15143   QUOTE (fpi @ Dec 14 2005, 10:45 AM)Before tes...   Jan 18 2006, 04:15
- - pepoluan   Ahhh... the thread has been resurrected So. Is...   Jan 19 2006, 17:51


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 20th August 2014 - 09:14