IPB

Welcome Guest ( Log In | Register )

General discussion of future public test
IgorC
post Dec 21 2011, 16:28
Post #1





Group: Members
Posts: 1575
Joined: 3-January 05
From: ARG/RUS
Member No.: 18803



Hello,
Now when itís sure that Apple encoder represents AAC standard very well the next step will be a public multiformat test.
No particular date or plan. Itís a general discussion with the purpose to hear the opinions, points of view, suggestions.

Items to talk about (these numbers are first approximations):
1.The number of codecs: 4+low anchor. 4 is affordable number for one test.
2.The selection of codecs (basing on curret previous votes):
http://listening-test.blogspot.com/2011/06...reparation.html

Apple LC-AAC - the most optimal AAC encoder. (Well, though FhG was quite good too).
MP3 LAME Ė 10 votes
Vorbis AoTuV Ė 8.5 votes.
Opus/CELT Ė 6 votes. (still no info when there will be Opus 1.0)

Itís possible to change your votes.

(?) USAC (working name of future AACís successor ). No information about future availability of it.
(?) low anchor
(?) Settings, versions, etc.

3. Bitrate:
VBR 96 kbps. The last AAC public test was at 96 kbps (well, it was actually 100 kbps).
Also I think it will be more interesting to compare MP3 128-135 kbps and AAC/AoTuV 96-100 kbps. Probably a lot of people are interesting to trade off between compability/compression efficiency smile.gif

4. Samples.
Last time we have applied the technic of random selection of the samples. 20 samples.

The developers are very welcome to participate in this topic.

This test should be more interesting as it will include interesting (for use) codecs. biggrin.gif
Go to the top of the page
+Quote Post
 
Start new topic
Replies
Gainless
post Aug 9 2012, 14:14
Post #2





Group: Members
Posts: 173
Joined: 28-October 11
Member No.: 94764



I think it would be a good idea to make another AAC listening at first (Maybe just QT vs. FhG) since the development of the Winamp encoder has been quite active.
Go to the top of the page
+Quote Post
Garf
post Aug 9 2012, 16:09
Post #3


Server Admin


Group: Admin
Posts: 4885
Joined: 24-September 01
Member No.: 13



QUOTE (Gainless @ Aug 9 2012, 15:14) *
I think it would be a good idea to make another AAC listening at first (Maybe just QT vs. FhG) since the development of the Winamp encoder has been quite active.


Comparison of the commercial codec to the free one that was open sourced (bought by Google) would also be interesting.

Ideally I'd like to see, somewhere in the 48-96kbps range: Vorbis, FhG, FhG-free, Apple AAC, LAME (if 96kbps), Opus and USAC. Though it's likely too early for USAC.
Go to the top of the page
+Quote Post
jensend
post Aug 10 2012, 04:09
Post #4





Group: Members
Posts: 145
Joined: 21-May 05
Member No.: 22191



QUOTE (Garf @ Aug 9 2012, 09:09) *
Ideally I'd like to see, somewhere in the 48-96kbps range: Vorbis, FhG, FhG-free, Apple AAC, LAME (if 96kbps), Opus and USAC. Though it's likely too early for USAC.

That's quite a lot to expect from one test. How many people would rate all 140 samples?

Keep in mind that there will be extra listener fatigue from trying to distinguish between encodes which are pretty transparent, especially for those of us without stellar golden ears. A 96kbps test is going to be considerably harder on people than a 64kbps test, and even in that test, which only had five encoders, only ten people submitted results for all samples.

FhG lost the public AAC 96kbps test to Apple last year by a statistically significant margin. Yes, it's been updated in the meantime and may be competitive with Apple's encoder at 96kbps now, and maybe it's noticeably better than Apple's for HE-AAC and <80kbps bitrates, but I don't think it's an important enough reference point at 96kbps to justify its inclusion at this stage.

Not only is it too early for USAC (no quality stereo encoder publicly available yet), but everything I see supports the idea that it's not really targeted at this bitrate anyway.

Let's just be sure to plan on another lower-bitrate test in the near future -probably 64kbps again, though I'd like to see one at ~48kbps too- to look at updated HE-AAC encoders, improvement in opus since the last test at that bitrate, and USAC.
Go to the top of the page
+Quote Post

Posts in this topic
- IgorC   General discussion of future public test   Dec 21 2011, 16:28
- - Steve Forte Rio   Nice... QUOTE Itís possible to change your votes....   Dec 22 2011, 16:45
- - IgorC   Good. Guys, propose the codecs you are intereste...   Dec 22 2011, 17:03
- - IgorC   There is a first issue if MP3 will be tested at 96...   Dec 22 2011, 20:17
|- - NullC   QUOTE (IgorC @ Dec 22 2011, 12:17) There ...   Dec 22 2011, 21:44
|- - Nick.C   QUOTE (IgorC @ Dec 22 2011, 19:17) Possib...   Dec 22 2011, 22:34
- - lvqcl   8.5 votes? then: +1 for AAC +1 for Vorbis +0.5...   Dec 22 2011, 20:37
- - Kohlrabi   I'd like to see how Opus will perform here, so...   Dec 22 2011, 21:10
- - IgorC   Not all cards support automatic switching between ...   Dec 23 2011, 14:16
- - halb27   The fact that Lame resamples to 32 kHz at 96 kbps ...   Dec 23 2011, 16:37
|- - nu774   QUOTE (halb27 @ Dec 24 2011, 00:37) The f...   Dec 23 2011, 17:24
- - IgorC   Also this time I will be glad to be just a listene...   Dec 24 2011, 00:53
- - IgorC   Some feedback was received on #Hydrogenaudio and ...   Dec 25 2011, 18:18
- - Yaztromo   +1 QT AAC +1 Vorbis (Aotuv b603?) +1 LAME 3.99 +0....   Dec 26 2011, 02:33
- - Gecko   +1 for keeping the number of codecs small. Conside...   Dec 26 2011, 12:43
- - IgorC   Very low quality low anchor permits to analyse the...   Dec 26 2011, 14:10
|- - knik   How about FAAC, I think it could be good as anchor...   Mar 2 2012, 10:44
- - Kohlrabi   Any chance to see Musepack competing against curre...   Mar 2 2012, 12:41
- - jensend   USAC has been "released" with the confus...   Mar 3 2012, 08:06
|- - knik   QUOTE Anybody who thinks that MP3 should only be t...   Mar 3 2012, 09:50
- - Pretentiousman   +1 Apple LC-AAC +1 MP3 LAME @ 128-135 kbps +1 Vorb...   Mar 7 2012, 22:03
- - Gainless   I think it would be a good idea to make another AA...   Aug 9 2012, 14:14
- - Garf   QUOTE (Gainless @ Aug 9 2012, 15:14) I th...   Aug 9 2012, 16:09
|- - jensend   QUOTE (Garf @ Aug 9 2012, 09:09) Ideally ...   Aug 10 2012, 04:09
- - IgorC   QUOTE (Gainless @ Aug 9 2012, 10:14) I th...   Aug 16 2012, 14:48


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 20th September 2014 - 05:01