IPB

Welcome Guest ( Log In | Register )

New opus test build
NullC
post Apr 16 2013, 23:31
Post #1





Group: Developer
Posts: 200
Joined: 8-July 03
Member No.: 7653



I've posted up a new win32 build of libopus git master: https://people.xiph.org/~greg/opus-tools_exp_a8783a1.zip

There aren't many major changes from the prior alpha but a number of small bugs fix, some of which impact quality. I think we're particular interested in knowing about any quality regressions vs prior versions and particular cases where the speech/music detection get confused. (For the actual release we'll likely back that detector off at high rates but for now it's set more aggressively in order to find problems)
Go to the top of the page
+Quote Post
 
Start new topic
Replies
Gainless
post Apr 21 2013, 15:18
Post #2





Group: Members
Posts: 173
Joined: 28-October 11
Member No.: 94764



Ok, I've done ABC-HR tests with the samples at 128 kb/s VBR, with nice results for the new build, it performed either equally or better than the older versions. "Sycho Active" was even transparent, seems like I've accidentally ABXed a wrong version there (1.1 and 1.0.2 have a lot of trouble with that one).

Sycho Active:
CODE
ABC/HR Version 1.1 beta 2, 18 June 2004
Testname: Sycho Active

1R = C:\Users\Master O\Desktop\Opus Samples\Sycho_Active__Sample_(1.1).wav
2L = C:\Users\Master O\Desktop\Opus Samples\Sycho_Active__Sample_(1.0.2).wav
3R = C:\Users\Master O\Desktop\Opus Samples\Sycho_Active__Sample_(Exp).wav

---------------------------------------
General Comments:
Comparison of Opus vers. 1.0.2, 1.1 alpha and the last exp build from 17.04.2013 at 128 kb/s VBR. Exp is the clear winner here.
---------------------------------------
1.1
1R Rating: 1.8
1R Comment: Several heavy distortions, cymbal is fine though.
---------------------------------------
1.0.2
2L Rating: 2.0
2L Comment: Same distortion character as in 1.1, but not as loud.
---------------------------------------
ABX Results:
Original vs C:\Users\Master O\Desktop\Opus Samples\Sycho_Active__Sample_(1.1).wav
12 out of 12, pval < 0.001
Original vs C:\Users\Master O\Desktop\Opus Samples\Sycho_Active__Sample_(1.0.2).wav
10 out of 10, pval < 0.001
Original vs C:\Users\Master O\Desktop\Opus Samples\Sycho_Active__Sample_(Exp).wav
5 out of 10, pval = 0.623


Girl In The Fire:
CODE
ABC/HR Version 1.1 beta 2, 18 June 2004
Testname: Poquito Mas

Tester: fdighdfb

1L = C:\Users\Master O\Desktop\Opus Samples\Girl_In_The_Fire__Sample_(1.0.2).wav
2R = C:\Users\Master O\Desktop\Opus Samples\Girl_In_The_Fire__Sample_(1.1).wav
3L = C:\Users\Master O\Desktop\Opus Samples\Girl_In_The_Fire__Sample_(Exp).wav

---------------------------------------
General Comments:
Comparison of Opus vers. 1.0.2., 1.1 alpha and the last exp build from 17.04.2013 at 128 kb/s VBR.

All versions introduced a slight distortion on the 3rd strike of the guitar on the right channel, a bit annoying, but not terrible.

(Forgot to change the test name)
---------------------------------------
1.0.2
1L Rating: 3.5
1L Comment:
---------------------------------------
1.1 alpha
2R Rating: 3.5
2R Comment:
---------------------------------------
Latest exp build
3L Rating: 3.5
3L Comment:
---------------------------------------
ABX Results:
Original vs C:\Users\Master O\Desktop\Opus Samples\Girl_In_The_Fire__Sample_(1.0.2).wav
9 out of 9, pval = 0.002
Original vs C:\Users\Master O\Desktop\Opus Samples\Girl_In_The_Fire__Sample_(1.1).wav
10 out of 10, pval < 0.001
Original vs C:\Users\Master O\Desktop\Opus Samples\Girl_In_The_Fire__Sample_(Exp).wav
10 out of 10, pval < 0.001


Poquito Mas:
CODE
ABC/HR Version 1.1 beta 2, 18 June 2004
Testname: Poquito Mas

Tester: fdighdfb

1R = C:\Users\Master O\Desktop\Opus Samples\Poquito_Mas__Sample_(1.0.2).wav
2R = C:\Users\Master O\Desktop\Opus Samples\Poquito_Mas__Sample_(1.1).wav
3R = C:\Users\Master O\Desktop\Opus Samples\Poquito_Mas__Sample_(Exp).wav

---------------------------------------
General Comments:
Opus vers. 1.0.2, 1.1 alpha and the last exp build from 17.04.2013. at 128 kb/s were compared. 1.0.2 performs worst.
---------------------------------------
1.0.2
1R Rating: 1.5
1R Comment: Heeeavy tonal distortions.
---------------------------------------
1.1
2R Rating: 2.5
2R Comment: Same distortion character as in 1.0.2, but a lot more subtle. Still quite annoying.
---------------------------------------
Latest exp build
3R Rating: 2.5
3R Comment: Same as 1.1
---------------------------------------
ABX Results:
Original vs C:\Users\Master O\Desktop\Opus Samples\Poquito_Mas__Sample_(1.0.2).wav
10 out of 10, pval < 0.001
Original vs C:\Users\Master O\Desktop\Opus Samples\Poquito_Mas__Sample_(1.1).wav
11 out of 11, pval < 0.001
Original vs C:\Users\Master O\Desktop\Opus Samples\Poquito_Mas__Sample_(Exp).wav
11 out of 11, pval < 0.001


Blender:
CODE
ABC/HR Version 1.1 beta 2, 18 June 2004
Testname: asfsadfsdg

Tester: fdighdfb

1L = C:\Users\Master O\Desktop\Opus Samples\Blender__Sample_(1.0.2).wav
2R = C:\Users\Master O\Desktop\Opus Samples\Blender__Sample_(Exp).wav
3R = C:\Users\Master O\Desktop\Opus Samples\Blender__Sample_(1.1).wav

---------------------------------------
General Comments:
Comparing Opus ver. 1.0.2, 1.1 Alpha and the last exp build from 17.04.2013
at 128 kb/s VBR.

All versions introduced noisy distortions on the guitar of the left channel.
---------------------------------------
1.0.2
1L Rating: 3.3
1L Comment:
---------------------------------------
Latest Exp build
2R Rating: 3.3
2R Comment:
---------------------------------------
1.1
3R Rating: 3.3
3R Comment:
---------------------------------------
ABX Results:
Original vs C:\Users\Master O\Desktop\Opus Samples\Blender__Sample_(1.0.2).wav
7 out of 8, pval = 0.035
Original vs C:\Users\Master O\Desktop\Opus Samples\Blender__Sample_(Exp).wav
8 out of 8, pval = 0.004
Original vs C:\Users\Master O\Desktop\Opus Samples\Blender__Sample_(1.1).wav
8 out of 8, pval = 0.004


This post has been edited by Gainless: Apr 21 2013, 15:28
Go to the top of the page
+Quote Post

Posts in this topic
- NullC   New opus test build   Apr 16 2013, 23:31
- - Dynamic   I was trying to test the speech/music detection, b...   Apr 17 2013, 19:32
|- - jmvalin   QUOTE (Dynamic @ Apr 17 2013, 14:32) I wa...   Apr 17 2013, 21:13
- - Gainless   Good to see the Muse Breaks fix finally bundled. B...   Apr 17 2013, 20:32
|- - jmvalin   QUOTE (Gainless @ Apr 17 2013, 15:32) Goo...   Apr 17 2013, 21:13
|- - Gainless   QUOTE (jmvalin @ Apr 17 2013, 22:13) I th...   Apr 19 2013, 14:57
- - CoRoNe   Using this test build (libopus 1.1a-67) to encode ...   Apr 18 2013, 20:27
- - Gainless   Forgot to add this one: Probably the worst of the...   Apr 20 2013, 10:52
- - IgorC   Gainless, Can You provide some ABC/HR logs compar...   Apr 20 2013, 16:14
|- - Gainless   QUOTE (IgorC @ Apr 20 2013, 17:14) Gainle...   Apr 21 2013, 10:33
- - IgorC   Here are some results for 96 kbps 1.0.2 https://f...   Apr 21 2013, 02:32
- - Kamedo2   I visualized IgorC's precious results on the p...   Apr 21 2013, 03:17
- - IgorC   Thank You, Kamedo2. I was thinking to add it but h...   Apr 21 2013, 04:00
- - Gainless   Ok, I've done ABC-HR tests with the samples at...   Apr 21 2013, 15:18
- - IgorC   There are two first samples (01 and 05) those have...   Apr 25 2013, 05:39
- - Gainless   What I don't really get, is why Opus's VBR...   Apr 25 2013, 10:41
|- - jmvalin   QUOTE (Gainless @ Apr 25 2013, 05:41) Wha...   Apr 25 2013, 13:06
|- - Gainless   QUOTE (jmvalin @ Apr 25 2013, 14:06) That...   Apr 25 2013, 14:00
|- - jmvalin   QUOTE (Gainless @ Apr 25 2013, 09:00) Can...   Apr 25 2013, 16:45
|- - Gainless   QUOTE (jmvalin @ Apr 25 2013, 17:45) Depe...   Apr 25 2013, 21:27
- - IgorC   Gainless, Some time ago You have submited one sam...   Apr 25 2013, 21:56
|- - Gainless   QUOTE (IgorC @ Apr 25 2013, 22:56) Gainle...   Apr 25 2013, 22:11
- - IgorC   Yes, it was Project 100 Sample. http://www.hydrog...   Apr 27 2013, 19:35
- - Gainless   Ok, then this is at least clear. What's probab...   Apr 27 2013, 21:11
- - IgorC   Have tried "Iron Man" sample with the ex...   May 11 2013, 19:26
- - Gainless   Igor, you may also take this sample into considera...   May 12 2013, 12:26
- - IgorC   Gainless, Yes, 1.0.2 was better than the experi...   May 12 2013, 21:42
- - Gainless   Maybe some framesize otpimation/detector can be do...   May 13 2013, 20:33
|- - jmvalin   QUOTE (Gainless @ May 13 2013, 15:33) Btw...   May 14 2013, 04:52
|- - Gainless   Sorry^1000 to Jmvalin and Igor, was my fault with ...   May 14 2013, 08:10
- - Gainless   Here's another sample that could benefit from ...   May 23 2013, 17:15
|- - jmvalin   QUOTE (Gainless @ May 23 2013, 12:15) Her...   May 24 2013, 08:43
|- - Gainless   QUOTE (jmvalin @ May 24 2013, 09:43) QUOT...   Jun 2 2013, 21:41
- - ChristianK   Hi, is this the place to also discus the latest ve...   Jun 14 2013, 19:02
- - ChristianK   Well, I'll just go ahead and post my question ...   Jun 16 2013, 22:02
|- - jmvalin   QUOTE (ChristianK @ Jun 16 2013, 17:02) I...   Jun 16 2013, 22:16
- - ChristianK   Yes, I'm curious on how to control the stereo....   Jun 17 2013, 19:10
|- - jmvalin   QUOTE (ChristianK @ Jun 17 2013, 14:10) Y...   Jun 17 2013, 19:25
|- - kabal4e   QUOTE You should replace the second line simply wi...   Jun 18 2013, 23:06
- - ChristianK   QUOTE (jmvalin @ Jun 17 2013, 20:25) Wher...   Jun 17 2013, 21:22
|- - jmvalin   QUOTE (ChristianK @ Jun 17 2013, 16:22) O...   Jun 18 2013, 00:23
|- - ChristianK   QUOTE (jmvalin @ Jun 18 2013, 01:23) You ...   Jun 30 2013, 20:50
- - Bostedclog   Could you tell me which opus encoder we should be ...   Jun 25 2013, 18:00
- - IgorC   Previously I gave a try to new temporal VBR at 48...   Jul 1 2013, 04:40
- - Gainless   A question: Does the tonality detector inside Opus...   Jul 4 2013, 15:03


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 21st September 2014 - 09:28