IPB

Welcome Guest ( Log In | Register )

> foobar2000 General Forum Rules

This is NOT a tech support forum.
Tech support questions go to foobar2000 Tech Support forum instead.

See also: Hydrogenaudio Terms of Service.

 
Reply to this topicStart new topic
What about a more selection-/cheatproof ABXer?
Porcus
post Jul 12 2012, 13:51
Post #1





Group: Members
Posts: 1842
Joined: 30-November 06
Member No.: 38207



For public listening tests, what about:

- publickey.txt that fb2k can read (hey, could even be installed as a component)
- write ABX results to file, encrypted with the public key

?

Reason: Bringing the procedure closer to double-blind.
As of today, ABXing with voluntary submission of results, is like first blinding patient and doctor, and then showing the result to the patient with the question of whether this should be submitted. (Would a patient who has had positive effects of something that turns out to be placebo, be equally likely to submit?)

For listening tests, it might be that people are less likely to submit results with negative findings. Especially if they score less than 50%. Indeed, people might just think the latter is nonsense and discard. Could very well be due to ignorance and neglect, not to deliberate cheating.

Suggestion might guard against those selection biases. (Although, not against deliberate manipulation, where you (i) ABX the normal way, and then for the more-doubleblind-test (ii) choose to test only those where you previously did well.)


--------------------
One day in the Year of the Fox came a time remembered well
Go to the top of the page
+Quote Post
skamp
post Jul 12 2012, 17:14
Post #2





Group: Developer
Posts: 1442
Joined: 4-May 04
From: France
Member No.: 13875



The owner of the private key would need to be trusted with all the results, and we should require them to publish them all after they've stopped taking submissions (or, automatically upon submission, if there's no date limit).


--------------------
See my profile for measurements, tools and recommendations.
Go to the top of the page
+Quote Post

Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 18th September 2014 - 18:58