Left Image
Right Image
Left image has higher visual quality. Select 1.
Left Image
Right Image
Right image has higher visual quality. Select -1.
Your task is to compare the visual quality of two images that may be affected by fast-fading degradation.
We have methods that analyze the consistency of your answers with respect to themselves, to those of your fellow workers and to references we know to be accurate. We will use these methods to rank the submitted assignments according to quality. We have made available a set of 714 different HITs. You are allowed to submit at most 40 different HITs.
For this experiment we will pay a base reward of $0.02/HIT for every accepted HIT. You will receive a bonus of:
Bonuses will be paid up to 7 days after submission. The base reward will always be paid within 24 hours of submission.
In each test, you are asked to compare the visual quality of two images according to the following scale:
| Score | Quality |
| 1 | Left image is better than right image |
| -1 | Right image is better than left image |
The following references illustrate the meaning of each score. Please note that you may encounter other types of distortions. Therefore, these examples do not exhaust the range of conditions you can expect to see.
Left image has higher visual quality. Select 1.
Right image has higher visual quality. Select -1.
Your results will be collected and evaluated for consistency. We (the requesters) have an estimate of each file's subjective quality that conforms with the references above. Thus, we can detect if someone submits random scores or does not rate according to these instructions, which can lead to work being rejected. You can rest assured that your work will be approved if you rate according to the table and examples above.
Answers will be either reviewed or automatically approved within 24 hours.