Difference between revisions of "Mistakes discussion"

Revision as of 09:14, 16 January 2017

Mistakes discussion page: http://cloud.tqauditor.com/evaluation/index?id=XXXX (replace XXXX with a valid number)

When project evaluator finishes assessing the translation quality (completes evaluation), project translator gets email notification.

Translator reviews the quality feedback

After the translator has received the email with the translation quality evaluation, the translator should:

1. View Comparison report tab. Look through all the corrections made by the editor.

2. Go to Evaluation report.

3. Look through classification of each mistake.

If the translator agrees with classification of all the mistakes, (s)he presses Complete project.

The project and its evaluation score are finalized at this stage.

If the translator does not agree with classification of some mistakes, (s)he does presses Add Comment in the box of the mistake that (s)he does not agree with and enters it clicking Submit:

When the translator has entered all the comments, (s)he sends the project for reevaluation by pressing Request reevaluation:

The project will be sent to the evaluator, who will review translator’s comments.

If they are convincing, the evaluator will change the mistake severity in translator’s favor.

The translator will receive the reevaluated project. The translator can send this project for reevaluation one more time.

If the translator has not reached an agreement with the evaluator, (s)he can send the project to the arbiter by pressing Request arbitration (it appears instead of Request reevaluation).

The arbiter will provide a final score that cannot be disputed.

Evaluator reviews the translator's comments

At this stage, the evaluator needs to review all the translator’s comments with objections. The evaluator has the following instructions:

1. If the translator is right, the evaluator changes mistake severity and enters the comment why it has been changed.

If the translator is wrong, the evaluator enters the comment why the mistake's severity has not been changed.

2. To finish, the evaluator presses Complete reevaluation. The project will be sent to the translator for review.

Arbiter reviews the project

Unless the system has been set up otherwise, the translator can return the project to the evaluator for 2 times.

If the translator and the evaluator have not managed to reach the agreement after 2 attempts, the translator sends the project to the arbiter.

The user, who was assigned to be the arbiter will be notified by the system.

The arbiter has to assign a final score on the disputed matters. S(he) looks through all the rows where the translator and evaluator disagree.

If the translator is right, the arbiter changes the mistake severity and enters his(er) comment why it has been changed.

If the translator is wrong, the arbiter enters the comment why the mistake severity has not been changed.

Finally, the arbiter should press Complete project. The project will be finalized and all its participants will receive the respective message.