Difference between revisions of "Mistakes discussion: in general"

Revision as of 10:55, 23 February 2022

When the project evaluator finishes assessing the translation quality, the project translator gets an email notification.

[new version] When the evaluator finishes the evaluation, the translator gets an email notification. Also, the translator will get a notification of comparison report creation if the corresponding setting is enabled.

Translator reviews the quality feedback

[new version] Translator reviews the quality feedback -> Translator's review

After the translator has received the email with the translation quality evaluation, the translator should:

1. View the Comparison report tab. Look through all the corrections made by the reviewer.

[new version] Once the translator has received the email notification of comparison report creation, they can review all the corrections made by the reviewer.

2. Go to the Evaluation report. Look through the classification of each mistake.

[new version] Once the evaluation report is created, the translator can review the mistakes classification.

If the translator agrees with the classification of all mistakes, they press "Complete project". The project and its evaluation score are finalized at this stage.

[new version] If the translator agrees with the mistakes classification, they click "Complete project". The project and its evaluation score will be finalized at this stage.

If the translator does not agree with the classification of some mistakes, they press "Add Comment" in the box of the mistake that they do not agree with and click "Submit":

[new version] If the translator does not agree with the mistakes classification, they can ask the evaluator to decrease a mistake severity. To do so, they click "Add comment" in the box of the mistake, write a comment clarifying the matter and click "Submit":

When the translator has entered all the comments, they send the project for reevaluation by pressing "Request reevaluation":

[new version] Once the translator has entered all the comments, they request the reevaluation.

The project will be sent to the evaluator, who will review translator’s comments. If they are convincing, the evaluator will change the mistake severity in translator’s favor.

The translator will receive the reevaluated project.

[new version] ::Note: Unless the number of maximum evaluation attempts has been adjusted by the administrator, the translator can request the reevaluation for 2 times.

If the translator still does not agree, they can send the project to the arbiter by pressing "Request arbitration" (it appears instead of "Request reevaluation"):

The arbiter will provide a final score that cannot be disputed.

Evaluator reviews the translator's comments

[new version] Evaluator reviews the translator's comments -> Reevaluation

At this stage, the evaluator needs to review all the translator’s comments with objections. The evaluator has the following instructions:

1. If the translator is right, the evaluator changes mistake severity and enters the comment why it has been changed.

If the translator is wrong, the evaluator enters the comment why the mistake's severity has not been changed.

[new version] If the translator has requested reevaluation, the evaluator will review the translator's comments. If they agree with the translator, they will decrease mistake severity. If not, the evaluator has to reply to the translator's comment to clarify the matter.

2. To finish, the evaluator presses "Complete reevaluation". The project will be sent to the translator for review.

[new version] Then the evaluator clicks "Complete evaluation", and the translator will be able to review the reevaluated translation.

Arbiter reviews the project

[new version] Arbiter reviews the project -> Arbitration

Unless the system has been set up otherwise, the translator can return the project to the evaluator for 2 times.

If the translator and the evaluator have not managed to reach the agreement after 2 attempts, the translator sends the project to the arbiter. The user, who was assigned to be the arbiter will be notified by the system.

[new version] If the translator has not reached agreement with the evaluator, the translator can request arbitration (a "Request arbitration" button will appear once all the evaluation attempts have been used). A user who was assigned as the arbiter will get an email notification.

[new] Note: the translator can request arbitration if the arbiter is assigned to the project.

The arbiter has to assign a final score on the disputed matters. The arbiter looks through all the rows where the translator and evaluator disagree.

[new version] The arbiter provides a final decision whether to decrease mistake severity or not. If the arbiter decides not to decrease it, they have to reply to the translator's comment to clarify the matter.

[new] Users with any role except "translator" can be assigned to the project as the arbiter.

If the translator is right, the arbiter changes the mistake severity and enters a comment why it has been changed.

If the translator is wrong, the arbiter enters a comment why the mistake severity has not been changed.

Finally, the arbiter should press "Complete project". The project will be finalized and all its participants will receive the respective messages.

[new version] Then the arbiter clicks "Complete project" and provides a final score that cannot be disputed. The project is completed and all participants will receive email notifications.