Difference between revisions of "Mistakes discussion: in general"

From TQAuditor Wiki
Jump to: navigation, search
(Arbiter reviews the project)
 
(71 intermediate revisions by 3 users not shown)
Line 1: Line 1:
When the project evaluator finishes '''<u>[[Evaluation report#View in comparison — this link redirects you on the page with Comparison report|assessing the translation quality]]</u>''', the project translator gets an email notification.
+
When the evaluator finishes the '''<u>[[Evaluation report|evaluation]]</u>''', the translator gets an email notification. Also, the translator will get a notification of comparison report creation if the '''<u>[[Notifications|corresponding setting]]</u>''' is enabled.
  
=='''Translator reviews the quality feedback'''==
+
=='''Translator's review'''==
 +
Once the translator receives the email notification of comparison report creation, they can review all the corrections made by the reviewer.
  
After the translator has received the email with the translation quality evaluation, the translator should:
+
Once the evaluation report is created, the translator can review the mistakes classification.
  
1. View the '''<u>[[Comparison report| Comparison report tab]]</u>'''. Look through all the corrections made by the evaluator.
+
If the translator agrees with the mistakes classification, they click '''"Complete project"'''. The project and its evaluation score will be finalized at this stage.  
  
2. Go to the '''<u>[[Evaluation report| Evaluation report]]</u>'''.
+
If the translator does not agree with the mistakes classification, they can ask the evaluator to decrease a mistake severity. To do so, they click '''"Add comment"''' in the box of the mistake, write a comment clarifying the matter and click '''"Submit"''':
 
 
3. Look through classification of each mistake.
 
 
 
If the translator agrees with the classification of all mistakes, (s)he presses "'''Complete project'''".
 
 
 
The project and its evaluation score are finalized at this stage.
 
 
 
If the translator does not agree with the classification of some mistakes, (s)he presses "'''Add Comment'''"
 
 
 
in the box of the mistake that (s)he does not agree with and enters it by clicking "'''Submit'''":
 
  
 
[[File:Misatake comment.png|border|700px]]
 
[[File:Misatake comment.png|border|700px]]
 
   
 
   
When the translator has entered all the comments, (s)he sends the project for reevaluation by pressing "'''Request reevaluation'''":
+
Once the translator enters all the comments, they request the reevaluation:
  
 
[[File:Request reevaluation.png|border|190px]]
 
[[File:Request reevaluation.png|border|190px]]
 
   
 
   
The project will be sent to the evaluator, who will review translator’s comments.  
+
::<span style="color:orange">'''Note:'''</span> The ability to request the reevaluation (and how many times) depends on the account <U>[[Evaluation settings|'''evaluation settings''']]</u>.
  
If they are convincing, the evaluator will change the mistake severity in translator’s favor.
+
If the translator still does not agree, they can request arbitration (the corresponding button appears instead of "'''Request reevaluation'''"):
 
 
The translator will receive the reevaluated project. The translator can send this project for reevaluation one more time.
 
 
 
If the translator has not reached an agreement with the evaluator, (s)he can send the project to the arbiter by pressing
 
 
 
"'''Request arbitration'''" (it appears instead of "'''Request reevaluation'''"):
 
  
 
[[File:Arb.png|border|190px]]
 
[[File:Arb.png|border|190px]]
Line 39: Line 24:
 
The arbiter will provide a final score that cannot be disputed.
 
The arbiter will provide a final score that cannot be disputed.
  
=='''Evaluator reviews the translator's comments'''==
+
=='''Reevaluation'''==
  
At this stage, the evaluator needs to review all the translator’s comments with objections. The evaluator has the following instructions:
+
If the translator requests reevaluation, the evaluator will review the translator's comments. If they agree with the translator, they will decrease mistake severity. If not, the evaluator will reply to the translator's comment to clarify the matter.
  
1. If the translator is right, the evaluator changes mistake severity and enters the comment why it has been changed.  
+
Then the evaluator clicks '''"Complete evaluation"''', and the translator will be able to review the reevaluated translation.
  
If the translator is wrong, the evaluator enters the comment why the mistake's severity has not been changed.
+
=='''Arbitration'''==
  
2. To finish, the evaluator presses "'''Complete reevaluation'''". The project will be sent to the translator for review.
+
If the translator does not reach agreement with the evaluator, the translator can request arbitration (a '''"Request arbitration"''' button will appear once all the evaluation attempts are used). A user who is assigned as the arbiter will get an email notification.
  
=='''Arbiter reviews the project'''==
+
Users with any role except "translator" can be assigned to the project as the arbiter.
  
Unless the system has been set up otherwise, the translator can return the project to the evaluator for 2 times.  
+
::<span style="color:orange">'''Note:'''</span> the translator can request arbitration if the arbiter is assigned to the project.
  
If the translator and the evaluator have not managed to reach the agreement after 2 attempts, the translator sends the project to the arbiter.
+
The arbiter provides a final decision on whether to decrease mistake severity or not. If the arbiter decides not to decrease it, they have to reply to the translator's comment to clarify the matter.
  
The user, who was assigned to be the arbiter will be notified by the system.
+
To complete evaluation, the arbiter has either to decrease mistake severities or reply to all the translator's comments. Otherwise, they will receive the following message:
  
The arbiter has to assign a final score on the disputed matters.  The arbiter looks through all the rows where the translator and evaluator disagree.
+
[[File:Arbiter error1.png|border|700px]]
 
 
If the translator is right, the arbiter changes the mistake severity and enters a comment why it has been changed.
 
 
 
If the translator is wrong, the arbiter enters a comment why the mistake severity has not been changed.  
 
  
 
[[File:Arbitors comments.png|border|700px]]
 
[[File:Arbitors comments.png|border|700px]]
 
   
 
   
Finally, the arbiter should press "'''Complete project'''". The project will be finalized and all its participants will receive the respective messages.
+
Then the arbiter clicks '''"Complete project"''' and provides a final score that cannot be disputed. The project is completed and all participants will receive email notifications.  
 
 
[[File:Complete project button arbiter's account.jpg|border|600px]]
 
  
[[File:Redirect.jpg|40px|link=Mistakes discussion]] Back to the '''table of contents'''.
+
[[File:Complete project.png|border|210px]]

Latest revision as of 14:47, 9 August 2022

When the evaluator finishes the evaluation, the translator gets an email notification. Also, the translator will get a notification of comparison report creation if the corresponding setting is enabled.

Translator's review

Once the translator receives the email notification of comparison report creation, they can review all the corrections made by the reviewer.

Once the evaluation report is created, the translator can review the mistakes classification.

If the translator agrees with the mistakes classification, they click "Complete project". The project and its evaluation score will be finalized at this stage.

If the translator does not agree with the mistakes classification, they can ask the evaluator to decrease a mistake severity. To do so, they click "Add comment" in the box of the mistake, write a comment clarifying the matter and click "Submit":

Misatake comment.png

Once the translator enters all the comments, they request the reevaluation:

Request reevaluation.png

Note: The ability to request the reevaluation (and how many times) depends on the account evaluation settings.

If the translator still does not agree, they can request arbitration (the corresponding button appears instead of "Request reevaluation"):

Arb.png

The arbiter will provide a final score that cannot be disputed.

Reevaluation

If the translator requests reevaluation, the evaluator will review the translator's comments. If they agree with the translator, they will decrease mistake severity. If not, the evaluator will reply to the translator's comment to clarify the matter.

Then the evaluator clicks "Complete evaluation", and the translator will be able to review the reevaluated translation.

Arbitration

If the translator does not reach agreement with the evaluator, the translator can request arbitration (a "Request arbitration" button will appear once all the evaluation attempts are used). A user who is assigned as the arbiter will get an email notification.

Users with any role except "translator" can be assigned to the project as the arbiter.

Note: the translator can request arbitration if the arbiter is assigned to the project.

The arbiter provides a final decision on whether to decrease mistake severity or not. If the arbiter decides not to decrease it, they have to reply to the translator's comment to clarify the matter.

To complete evaluation, the arbiter has either to decrease mistake severities or reply to all the translator's comments. Otherwise, they will receive the following message:

Arbiter error1.png

Arbitors comments.png

Then the arbiter clicks "Complete project" and provides a final score that cannot be disputed. The project is completed and all participants will receive email notifications.

Complete project.png