Difference between revisions of "Evaluator user manual"

From TQAuditor Wiki
Jump to: navigation, search
(→‎Reevaluation and arbitration requests)
(→‎Reevaluation request)
 
(113 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
<span style="color:red">  '''The page is under creation''' </span>
 
−
 
−
 
 
=='''Introduction'''==
 
=='''Introduction'''==
  
 
TQAuditor is the system that '''evaluates and monitors translation quality''' and allows you to:
 
TQAuditor is the system that '''evaluates and monitors translation quality''' and allows you to:
  
−
*'''compare''' unedited translation made by a translator with edited version received from an editor;
+
*'''compare''' unedited translation made by a translator with an edited version received from an editor;
  
 
*'''generate a report''' about editor’s corrections;
 
*'''generate a report''' about editor’s corrections;
  
−
*'''classify''' each correction by mistake type and severity, thus allowing to get the translation quality evaluation score. By default, a maximum score is set to 100 points;
+
*'''classify''' each correction by a mistake type and severity, thus allowing to get the translation quality evaluation score;
  
 
*ensure '''anonymous communication''' between a translator and an editor regarding corrections and mistakes classification;
 
*ensure '''anonymous communication''' between a translator and an editor regarding corrections and mistakes classification;
  
 
*'''automate a process''' of maintaining the evaluation project;
 
*'''automate a process''' of maintaining the evaluation project;
 +
 +
The evaluator's role is to assess the quality of a translation. To do it, they compare two versions of a translated file, add mistakes and classify them by type and severity.
 +
Once the evaluation is completed, the evaluator generates a report regarding the quality of the translation.
  
 
=='''How to accept invitation'''==
 
=='''How to accept invitation'''==
Line 28: Line 28:
 
[[File:Evaluator registration2.png|border|800px]]
 
[[File:Evaluator registration2.png|border|800px]]
  
−
Choose your own username and password, confirm the password, accept the Privacy policy and Terms of service (to read them, click the corresponding links highlighted in blue) and press "Submit".  
+
Choose your username and password, confirm the password, accept the Privacy policy and Terms of service (to read them, click the corresponding links highlighted in blue), and click "Submit".  
  
 
4. Your account will be created.
 
4. Your account will be created.
  
−
=='''Profile settings'''==
+
=='''Get started with an evaluator account'''==
  
−
On the '''My Profile''' page you can update your personal information and change your password.
+
There are several main menus the evaluator has access to:
  
−
To do so, go to the '''My profile''' menu:
+
[[File:Evaluator profile1.png|border|1000px]]
  
−
[[File:Profile settings1.png|border|1000px]]
+
*'''Quick compare''' — here, you can compare two versions of translated files in the system.
 +
 
 +
*'''Projects''' — here, you can find the list of projects.
 +
 
 +
*'''Reports''' — here, you can find your reports.
  
−
=='''Get started with an evaluator account'''==
+
*'''System''' — here, you can find the quality standard of the company you cooperate with.
  
−
There are several main menus that you need to focus on:
+
==='''Profile settings'''===
  
−
[[File:Evaluator profile1.png|border|1000px]]
+
On the "My Profile" page, you can update your personal information and change your password.
  
−
*'''Quick compare''' — here you can compare two versions of translated files in the system.
+
To do so, go to the "My profile" menu:
  
−
*'''Projects''' — here you can find the list of projects.
+
[[File:Profile settings1.png|border|1000px]]
  
−
*'''Reports''' — here you can find your reports.
+
=='''Quick compare'''==
  
−
*'''System''' — here you can find the Quality standard of the company you cooperate with.
+
You can compare two versions of translated files in the system. Press the "Quick compare" button to do it:
  
−
=='''Quick comparison'''==
+
[[File:Quick compare1.png|border|1000px]]
  
−
You can compare two versions of translated files in the system.
+
Click "Supported bilingual file types" to see the file formats TQA work with.
 +
 
 +
Press the "Upload selected files" button:
 
   
 
   
 
[[File:Compare.png|border|300px]]
 
[[File:Compare.png|border|300px]]
  
−
Click '''Supported bilingual file types''' to see the file formats TQA work with.
+
The [https://wiki.tqauditor.com/wiki/Comparison_report comparison report] will be created, where you can see the editor’s amendments highlighted with color and different filters to simplify your work.
−
 
 
−
Press the "Upload selected files" button.
 
−
 
 
−
The comparison report will be created, where you can see the editor’s amendments highlighted with color, and different filters to simplify your work.
 
  
 
=='''Projects'''==
 
=='''Projects'''==
  
−
On the "Projects" page, you can find the list of projects that you have been assigned as an evaluator.
+
On the "Projects" page, you can find the list of projects that you have been assigned as the evaluator.
  
 
Click on the project's ID to open a project:
 
Click on the project's ID to open a project:
  
 
[[File:Projects list1.2.png|border|1000px]]
 
[[File:Projects list1.2.png|border|1000px]]
 +
 +
==='''Filters'''===
 +
 +
You may order projects by particular criteria: click the title of any column highlighted in blue, and all the projects will line up (the arrow [[file:Line up arrow.jpg|border|25px]] button appears).
 +
 +
[[File:2 project filters.png|1000px]]
 +
 +
Also, you may find additional filters here:
 +
 +
[[File:1 project filter.png|250px]]
 +
 +
*Is overdue — the system will display the overdue projects only.
 +
 +
*Stage — tick one of the checkboxes, and the system will display only projects at a particular stage.
 +
 +
*Project code — the system will display projects with the specified project code.
 +
 +
*Translation job code — the system will display the projects with a particular translation job ID entered by the manager.
 +
 +
*Review job code — the system will display the projects with a particular review job ID entered by the manager (differs from translation job code).
 +
 +
*Project name — the system will display the projects with the specified name.
 +
 +
*Specialization — the system will display the projects with a particular translation specialization.
 +
 +
*Service — the system will display the projects with a particular service.
 +
 +
*Evaluation count — the system will display projects with the specified evaluation count.
 +
 +
*Manager — the system will display the projects assigned to a particular manager.
 +
 +
*Creation date — the system will display the projects created within the specified dates.
  
 
==='''Project details'''===
 
==='''Project details'''===
  
−
Once you've been assigned the project, you can see general information, project manager, and their email:
+
Once you've been assigned the project, you can see general information, a project manager, and their email:
  
 
[[File:Project details1.2.png|1000px]]
 
[[File:Project details1.2.png|1000px]]
Line 87: Line 121:
 
[[File:Upload files1.png|1000px]]
 
[[File:Upload files1.png|1000px]]
  
−
Press the "Choose files" button to select two versions of the translated file.
+
Press the "Choose files" button to select two versions of a translated file:
  
−
Note: the evaluator is the only user who can upload files.
+
[[File:Upload files3.png|600px]]
 +
 
 +
::<span style="color:orange">'''Note:'''</span> the evaluator is the only user who can upload files.
  
 
==='''Create comparison report'''===
 
==='''Create comparison report'''===
  
−
Once you have uploaded files you can create the comparison report. Press the "Create comparison report" button to do it:
+
Once you have uploaded files, you can create the comparison report. Press the "Create comparison report" button:
  
 
[[File:Upload files2.1.png|border|250px]]
 
[[File:Upload files2.1.png|border|250px]]
  
−
When the comparison report is generated, you will see time limits details, the comparison of the original and amended translation, markup display settings, and comparison details:
+
When the comparison report is generated, you will see time limits details, the comparison of the original and reviewed translation, markup display settings, and comparison details:
  
 
[[File:Comparison report1.1.png|border|1000px]]
 
[[File:Comparison report1.1.png|border|1000px]]
Line 107: Line 143:
 
Once files are uploaded and the comparison report is created, you can start an evaluation by selecting whether an automatic or manual word count.
 
Once files are uploaded and the comparison report is created, you can start an evaluation by selecting whether an automatic or manual word count.
  
−
The automatic word count is used for fully reviewed files and the manual word count is used for partially reviewed files. You can read more on the differences between the two types of word count and how to use them on [https://wiki.tqauditor.com/wiki/Frequently_Asked_Questions#Automatic_vs._manual_word_count this page].
+
The automatic word count is used for fully reviewed files, and the manual word count is used for partially reviewed files. You can read more on the differences between the two types of word count and how to use them on [https://wiki.tqauditor.com/wiki/Frequently_Asked_Questions#Automatic_vs._manual_word_count this page].
  
 
==='''Evaluation with automatic word count'''===
 
==='''Evaluation with automatic word count'''===
  
−
To start the evaluation with the automatic word count, press the "Start evaluation (automatic word count)" button:
+
To start the evaluation with the automatic word count, press "Start evaluation (automatic word count)":
  
 
[[File:Evaluation automatic word count1.png|border|250px]]
 
[[File:Evaluation automatic word count1.png|border|250px]]
Line 117: Line 153:
 
You can also adjust evaluation settings:
 
You can also adjust evaluation settings:
  
−
*Skip locked units — hide "frozen" units (for example, a client wants some important parts of the translated text to stay unchanged. Besides, extra units slow down the editor's work).
+
*Skip repetitions — the system will hide repeated segments (only one of them will be displayed)
  
−
*Skip repetitions — the system will hide repeated segments (only one of them will be displayed in this case).
+
*Skip locked units — the "frozen" units will not be displayed (for example, this setting is used if a client wants some important parts of the translated text to stay unchanged).
  
−
*Skip segments with match — fuzzy match percentage. The program will hide segments with matches greater than or equal to a number you specified.
+
*"Skip segments with match >=" — units with matches greater than or equal to a specified number will not be displayed.
  
−
*Evaluation sample word count limit — the number of words in edited segments chosen for evaluation.
+
*Evaluation sample word count limit — this value is used to adjust how many segments for evaluation will be displayed.
  
 
Press the "Start evaluation" button once settings are adjusted:
 
Press the "Start evaluation" button once settings are adjusted:
Line 129: Line 165:
 
[[File:Evaluation automatic word count2.2.png|border|1000px]]
 
[[File:Evaluation automatic word count2.2.png|border|1000px]]
  
−
==='''Quality evaluation'''===
+
==='''Evaluation with manual word count'''===
  
−
Now you have to classify every correction by type and severity. Click the "Add mistake" button to do it:
+
To start the evaluation with the manual word count, press "Start evaluation (manual word count)":
  
−
[[File:1. 91.png|border|800px]]
+
[[File:Start evaluation1.1.png|border|250px]]
  
−
Add the information about the mistake and click "Submit":
+
Enter the number of evaluated source words and press the "Start evaluation" button:
  
−
[[File:2. mistake.png|border|280px]]
+
[[File:Start evaluation manual word count1+.png|border|1000px]]
  
−
You can edit, delete mistake/comment or add another mistake by clicking the corresponding buttons:
+
::<span style="color:orange">'''Note:'''</span> Please take into account that the "Evaluated source words" should reflect the total number of words in the reviewed part of the file. You can read more on how to use the manual word count on [https://wiki.tqauditor.com/wiki/Frequently_Asked_Questions#Automatic_vs._manual_word_count this page].
  
−
[[File:3. mistal.png|border|800px]]
+
==='''Quality evaluation'''===
  
−
When the classification of mistakes is done, click "Complete evaluation", write an evaluation summary, and press the "Complete" button.
+
Once you have started the evaluation, you can find the evaluation report by clicking the corresponding button:
  
−
The system will send the quality assessment report to the translator.
+
[[File:Evaluation automatic word count3.png|1000px]]
  
−
Please note that you may '''<U>[[Evaluation report#Export to Excel|export the evaluation report]]</U>''' with mistakes classification.
+
Now you have to start adding mistakes. Click the "Add mistake" button within a needed segment to add a mistake:
  
−
[[File:Redirect.jpg|40px|link=User manual]] Back to the '''table of contents'''.
+
[[File:1. 91.png|border|800px]]
  
−
=='''Reevaluation and arbitration requests'''==
+
Specify each mistake's type and severity, leave a comment if needed, and click "Submit":
  
−
If the translator has requested a reevaluation, you will receive a corresponding email notification:
+
[[File:2. mistake.png|border|280px]]
  
−
[[File:Reevaluation1.png|border|1000px]]
+
You can edit, delete mistake/comment or add mistakes by clicking the corresponding buttons:
  
−
Click on the project ID, and it will bring you to the "Project details" page. Next, press the "Evaluation report" button and start reevaluation.
+
[[File:3. mistal.png|border|800px]]
  
−
::<span style="color:red">'''Note:'''</span> in order to do reevaluation you have to reply to all the comments left by the translator.
+
When all the mistakes are added and classified, click "Complete evaluation", write an evaluation summary, and press the "Complete" button. The system will send the quality assessment report to the translator.
  
 +
Please note that you may '''<U>[[Evaluation report#Export to Excel|export the evaluation report]]</U>''' with mistakes classification.
  
 +
==='''Reevaluation request'''===
  
 +
If the translator has requested a reevaluation, you will receive a corresponding email notification:
  
−
After you receive the email with translation quality evaluation, follow the project ID link in your email:
+
[[File:Reevaluation1.png|border|800px]]
  
−
And do the following actions:
+
Click on the project ID, and it will bring you to the "Project details" page. Next, press the "Evaluation report" button and start the reevaluation:
  
−
1. View the '''<u>[[Comparison report]]</u>'''. Look through all the corrections made by the evaluator:
+
[[File:Reevaluation2.png|border|250px]]
  
−
[[File:Comparisonf report.png|border|150px]]
+
Press the "Add comment" button to reply to the translator's comment:
  
−
2. Go to the '''<u>[[Evaluation report]]</u>''':
+
[[File:Reevaluation3.png|border|1000px]]
  
−
[[File:Evaluation report.png|border|150px]]
+
::<span style="color:orange">'''Note:'''</span> in order to do the reevaluation you have to reply to all the comments left by the translator.
  
−
3. Look through classification of each mistake.
+
You can also select a "Last commented by translator" option so that you see units with the translator's comments first:
  
−
4. If you agree with classification of all the mistakes, press "'''Complete project'''":
+
[[File:Reevaluation4.png|border|250px]]
  
−
[[File:Complete tr.png|border|150px]]
+
Once done, click "Complete evaluation", edit an evaluation summary if needed, and press the "Complete" button.
  
−
The project and its evaluation score are finalized at this stage. If you do not agree with classification of some mistakes, do the following actions.
+
==='''Arbitration request'''===
  
−
5. Press "'''Add Comment'''" in the box of the mistake that you do not agree with and enter it by clicking "'''Submit'''":
+
If there is still no agreement regarding the severity of mistakes, the translator can request arbitration. The arbiter will provide a final score that cannot be disputed. The stage of the project will change accordingly:
  
−
[[File:Misatake comment.png| border|650px]]
+
[[File:Arbitration1+.png|border|300px]]
−
 
−
6. When you have entered all the comments, send the project for reevaluation by pressing "'''Request reevaluation'''":
 
  
−
[[File:Request reevaluation.png|border|150px]]
+
You'll also receive an email notification when the arbiter completes the project. Follow the project ID link to see the changes:
−
 
−
7. The project will be sent to the evaluator, who will review your comments.
 
  
−
If they are convincing, the evaluator will change the mistake severity in your favor.  
+
[[File:Arbitration2.png|border|600px]]
  
−
You will receive the reevaluated project. You are able to send this project for reevaluation one more time.
+
=='''Reports'''==
  
−
8. If you have not reached agreement with the evaluator, you can send the project to the arbiter by pressing "'''Request arbitration'''" (it appears instead of "'''Request reevaluation'''"):
+
Since the evaluator can also be assigned to a project as the translator, you can check both the translator and evaluator reports.
  
−
[[File:Arb.png|border|150px]]
+
==='''Translator reports'''===
  
−
9. The arbiter will provide a final score that cannot be disputed.
+
To check your translator reports, go to "Reports" —> "Translator report".
  
−
=='''Reports'''==
+
[[File:Reports1.png|border|300px]]
−
 
 
−
To check your translator reports, go to '''Reports ⇾ Translator report'''
 
−
 
 
−
[[File:New.png|border|410px]]
 
  
 
Here you can find different charts and diagrams:
 
Here you can find different charts and diagrams:
Line 214: Line 245:
 
*Score dynamics:
 
*Score dynamics:
  
−
[[File:Screenshot 13.png|850px]]
+
[[File:Screenshot 13.png|1000px]]
  
 
*Monthly average score dynamics:
 
*Monthly average score dynamics:
  
−
[[File:Screesnshot 2.png|border|850px]]
+
[[File:Screesnshot 2.png|border|1000px]]
  
−
[[File:Screenshot 11.png|border|600px]]
+
[[File:Screenshot 11.png|border|800px]]
  
 
*Managed by:
 
*Managed by:
  
−
[[File:Ev4.png|400px]]
+
[[File:Ev4.png|600px]]
  
 
*Projects by specialization:
 
*Projects by specialization:
  
−
[[File:Pp.png|400px]]
+
[[File:Pp.png|600px]]
  
 
*Mistakes by type:
 
*Mistakes by type:
  
−
[[File:Screenddshot 7.png|650px]]
+
[[File:Screenddshot 7.png|1000px]]
  
 
*Mistakes by severity:
 
*Mistakes by severity:
  
−
[[File:Screaenshot 8.png|650px]]
+
[[File:Screaenshot 8.png|1000px]]
  
−
=='''Quality standard'''==
+
==='''Evaluator reports'''===
  
−
To check the quality standard of the company you cooperate with, go to '''Settings''' ⇾ '''Quality standard'''
+
To check your evaluator reports, go to "Reports" —> "Evaluator report".
  
−
[[File:Qq.png|border|450px]]
+
[[File:Reports2.png|300px]]
  
−
Here you can find:
+
*Score dynamics:
  
−
* Score limit and Mistake severities:
+
[[File:Reports3.png|border|1000px]]
  
−
[[File:1 m.png|border|200px]]
+
*Monthly average score dynamics:
  
−
* Mistake types:
+
[[File:Reports4.png|border|1000px]]
  
−
[[File:M2.png|border|200px]]
+
*Managed by:
  
−
* Mistake type score weight coefficients per specialization:
+
[[File:Reports5.png|border|600px]]
  
−
[[File:M3.png|border|600px]]
+
*Projects by specialization:
  
−
* Quality levels
+
[[File:Reports6.png|border|600px]]
  
−
[[File:M4.png|border|250px]]
+
*Mistakes by type:
  
−
=='''Filters'''==
+
[[File:Reports7.png|border|1000px]]
  
−
There are filters that can help you to display the data you need.
+
*Mistakes by severity:
  
−
==='''Project filters'''===
+
[[File:Reports8.png|border|1000px]]
  
−
You may order projects by particular criteria: click the title of any column
+
==='''Filters'''===
−
and all the projects will line up (the arrow [[file:Line up arrow.jpg|border|25px]] button appears).
 
  
−
[[File:2 project filters.png|900px]]
+
Уou can specify the project creation date range using the filter:
  
−
<span style="color:red">'''Note:'''</span> The column headers which enable this sorting feature are highlighted in blue.
+
[[File:Report filters.png|250px]]
  
−
Also, you may find here additional filters:
+
=='''Quality standard'''==
  
−
[[File:1 project filter.png|250px]]
+
To check the quality standard of the company you cooperate with, go to "Settings" —> "Quality standard".
  
−
*'''Is overdue''' — the system will display the overdue projects only.
+
[[File:Qq.png|border|450px]]
  
−
*'''Stage''' — tick one of the cells, and the system will display only projects at a particular stage.
+
Here you can find:
  
−
*'''Project code''' — the system will display projects with the specified project code.
+
* Score limit and mistake severities:
  
−
*'''Translation job code''' — the system will display the projects with a particular translation job ID, entered by the manager.
+
[[File:1 m.png|border|200px]]
  
−
*'''Review job code''' — the system will display the projects with a particular review job ID, entered by the manager (differs from translation job code).
+
* Mistake types:
  
−
*'''Project name''' — the system will display the projects with the specified name.
+
[[File:M2.png|border|200px]]
  
−
*'''Specialization''' — the system will display the projects with a particular translation specialization.
+
* Mistake type score weight coefficients per specialization:
  
−
*'''Service''' — the system will display the projects with a particular translation service.
+
[[File:M3.png|border|600px]]
  
−
*'''Evaluation count''' — the system will display projects with the specified evaluation count.
+
* Quality levels
  
−
*'''Manager''' — the system will display the projects with a particular supervisor.
+
[[File:M4.png|border|250px]]
−
 
 
−
*'''Creation date''' — the system will display the projects with particular creation dates.
 
−
 
 
−
==='''Report filter'''===
 
−
 
 
−
Here you can specify the project creation date range:
 
−
 
 
−
[[File:Report filters.png|250px]]
 

Latest revision as of 15:15, 12 July 2022

Introduction

TQAuditor is the system that evaluates and monitors translation quality and allows you to:

  • compare unedited translation made by a translator with an edited version received from an editor;
  • generate a report about editor’s corrections;
  • classify each correction by a mistake type and severity, thus allowing to get the translation quality evaluation score;
  • ensure anonymous communication between a translator and an editor regarding corrections and mistakes classification;
  • automate a process of maintaining the evaluation project;

The evaluator's role is to assess the quality of a translation. To do it, they compare two versions of a translated file, add mistakes and classify them by type and severity. Once the evaluation is completed, the evaluator generates a report regarding the quality of the translation.

How to accept invitation

1. The translation agency you cooperate with adds your account into the system. You receive an invitation email.

2. Accept the invitation by clicking the link in the received letter:

Evaluator registration1.png

3. The following window appears:

Evaluator registration2.png

Choose your username and password, confirm the password, accept the Privacy policy and Terms of service (to read them, click the corresponding links highlighted in blue), and click "Submit".

4. Your account will be created.

Get started with an evaluator account

There are several main menus the evaluator has access to:

Evaluator profile1.png

  • Quick compare — here, you can compare two versions of translated files in the system.
  • Projects — here, you can find the list of projects.
  • Reports — here, you can find your reports.
  • System — here, you can find the quality standard of the company you cooperate with.

Profile settings

On the "My Profile" page, you can update your personal information and change your password.

To do so, go to the "My profile" menu:

Profile settings1.png

Quick compare

You can compare two versions of translated files in the system. Press the "Quick compare" button to do it:

Quick compare1.png

Click "Supported bilingual file types" to see the file formats TQA work with.

Press the "Upload selected files" button:

Compare.png

The comparison report will be created, where you can see the editor’s amendments highlighted with color and different filters to simplify your work.

Projects

On the "Projects" page, you can find the list of projects that you have been assigned as the evaluator.

Click on the project's ID to open a project:

Projects list1.2.png

Filters

You may order projects by particular criteria: click the title of any column highlighted in blue, and all the projects will line up (the arrow Line up arrow.jpg button appears).

2 project filters.png

Also, you may find additional filters here:

1 project filter.png

  • Is overdue — the system will display the overdue projects only.
  • Stage — tick one of the checkboxes, and the system will display only projects at a particular stage.
  • Project code — the system will display projects with the specified project code.
  • Translation job code — the system will display the projects with a particular translation job ID entered by the manager.
  • Review job code — the system will display the projects with a particular review job ID entered by the manager (differs from translation job code).
  • Project name — the system will display the projects with the specified name.
  • Specialization — the system will display the projects with a particular translation specialization.
  • Service — the system will display the projects with a particular service.
  • Evaluation count — the system will display projects with the specified evaluation count.
  • Manager — the system will display the projects assigned to a particular manager.
  • Creation date — the system will display the projects created within the specified dates.

Project details

Once you've been assigned the project, you can see general information, a project manager, and their email:

Project details1.2.png Project details2.1.png

Upload files

First, you have to upload files. Press the "Upload files" button to do it:

Upload files1.png

Press the "Choose files" button to select two versions of a translated file:

Upload files3.png

Note: the evaluator is the only user who can upload files.

Create comparison report

Once you have uploaded files, you can create the comparison report. Press the "Create comparison report" button:

Upload files2.1.png

When the comparison report is generated, you will see time limits details, the comparison of the original and reviewed translation, markup display settings, and comparison details:

Comparison report1.1.png

For more information, please check the "Comparison report" page.

Start evaluation

Once files are uploaded and the comparison report is created, you can start an evaluation by selecting whether an automatic or manual word count.

The automatic word count is used for fully reviewed files, and the manual word count is used for partially reviewed files. You can read more on the differences between the two types of word count and how to use them on this page.

Evaluation with automatic word count

To start the evaluation with the automatic word count, press "Start evaluation (automatic word count)":

Evaluation automatic word count1.png

You can also adjust evaluation settings:

  • Skip repetitions — the system will hide repeated segments (only one of them will be displayed)
  • Skip locked units — the "frozen" units will not be displayed (for example, this setting is used if a client wants some important parts of the translated text to stay unchanged).
  • "Skip segments with match >=" — units with matches greater than or equal to a specified number will not be displayed.
  • Evaluation sample word count limit — this value is used to adjust how many segments for evaluation will be displayed.

Press the "Start evaluation" button once settings are adjusted:

Evaluation automatic word count2.2.png

Evaluation with manual word count

To start the evaluation with the manual word count, press "Start evaluation (manual word count)":

Start evaluation1.1.png

Enter the number of evaluated source words and press the "Start evaluation" button:

Start evaluation manual word count1+.png

Note: Please take into account that the "Evaluated source words" should reflect the total number of words in the reviewed part of the file. You can read more on how to use the manual word count on this page.

Quality evaluation

Once you have started the evaluation, you can find the evaluation report by clicking the corresponding button:

Evaluation automatic word count3.png

Now you have to start adding mistakes. Click the "Add mistake" button within a needed segment to add a mistake:

1. 91.png

Specify each mistake's type and severity, leave a comment if needed, and click "Submit":

2. mistake.png

You can edit, delete mistake/comment or add mistakes by clicking the corresponding buttons:

3. mistal.png

When all the mistakes are added and classified, click "Complete evaluation", write an evaluation summary, and press the "Complete" button. The system will send the quality assessment report to the translator.

Please note that you may export the evaluation report with mistakes classification.

Reevaluation request

If the translator has requested a reevaluation, you will receive a corresponding email notification:

Reevaluation1.png

Click on the project ID, and it will bring you to the "Project details" page. Next, press the "Evaluation report" button and start the reevaluation:

Reevaluation2.png

Press the "Add comment" button to reply to the translator's comment:

Reevaluation3.png

Note: in order to do the reevaluation you have to reply to all the comments left by the translator.

You can also select a "Last commented by translator" option so that you see units with the translator's comments first:

Reevaluation4.png

Once done, click "Complete evaluation", edit an evaluation summary if needed, and press the "Complete" button.

Arbitration request

If there is still no agreement regarding the severity of mistakes, the translator can request arbitration. The arbiter will provide a final score that cannot be disputed. The stage of the project will change accordingly:

Arbitration1+.png

You'll also receive an email notification when the arbiter completes the project. Follow the project ID link to see the changes:

Arbitration2.png

Reports

Since the evaluator can also be assigned to a project as the translator, you can check both the translator and evaluator reports.

Translator reports

To check your translator reports, go to "Reports" —> "Translator report".

Reports1.png

Here you can find different charts and diagrams:

  • Score dynamics:

Screenshot 13.png

  • Monthly average score dynamics:

Screesnshot 2.png

Screenshot 11.png

  • Managed by:

Ev4.png

  • Projects by specialization:

Pp.png

  • Mistakes by type:

Screenddshot 7.png

  • Mistakes by severity:

Screaenshot 8.png

Evaluator reports

To check your evaluator reports, go to "Reports" —> "Evaluator report".

Reports2.png

  • Score dynamics:

Reports3.png

  • Monthly average score dynamics:

Reports4.png

  • Managed by:

Reports5.png

  • Projects by specialization:

Reports6.png

  • Mistakes by type:

Reports7.png

  • Mistakes by severity:

Reports8.png

Filters

Уou can specify the project creation date range using the filter:

Report filters.png

Quality standard

To check the quality standard of the company you cooperate with, go to "Settings" —> "Quality standard".

Qq.png

Here you can find:

  • Score limit and mistake severities:

1 m.png

  • Mistake types:

M2.png

  • Mistake type score weight coefficients per specialization:

M3.png

  • Quality levels

M4.png

Retrieved from "https://wiki.tqauditor.com/index.php?title=Evaluator_user_manual&oldid=4333"