User manual

From TQAuditor Wiki
Revision as of 14:48, 14 April 2020 by Aleksandra.d (talk | contribs) (Create project)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

For a brief overview of the system, please check this video: Youtube.jpg

About TQAuditor

TQAuditor 3.04 is the system that evaluates and monitors translation quality and allows you to:

  • compare unedited translation made by a translator with edited version received from an editor;
  • generate a report about editor’s corrections;
  • classify each correction by mistake type and severity, thus allowing to get the translation quality evaluation score with a maximum 100 points;
  • ensure anonymous communication between a translator and an editor regarding corrections and mistakes classification;
  • automate a process of maintaining the evaluation project;
  • save all evaluated translations in the database and create the translation quality reports at the company:

you can create the list of top translators with the highest score, see dynamics of quality per individual translator by month, etc.

Quick compare without signing up

You can compare two versions of translated files in the system even without registering an account.

1. Go to https://tqauditor.com and click "Compare files":

Tq.png

It will open the Quick compare page.

2. Choose the translated and reviewed files, and click the "Update selected files" button:

Compare.png

TQAuditor 3.03 accepts bilingual files of different formats (Helium, XLF, XLZ, SDLXliff, TTX, TMX etc.). Click "Supported bilingual file types" to see all the file formats TQA work with.

3. The Comparison report page will be displayed:

Big page.png

Redirect.jpg Back to the table of contents.

Quick compare details

Here you can:

  • Delete comparison report if current information is no longer needed:

1 delete comparison.png

  • Upload other files for a new comparison report by pressing Upload files:

2 upload files.png

  • With Markup display option, you may choose tags display.
  • Full - tags have original length, so you can see the data within:

1 full.png 1.png

  • Short - tags are compressed and you see only their position in the text:

2 short.png 2.png

  • None – tags are totally hidden, so they will not distract you:

3 none.png 3.png

  • With Units display option, you may choose text segments display.
  • All units - shows all text segments:

1 all.png 1 all text .png

  • With corrections - shows nothing but amended:

2 with corrections.png 2. not all .png

Press the "Apply" button after changing the preferences:

Apply.png

Redirect.jpg Back to the table of contents.

Register an account

You’ll need to register an account to benefit from the full functionality of the system, e.g. comparing many file pairs at once, classify mistakes, get the quality score of the translation, enable discussion between the translator and editor, and see the detailed reports of everything that happens with translation quality in your company.

1. Go to https://tqauditor.com and press "Sign Up":

Sign up.png

2. Fill in all the boxes, read our Privacy policy and Terms of service, mark the relevant checkbox and click the "Submit" button:

Screenshot 2.png

Redirect.jpg Back to the table of contents.

Add users

You can add users manually, one by one, or import their list from an Excel file. Each of these options is described below.

  • Add users manually

1. To add a new user, go to Users → New user:

Add users.png

2. Fill in all the fields and press the "Create" button:

Eva apple.png

Note: Only users with the marked "Can log in" checkbox can register, work in the system and get corresponding notifications.

You may also edit user details by clicking the user's ID:

Screenshot 23.png

There are 4 types of users with <U>different roles in the system:

  • Translator
  • Evaluator
  • Manager
  • Administrator
  • Import users from Excel

If you already have the list of users with their contact info, you can easily import it without the need to enter such information manually.

To do so, go to Users → Import from Excel:

Import from excel.png

For more detailed instructions on users import, please see the Import users from Excel page.

When all users are added, you can start working with projects.

Redirect.jpg Back to the table of contents.

Create project

1. Go to Projects → New project:

Projects.png

2. Enter the required information and press the "Create" button:

Create new project.png

3. To check the project details, select the ID number:

Prdoject ID.png

Manager can control the project: edit & download files, reassign participants (manager, translator, evaluator or arbiter) or delete the project:

Project details.png

Note: Only the evaluator uploads the files. Manager may only download them, if needed

Redirect.jpg Back to the table of contents.

Create comparison report

After receiving an evaluation request from the system, the project evaluator has to compare edited files with unedited ones.

1. The evaluator uploads files:

1 ev upload files.png

2. When done, click "Create comparison report":

Create comparison reevport.png

Then you need to start evaluation. There are two types of evaluation.

Start evaluation (automatic word count)

If you select this option, the system will display randomly selected segments containing only corrected units for evaluation.

Click Start evaluation (automatic word count):

1 automaic.png

Then you may configure the evaluation process:

  • Skip locked units — hide "frozen" units (for example, the client wants some parts, extremely important for him, stayed unchanged. Besides, extra units slow down editor’s work).
  • Skip repetitions — the system will hide repeated segments (only one of them will be displayed in this case).
  • Skip segments with match — fuzzy match percentage. The program will hide segments with match greater than or equal to that you specified.
  • Evaluation sample word count limit — the number of words in edited segments, chosen for evaluation.

Click "Start evaluation":

Start evaluation automatic world count.png

Start evaluation (manual word count)

If the word count given by the system does not correspond to the word count you want, you may manually enter the total word count before starting evaluation.

Click Start evaluation (manual word count):

2 manual.png

Enter the number of evaluated source words:

1. start evaluation.png

Then press "Start evaluation" and the system will display all corrected segments of the document.

Quality evaluation

In this step, the project evaluator has to select the sample for the quality assessment and classify every correction by type and severity.

1. Click the "Add mistake" button:

1. 91.png

2. Add the information about the mistake and click "Submit":

2. mistake.png

You can edit, delete mistake/comment or add another mistake by clicking the corresponding buttons:

3. mistal.png

When the mistakes' classification is done, the project evaluator has to click "Complete evaluation" → "Complete",

The system will send the quality assessment report to the translator.

Please note that you may export the evaluation report with mistakes classification.

Redirect.jpg Back to the table of contents.

Complete evaluation

When you have evaluated all segments press "Complete evaluation", leave the comment if needed and click the "Complete" button:

1 complete evaluation.png

After generating the comparison report, the system sends the notification to the translator, and the translator may see all the corrections done in his deliveries.

Redirect.jpg Back to the table of contents.

Discussion of mistakes

When the project evaluator finishes assessing the translation quality, the project translator gets an email notification.

Translator reviews the quality feedback

After the translator has received the email with the translation quality evaluation, the translator should do the following actions:

1. View the Comparison report. Look through all the corrections made by the evaluator.

2. Go to the Evaluation report.

3. Look through the classification of each mistake.

4. If the translator agrees with the classification of all mistakes, they press "Complete project". The project and its evaluation score are finalized at this stage:

Complete tr.png

If the translator does not agree with the classification of some mistakes, they do the following actions:

5. Press "Add comment" in the box of the mistake that they do not agree with and enter it by clicking "Submit":

Misatake comment.png

6. They send the project for reevaluation by pressing "Request reevaluation":

Request reevaluation.png

7. The project will be sent to the evaluator, who will review the comments. The translator will receive the reply or reevaluated project. This action can be done 2 times.

8. If the translator and the evaluator have not reached an agreement, the translator can send the project to the arbiter by pressing "Request arbitration" (it appears instead of "Request reevaluation"):

Arb.png

9. The arbiter will provide a final score that cannot be disputed.

Evaluator reviews the translator's comments

At this stage, the evaluator needs to review all the translator’s comments with objections. The evaluator has the following instructions:

1. If the translator is right, change the mistake’s severity and enter your comment why it has been changed.

If the translator is wrong, enter your comment why the mistake's severity has not been changed.

2. To finish, press "Complete evaluation"=>"Complete". The project will be sent to the translator for review.

Arbiter reviews the project

Unless the system has been set up otherwise, the translator can return the project to the evaluator for 3 times.

If the translator and the evaluator have not managed to reach the agreement after 3 attempts, the translator sends the project to the arbiter.

The user, who was assigned to be the arbiter will be notified by the system.

The arbiter has to assign a final score on the disputed matters. Look through all the rows where the translator and evaluator disagree.

If the translator is right, change the mistake’s severity and enter your comment why it has been changed.

If the translator is wrong, enter your comment why the mistake severity has not been changed.

Arbitors comments.png

Finally, the arbiter should press "Complete project". The project will be finalized and all its participants will receive the respective message.

Complete project.png

Redirect.jpg Back to the table of contents.

Projects filters

For convenience's sake, you may apply different project filters:

1 f.png 2 fil.png

You may also order projects by particular criteria: click the title of any column and all the projects will line up (the arrow Line up arrow.jpg button appears):

1 project list.png

Note: The column headers which enable this sorting feature are highlighted in blue.

Redirect.jpg Back to the table of contents.

Reports

You can generate various reports in the system. Click the Reports menu on the top panel:

Reports.png

Users with the Translator role can access only their individual reports on their translations quality:

Users with the Evaluator role can access their individual reports on their translations quality and their evaluations reports:

Users with the Manager and Administrator roles can access all the available reports:

  • Average score reports

Here you may see the average reports: per translator and per translator company, per evaluator and per evaluator company, per manager and per manager company, per specialization.

  • Translator report

On this page, you will find information about every translator.

For more details, please see the Translator report page.

  • Evaluator report

On this page, you will find information about every evaluator.

For more details, please see the Evaluator report page.

  • Translator company report
  • Evaluator company report

Redirect.jpg Back to the table of contents.

System settings

You can change and set system values in the System menu:

System settings.png

Each of these menu screens is described below.

Account details

On the Account details page you can change the company name or delete the account by pressing the corresponding buttons:

Account details.png

Redirect.jpg Back to the table of contents.

Clients

The Client menu contains two submenus.

Clients.png

  • Clients list — the list of your client where you can edit or delete them by pressing the corresponding buttons:

Cliednt list.png

Note: You can’t delete a client connected with projects. Just select the unneeded client by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

  • New client — here you can add a new client by pressing the "Create" button:

New client.png

Redirect.jpg Back to the table of contents.

Languages

The languages' menu contains two submenus:

Language.png

  • Languages list — here you may view, edit or delete your language pairs by pressing the corresponding buttons:

Langduages list.png

Note: You can’t delete a language connected with projects. Just select the unneeded language by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

  • New language — here you can add a new language pair by pressing the "Add" button:

Add new language '.png

Redirect.jpg Back to the table of contents

Specializations

Specialization is a particular field that translation is focused on (an object of translation).

This menu screen contains two submenus. Each of them is described below.

1 spesial.png

  • Specializations list — here you may view, edit, and delete your specializations by pressing the corresponding buttons:

1 specializationfs.png

Note: You can’t delete specializations connected with projects. Just select the unneeded specialization by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

  • New specialization — here you may add a new specialization by pressing the "Create" button:

New specializations.png

Redirect.jpg Back to the table of contents

Services

The services' menu contains two submenus:

Services.png

  • Services list — here you can view, edit or delete services you provide by pressing the corresponding buttons:

Services list.png

  • New service — here you can add new services by pressing the Create" button:

New service.png

Redirect.jpg Back to the table of contents

Mistake severities

Mistake severity is the gravity of mistake.

Go to System → Mistake severities:

Mistake severties.png

This menu screen contains two submenus. Each of them is described below.

  • Mistake severities list - here you may view, edit, and delete the mistake severities by pressing the corresponding buttons:

Mistakse severities list.jpg

Note: You can’t delete mistake severities connected with projects. Just select the unneeded mistake severity by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

New mistake severties.png

Redirect.jpg Back to the table of contents

Mistake types

Mistake type is the kind of mistake. For example, Grammar, Punctuation, etc:

Mstake types.png

This menu screen contains two submenus. Each of them is described below.

  • Mistake types list - here you may view, edit, and delete the mistake types by pressing the corresponding buttons:

Mistcake types list.jpg

Note: You can’t delete mistake types connected with projects. Just select the unneeded mistake by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

  • New mistake type - here you may add a new mistake type by pressing the "Create" button:

New mistake typ2e.png

Redirect.jpg Back to the table of contents

Quality standards

By default, the system has predefined quality standards, i.e. types of mistakes, penalty scores etc., but you can change them to define your own corporate quality standards.

For more detailed information, please see the Quality standard page.

Edit quality levels

Here you may see the list of default quality levels proposed by the system.

You can update, remove, and add new quality levels by pressing the corresponding buttons:

1quality.png

Note: You can’t remove quality levels connected with projects.

Redirect.jpg Back to the table of contents

Evaluation settings

On the Evaluation settings page you may define score limit, maximum evaluation attempts and default evaluation sample word count limit by pressing the "update" button:

Screeenshot 1.png

  • Score limit — the maximum score your translations can get.
  • Maximum evaluation attempts — here you may define, how many times translator may argue in discussion with evaluator. By default, translator may leave 3 comments. 2 times replies evaluator, but on the 3-rd time, arbiter replies and complete this discussion.
  • Default evaluation sample word count limit — here you may define the number of words for evaluation (the system offers 1000 words by default).

Redirect.jpg Back to the table of contents

Default time limits

On this page you may define evaluator/ translator/ arbiter time limit by pressing the "Update" button:

Default time limit.png

Redirect.jpg Back to the table of contents

Notifications

Here you can configure whether the system should send notifications of comparison reports creation to translators, and of projects completion to evaluators:

Email notifications.png

Enable or disable the corresponding notification, and press "Update" to save changes.

Redirect.jpg Back to the table of contents

License

On this page, you may see your license details:

License page.jpg

By pressing "Manage license" you can manage your license.


If any questions arise, please contact us.

Good luck!

Redirect.jpg Back to the table of contents