User manual

From TQAuditor Wiki
Jump to: navigation, search

About TQAuditor

TQAuditor 2.12 is the system that evaluates and monitors translation quality and allows you to:

  • compare unedited translation made by a translator with edited version received from an editor;
  • generate a report about editor’s corrections;
  • classify each correction by mistake type and severity, thus allowing to get the translation quality evaluation score with a maximum 100 points;
  • ensure anonymous communication between a translator and an editor regarding corrections and mistakes classification;
  • automate a process of maintaining the evaluation project;
  • save all evaluated translations in the database and create the translation quality reports at the company:

you can create the list of top translators with the highest score, see dynamics of quality per individual translator by month, etc.

Start without registration

You can compare two versions of translated files in the system even without registering an account.

Go to https://tqauditor.com and use "Compare files":

Compare files without registering.jpg

It will open the Quick compare page:

Quick compare files uploading.jpg

  • Translated files - add here unedited bilingual files using the "Browse" button.
  • Reviewed files - add here edited bilingual files using the "Browse" button.

TQAuditor 2.12 accepts bilingual files of different formats (Helium, XLF, XLZ, SDLXliff, TTX, TMX etc.). Click "Supported bilingual file types" to see all the file formats TQA work with.

Press "Upload selected files".

It will open the page with the Comparison report and additional options:

QQP comparison report.jpg

Let’s review them in details.

Redirect.jpg Back to the table of contents.

Comparison report deletion

Press Delete comparison report if current information is no longer needed:

CR deletion anf files uploading.jpg

Here you may also upload other files for a new comparison report by pressing Upload files.

Export report to Excel

You may even export the report to Excel.

Click Export to Excel:

CR export data.jpg

And you will have the fixes in columns for comparing:

CR xls file.jpg

Markup display

With Markup display option, you may choose tags display.

  • Full - tags have original length, so you can see the data within:

Markup display Full.jpg

  • Short - tags are compressed and you see only their position in the text:

Markup display Short.jpg

  • None – tags are totally hidden, so they will not distract you:

Markup display None.jpg

Press the "Apply" button after changing the preferences:

Apply button2.jpg

Redirect.jpg Back to the table of contents.

Units display

  • All units - shows all text segments:

UD all11.jpg

  • With corrections - shows nothing but amended:

UD with corrections.jpg

Press the "Apply" button after changing the preferences:

Apply button2.jpg


That’s it. To discover the other features of TQAuditor, you need to register.

Please see the next chapters.


Redirect.jpg Back to the table of contents.

Account registration

You’ll need to register an account to benefit from the full functionality of the system, e.g. comparing many file pairs at once, classify mistakes, get the quality score of the translation,

enable discussion between the translator and editor, and see the detailed reports of everything that happens with translation quality in your company.

So let’s start the registration…

1. Go to https://tqauditor.com and press "Sign Up":

Sign up button.jpg

2. Choose the type of account (Light account or Enterprise account):

Light or Enterprise account choice.jpg

Light account includes comparison options:

  • Unlimited quantity of file pairs per comparison report
  • Uploading files in ZIP archives
  • Export results to Excel

Enterprise account in addition to comparison options includes evaluation options and statistics:

  • Unlimited quantity of file pairs per comparison report
  • Uploading files in ZIP archives
  • Export results to Excel
  • Evaluation
  • Quality standard customization
  • Reports and statistics

3. Fill in all the fields with required information and select "Submit".

Now you have an account. We need to add your translators, managers and evaluators in the system. Please see the next chapter.


Redirect.jpg Back to the table of contents.

Adding users

You can add users manually, one by one, or import their list from an Excel file. Each of these options is described below.

Adding users manually

To add a new user, go to Users => New user:

UM New user.jpg

It will open the New user creation page.

Fill in all the fields and press the "Create" button:

UCP.jpg

The system will send a confirmation e-mail to just created user.

And you will see, that user appeared in the Users list.

You may also Edit user details or Resend invitation (for this, click the necessary user ID):

UL ID clicking.jpg

For more info, please see the User details page.

The user must confirm registration. The date and time of registration will be shown in the Registered at column:

ULP registration confirmation field.jpg

Note: There are 4 types of users with different roles in the system:

  • Translator
  • Evaluator
  • Manager
  • Administrator

For more detailed information on System roles, please see the System roles section.

Import users from Excel

If you already have the list of users with their contact info, you can easily import it without the need to enter such information manually.

To do so, go to Users=>Import from Excel:

UM Import.jpg

For more detailed instructions on users import, please see the Import users from Excel page.

Now, when all users are added, we may start working with projects. Please see the next chapter.


Redirect.jpg Back to the table of contents.

Project creation

Creating a translation quality evaluation project takes a minute or two.

The manager has just to appoint the project evaluator, project translator, project arbiter, enter some basic project info, and let the system take care of the project.

To start a new project, go to Projects=>New project:

New project menu.jpg

Fill in the blank and press the "Create" button:

Project creation page1.jpg

  • TMS translation job code - project code, entered by manager.
  • TMS review job code - project code, entered by manager (differs from translation job code).
  • Source language - language being translated from.
  • Target language - language being translated to.
  • Specialization - select a translation specialization (first, it should be created: System => Specialization => New specialization).
  • CAT word count - the weighted word count of the job.
  • Project translator - user that performs translations (may be assigned to everyone).
  • Project evaluator - user that evaluates translations (may be assigned to everyone, excluding translator).
  • Project arbiter - user that becomes a judge between translator and evaluator in controversial situations.

The arbiter’s decision about evaluation is final (may be assigned to everyone, excluding translator).

  • Note for evaluator- manager may leave additional information for the project evaluator here.

Note 1: Manager may assign himself as Project arbiter, Project evaluator or Project translator.

Note 2: The system role for Arbiter may be Evaluator, Manager or Administrator.

The new project will appear in the list.

To see project details, select the ID number:

Project ID item1.jpg

It will open the Project details page.

Manager can control the project: edit & download project files, reassign participants (manager, translator, evaluator or arbiter) or delete this project at all:

Project details page.jpg

Note: Evaluator (not manager) uploads the files. Manager may only download them, if needed:

Upload files evaluator page.jpg

Now, the project has been created, and manager can forget about it. The system sends an email notification to the project evaluator,

who has to follow the instructions from the next chapter.

Redirect.jpg Back to the table of contents.

Files comparison

After receiving an evaluation request from the system, the project evaluator has to compare edited files with unedited ones.

First, the evaluator uploads them:

Upload files button Ev account.jpg

Then, he has to choose files to compare and click "Upload selected files":

Upload selected files button Ev account.jpg


Files uploaded:

Files uploaded EV account.jpg

The evaluator may select several files by using "Browse" buttons.

After uploading, please click "Create comparison report":

Create comparison report button Ev Acc.jpg

The сomparison report has the word count for each segment, useful statistics and filters.

You may even export the report to Excel.


Let’s continue - press "Start evaluation":

Comparison report.jpg

You may configure evaluation process:

Start evaluation presettings.jpg

  • Skip locked units - hide "frozen" units (for example, the client wants some parts, extremely important for him, stayed unchanged. Besides, extra units slow down editor’s work).
  • Skip segments with match >= - fuzzy match percentage. The program will hide segments with match greater than or equal to that you specified.
  • Evaluation sample word count limit - the number of words in edited segments, chosen for evaluation.


Press "Start evaluation":

Start evaluation button.jpg

The evaluation started.

For convenience, you may view every segment in the comparison report - use "View in comparison":

View in comparison.jpg


When you have evaluated all segments press "Complete evaluation":

Complete evaluation button.jpg

Describe the translation in general or give advice to the translator and press the "Complete" button:

Complete evaluation details page.jpg

After generating the comparison report, the system sends the notification to the translator, and the translator may see all the corrections done in his deliveries.

But this is just the beginning - the project evaluator may start quality assessment process. For more info, please see the next chapter.

Redirect.jpg Back to the table of contents.

Quality evaluation

In this step, the project evaluator has to select the sample for the quality assessment and classify every correction by type and severity.

Select "Add mistake":

Add mistake button terminology.jpg

Add information about the mistake and click "Submit":

Adding mistake glossary.jpg

You can also edit, delete mistake/comment:

Mistake&Comment edit delete buttons new.jpg

You may add another mistake by pressing "Add mistake":

Adding another mistake new.jpg

When the mistakes classification is done, the project evaluator has to press "Complete evaluation" => "Complete",

and the system will send the quality assessment report to the translator. See translator’s steps in the next chapter.

Please note that you may export the evaluation report with mistakes classification.

Redirect.jpg Back to the table of contents.

Discussion of mistakes

When the project evaluator finishes assessing the translation quality, the project translator gets an email notification.

Translator reviews the quality feedback

After the translator has received the email with the translation quality evaluation, the translator should do the following actions:

1. View the Comparison report. Look through all the corrections made by the evaluator.

2. Go to the Evaluation report.

3. Look through the classification of each mistake.

4. If you agree with the classification of all mistakes, press "Complete project". The project and its evaluation score are finalized at this stage:

Complete project button translator's account.jpg

If you do not agree with the classification of some mistakes, do the following actions:

5. Press "Add comment" in the box of the mistake that you do not agree with and enter it by clicking "Submit":

Translator's 1st comment.jpg

6. When you have entered all the comments, send the project for reevaluation by pressing "Request reevaluation":

Request eveluation button translator's account.jpg

7. The project will be sent to the evaluator, who will review your comments. If they are convincing, the evaluator will change the mistake

severity in your favour. You will receive the reevaluated project. You are able to send this project for reevaluation one more time.

8. If you have not reached an agreement with the evaluator, you can send the project to the arbiter by pressing "Request arbitration" (it appears instead of "Request reevaluation"):

Request arbitration button.jpg

9. The arbiter will provide a final score that cannot be disputed.

Evaluator reviews the translator's comments

At this stage, the evaluator needs to review all the translator’s comments with objections. The evaluator has the following instructions:

1. If the translator is right, change the mistake’s severity and enter your comment why it has been changed.

If the translator is wrong, enter your comment why the mistake's severity has not been changed.

2. To finish, press "Complete evaluation"=>"Complete". The project will be sent to the translator for review.

Arbiter reviews the project

Unless the system has been set up otherwise, the translator can return the project to the evaluator for 3 times.

If the translator and the evaluator have not managed to reach the agreement after 3 attempts, the translator sends the project to the arbiter.


The user, who was assigned to be the arbiter will be notified by the system.


The arbiter has to assign a final score on the disputed matters. Look through all the rows where the translator and evaluator disagree.

If the translator is right, change the mistake’s severity and enter your comment why it has been changed.

If the translator is wrong, enter your comment why the mistake severity has not been changed.

Arbiter's final comment1.jpg

Finally, the arbiter should press "Complete project". The project will be finalized and all its participants will receive the respective message.

Complete project button arbiter's account.jpg

Redirect.jpg Back to the table of contents.

Projects filters

For convenience's sake, you may apply different project filters:

Projects list filters.jpg

For more details, please see the Additional filters section.

You may also order projects by particular criteria: click the title of any column and all the projects will line up (the arrow Line up arrow.jpg button appears):

Projects list header.jpg

Note: The column headers which enable this sorting feature are highlighted in blue.

For more details, please see the Projects list page.

Redirect.jpg Back to the table of contents.

Statistics and reports

All the data on translation quality assessment are piled up in the system, and after some period you’ll be able to generate the reports.

E.g. you can see the best-scoring translators or view the detailed report on each translator: how his quality was changing over time,

see what typical mistake the translator is making, in what specializations he scores better etc.

You can access reports by pressing Reports in the upper section of the screen:

Menu Reports.jpg

  • Users with the Translator role can access only their individual reports on their translations quality:

Translator's reports short.jpg

  • Users with the Evaluator role can access their individual reports on their translations quality and their evaluations reports:

Evaluator's reports.jpg

  • Users with the Manager and Administrator roles can access all the available reports:

Reports menu.jpg

Average score reports

To view the Average score reports, go to Reports=>Average score and select the necessary report:

Average score reports.jpg

Here you may see the following reports:

Translator report

To view the Translator report , go to Reports=>Translator report:

Translator report.jpg

On this page, you will find information about every translator.

For more details, please see the Translator report page.

Evaluator report

To view the Evaluator report , go to Reports=>Evaluator report:

Evaluator report.jpg

On this page, you will find information about every evaluator.

For more details, please see the Evaluator report page.

Redirect.jpg Back to the table of contents.

System settings

You can change and set system values in the System menu:

SM system.jpg

Each of these menu screens is described below.

Quality standards

By default, the system has pre-defined quality standards, i.e. types of mistakes, penalty scores etc.,

but you can change them to define your own corporate quality standards. To do so, go to System=>Quality standard:

Quality standard menu.jpg

For more detailed information, please see the Quality standard page.

Mistake severities

Mistake severity is the gravity of mistake.

Go to System=>Mistake severities:

Mistake severity menu.jpg

This menu screen contains two submenus. Each of them is described below.

  • Mistake severities list - here you may view the list of default mistake severities proposed by the system:

Mistake severities list.jpg

Note: You can’t delete mistake severities connected with projects. Just select the unneeded mistake severity by pressing "Edit"

and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

  • New mistake severity - here you may add a new mistake severity:

New mistake severity.jpg

For more details, please see the Mistake severities list and New mistake severity pages.

Redirect.jpg Back to the table of contents

Mistake types

Mistake type is the kind of mistake. For example, Grammar, Punctuation, etc.

Go to System=>Mistake types:

SM Mistake types.jpg

This menu screen contains two submenus. Each of them is described below.

  • Mistake types list - here you may view the list of default mistake types proposed by the system:

Mistake types list.jpg

Note: You can’t delete mistake types connected with projects. Just select the unneeded mistake by pressing "Edit"

and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

  • New mistake type - here you may add a new mistake type:

New mistake type page.jpg

For more details, please see the Mistake types list and New mistake type pages.

Redirect.jpg Back to the table of contents

Specializations

Specialization is a particular field that translation is focused on (an object of translation).

Go to System=>Specializations:

SM Specializations list.jpg

This menu screen contains two submenus. Each of them is described below.

  • Specializations list - here you may view the list of default specializations proposed by the system:

Specializations list page.jpg

Note: You can’t delete specializations connected with projects. Just select the unneeded specialization by pressing "Edit"

and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

  • New specialization - here you may add a new specialization:

New specialization page.jpg

For more details, please see the Specializations list and New specialization pages.

Redirect.jpg Back to the table of contents

Edit quality levels

Go to System=>Edit quality levels:

SM Edit quality levels.jpg

Here you may see the list of default quality levels proposed by the system:

Edit quality levels page.jpg

Note: You can’t remove quality levels connected with projects.

But you may add a new one (click "Add below") or edit current quality levels:

Edit quality levels page new level.jpg

Redirect.jpg Back to the table of contents

Evaluation settings

Go to System=>Evaluation settings:

SM Evaluation settings.jpg

On the Evaluation settings page you may define maximum evaluation attempts and default evaluation sample word count limit:

Evaluation settings page.jpg

  • Maximum evaluation attempts - here you may define, how many times translator may argue in discussion with evaluator. By default, translator may leave 3 comments. 2 times replies evaluator,

but on the 3-rd time, arbiter replies and complete this discussion.

  • Default evaluation sample word count limit- here you may define the number of words for evaluation (the system offers 1000 words by default).

Redirect.jpg Back to the table of contents

Reminders

Go to System=>Reminders:

SM Reminders.jpg

The system can remind about projects or automatically close them when you need it.

Reminders settings page.jpg

As you may see, the system is quite flexible in terms of settings, and you may configure the system to work a bit differently than it does by default.

Redirect.jpg Back to the table of contents

Notifications

Go to System=>Notifications:

CM Notifications.jpg

Here you can configure whether the system should send notifications of comparison reports creation to translators, and of projects completion to evaluators:

Email notification settings.jpg

Enable or disable the corresponding notification, and press "Update" to save changes.

Redirect.jpg Back to the table of contents

License

Go to System=>License:

SM License.jpg

On this page, you may see your license details:

License page.jpg

By pressing "Manage license" you can manage your license.

For more details, please see the Licensing page.


It seems that’s all you need for productive work in TQAuditor.

If any questions arise, please contact us.

Good luck!

Redirect.jpg Back to the table of contents