Difference between revisions of "Administrator user manual"

Revision as of 09:02, 12 May 2022

For a brief overview of the system, please check this video:

About TQAuditor

TQAuditor 3.04 is the system that evaluates and monitors translation quality and allows you to:

• compare unedited translation made by a translator with edited version received from an editor;

• generate a comparison report;

• classify each correction by mistake type and severity, thus allowing to get the translation quality evaluation score;

• ensure anonymous communication between the translator, evaluator and arbiter regarding mistakes classification;

• automate a process of maintaining the evaluation project;

• save all evaluated translations in the database and create translation quality reports both on each individual user and the whole company.

• you can create the list of top translators with the highest score, see dynamics of quality per individual translator by month, etc.

Quick comparison

You can compare two versions of the translation without registering an account.

1. Go to https://tqauditor.com and click "Compare files":

It will open the Quick comparison page.

2. Choose the translated and reviewed files, and click the "Update selected files" button:

Note: TQAuditor accepts bilingual files of different formats (Helium, XLF, XLZ, SDLXliff, TTX, TMX etc.). Click "Supported bilingual file types" on the "Upload files" page to see all the file formats TQA work with.

3. The Comparison report page will be displayed:

Back to the table of contents.

Quick comparison details

You can delete the comparison report by clicking a corresponding button:

You may also upload files for a new comparison report by clicking "Upload files". An existing comparison report will be deleted.

Markup display

Markup display settings allow you to choose how tags will be displayed:

• "Full" — tags have original length, so you can see data within:

• "Short" — the contents of the tags are not displayed and you see only their position in the text:

• "None" — tags are not displayed:

Units display

• "All" — units with and without corrections are displayed:

• "With corrections" — only units with corrections are displayed:

Back to the table of contents.

Register an account

You’ll need to register an account to benefit from the full functionality of the system, e.g. comparing many file pairs at once, classify mistakes, get the quality score of the translation, enable discussion between the translator and editor, and see the detailed reports of everything that happens with translation quality in your company.

[new version] To use the full functionality of the system, you have to register an account. It will allow you to add users to your company account, create projects and manage project participants, generate detailed reports, and set up the quality standard for your company.

1. Go to tqauditor.com and click "Sign up":

2. Fill in the information, read Terms of Service and Privacy Policy, mark the checkbox, and click the "Submit" button:

Back to the table of contents.

Add users

You can add users manually or import a users list from an Excel file.

Add users manually

1. To add a new user, go to Users → New user:

2. Fill in all the fields and click the "Create" button:

Note: only users with the marked "Can log in" checkbox can get the invitation email and complete registration, use the system and get email notifications. If the "Can log in" checkbox is unmarked, the invitation email will not be sent.

You may also edit user details by clicking the user's ID:

There are 4 roles in the system: translator, evaluator, manager, and administrator.

Import users from Excel

If you already have the list of users with their contact info, you can easily import it without the need to enter such information manually.

To do so, go to Users → Import from Excel:

For more detailed instructions on users import, please see the Import users from Excel page.

Note: only an account owner can import users from Excel.

When all users are added, you can start creating projects and managing project participants.

Back to the table of contents.

Create project

1. Go to Projects → New project:

2. Enter the required information and press the "Create" button:

3. To check the project details, select the ID number:

The manager can edit project details, download files, reassign project participants, clone or delete the project.

Note: only the evaluator can upload files.

Back to the table of contents.

Create comparison report

After getting an email notification from the system the assigned evaluator has to compare the original and reviewed versions of a translation.

1. The evaluator uploads files:

2. When done, the evaluator can create the comparison report:

3. Then the evaluator can start the evaluation whether with an automatic or manual word count.

Start evaluation (automatic word count)

If you select this option, the system will display randomly selected segments containing only corrected units for evaluation.

Click Start evaluation (automatic word count):

The evaluation settings can be configured:

• "Skip repetitions" — the system will hide repeated segments (only one of them will be displayed)

• "Skip locked units" — the "frozen" units will not be displayed (for example, this setting is used if a client wants some important parts of the translated text to stay unchanged).

• "Skip units with match >=" — units with matches greater than or equal to a specified number will not be displayed.

• "Evaluation sample word count limit" — this value is used to adjust how many segments for evaluation will be displayed.

Click "Start evaluation":

Start evaluation (manual word count)

If the word count given by the system does not correspond to the word count you want, you may manually enter the total word count before starting evaluation.

If this option is applied, all the corrected units will be displayed.

Click Start evaluation (manual word count):

Enter the number of evaluated source words:

Quality evaluation

In this step, the project evaluator has to select the sample for the quality assessment and classify every correction by type and severity.

1. Click the "Add mistake" button:

2. Add the information about the mistake and click "Submit":

The evaluator can add mistakes, edit existing mistakes and comments or delete them by clicking the corresponding buttons:

When the mistakes classification is done, the evaluator has to click "Complete evaluation", write an evaluation summary, and click the "Complete" button. Then, the translator will get a notification of evaluation completion and a quality assessment report.

[new version] The translator will receive an email notification of quality evaluation completion.

Please note that you may export the evaluation report with mistakes classification.

[new version] Please note that any project participant can export the evaluation report.

Back to the table of contents.

Complete evaluation

When you have evaluated all segments press "Complete evaluation", leave the comment if needed and click the "Complete" button:

[new version] When all the mistakes are added and classified, click "Complete evaluation", write an evaluation summary, and click the "Complete" button. The translator will receive an email notification of quality evaluation completion.

After generating the comparison report, the system sends the notification to the translator, and the translator may see all the corrections done in his deliveries.

Back to the table of contents.

Translator's review

After the translator has received the email with the translation quality evaluation, the translator should do the following actions:

1. View the Comparison report.

2. Go to the Evaluation report. Look through all the corrections made by the evaluator.

3. Look through the classification of each mistake.

4. If the translator agrees with the classification of all mistakes, they press "Complete project". The project and its evaluation score are finalized at this stage:

[new version] Once the translator receives the email notification of comparison report creation, they can review all the corrections made by the reviewer.

Once the evaluation report is created, the translator can review the mistakes classification.

If the translator agrees with the mistakes classification, they click "Complete project". The project and its evaluation score will be finalized at this stage:

If the translator does not agree with the classification of some mistakes, they do the following actions:

5. Press "Add comment" in the box of the mistake that they do not agree with and enter it by clicking "Submit":

[new version] If the translator does not agree with the mistakes classification, they can ask the evaluator to decrease a mistake severity. To do so, they click "Add comment" in the box of the mistake, write a comment clarifying the matter and click "Submit":

6. They send the project for reevaluation by pressing "Request reevaluation":

[new version] Once the translator enters all the comments, they request the reevaluation.

7. The project will be sent to the evaluator, who will review the comments. The translator will receive the reply or reevaluated project. This action can be done 2 times.

[new version] ::Note: The ability to request the reevaluation (and how many times) depends on the account evaluation settings.

8. If the translator and the evaluator have not reached an agreement, the translator can send the project to the arbiter by pressing "Request arbitration" (it appears instead of "Request reevaluation"):

[new version] If the translator still does not agree, they can request arbitration (the corresponding button appears instead of "Request reevaluation"):

9. The arbiter will provide a final score that cannot be disputed.

Projects filters

For convenience's sake, you may apply different project filters:

[new version] You can use filters on the "Projects list" page.

To sort the projects by the needed criteria, please click any column name highlighted in blue.

When the projects are sorted, you will see the arrow button next to the corresponding column name:

Back to the table of contents.

Reports

You can generate various reports in the system. Click the Reports menu on the top panel:

[new version] You can generate various reports. Click the Reports menu on the top panel

Users with the Translator role can access only their individual reports on their translations quality:

[new version] Users with the "translator" role can access only their individual translation quality reports.

Users with the Evaluator role can access their individual reports on their translations quality and their evaluations reports:

[new version] Users with the "evaluator" role can access their individual translation quality reports and evaluator reports:

Users with the Manager and Administrator roles can access all the available reports:

[new version] Users with the "Manager" and "Administrator" roles can access both their individual reports and other translators' and evaluators' reports.

The list of all available reports:

• Average score reports:

Here you may see the average reports: per translator and per translator company, per evaluator and per evaluator company, per manager and per manager company, per specialization.

[new version]

Per translator

Per evaluator

Per manager

Per translator company

Per evaluator company

Per manager company

Per specialization

• Translator reports

On this page, you will find information about every translator.

For more details, please see the Translator report page.

• Evaluator reports

On this page, you will find information about every evaluator.

For more details, please see the Evaluator report page.

• Translator company reports

• Evaluator company reports

Back to the table of contents.

System settings

You can change and set system values in the System menu:

[new version] You can adjust account settings and specify system values in the "System" menu:

Each of these menu screens is described below.

Account details

On the Account details page you can change the company name or delete the account by pressing the corresponding buttons:

Back to the table of contents.

Clients

The Client menu contains two submenus.

• Clients list — the list of your client where you can edit or delete them by pressing the corresponding buttons:

Note: You can’t delete a client connected with projects. Just select the unneeded client by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

• New client — here you can add a new client by pressing the "Create" button:

Back to the table of contents.

Languages

The languages' menu contains two submenus:

• Languages list — here you may view, edit or delete your language pairs by pressing the corresponding buttons:

Note: You can’t delete a language connected with projects. Just select the unneeded language by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

• New language — here you can add a new language pair by pressing the "Add" button:

Back to the table of contents

Specializations

Specialization is a particular field that translation is focused on (an object of translation).

This menu screen contains two submenus. Each of them is described below.

• Specializations list — here you may view, edit, and delete your specializations by pressing the corresponding buttons:

Note: You can’t delete specializations connected with projects. Just select the unneeded specialization by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

• New specialization — here you may add a new specialization by pressing the "Create" button:

Back to the table of contents

Services

The services' menu contains two submenus:

• Services list — here you can view, edit or delete services you provide by pressing the corresponding buttons:

• New service — here you can add new services by pressing the Create" button:

Back to the table of contents

Mistake severities

Mistake severity is the gravity of mistake.

Go to System → Mistake severities:

This menu screen contains two submenus. Each of them is described below.

• Mistake severities list - here you may view, edit, and delete the mistake severities by pressing the corresponding buttons:

Note: You can’t delete mistake severities connected with projects. Just select the unneeded mistake severity by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

• New mistake severity - here you may add a new mistake severity by pressing the "Create" button:

Back to the table of contents

Mistake types

Mistake type is the kind of mistake. For example, Grammar, Punctuation, etc:

This menu screen contains two submenus. Each of them is described below.

• Mistake types list - here you may view, edit, and delete the mistake types by pressing the corresponding buttons:

Note: You can’t delete mistake types connected with projects. Just select the unneeded mistake by pressing "Edit" and uncheck the "Enabled" box. It will not appear in the drop-down list anymore.

• New mistake type - here you may add a new mistake type by pressing the "Create" button:

Back to the table of contents

Quality standards

By default, the system has predefined quality standards, i.e. types of mistakes, penalty scores etc., but you can change them to define your own corporate quality standards.

For more detailed information, please see the Quality standard page.

Edit quality levels

Here you may see the list of default quality levels proposed by the system.

You can update, remove, and add new quality levels by pressing the corresponding buttons:

Note: You can’t remove quality levels connected with projects.

Back to the table of contents

Evaluation settings

On the Evaluation settings page you may define score limit, maximum evaluation attempts and default evaluation sample word count limit by pressing the "update" button:

• Score limit — the maximum score your translations can get.

• Maximum evaluation attempts — here you may define, how many times translator may argue in discussion with evaluator. By default, translator may leave 3 comments. 2 times replies evaluator, but on the 3-rd time, arbiter replies and complete this discussion.

• Default evaluation sample word count limit — here you may define the number of words for evaluation (the system offers 1000 words by default).

Back to the table of contents

Default time limits

On this page you may define evaluator/ translator/ arbiter time limit by pressing the "Update" button:

Back to the table of contents

Notifications

Here you can configure whether the system should send notifications of comparison reports creation to translators, and of projects completion to evaluators:

Enable or disable the corresponding notification, and press "Update" to save changes.

Back to the table of contents

License

On this page, you may see your license details:

By pressing "Manage license" you can manage your license.

If any questions arise, please contact us.

Good luck!

Back to the table of contents