Difference between revisions of "Quality score formula"

From TQAuditor Wiki
Jump to: navigation, search
(Quality score calculation examples)
 
(23 intermediate revisions by the same user not shown)
Line 2: Line 2:
  
 
[[File:QSF.png|border|1000px]]
 
[[File:QSF.png|border|1000px]]
 
  
 
;1. Account score limit
 
;1. Account score limit
Line 13: Line 12:
 
:A sum of products of #2 and #3 for all the mistakes.
 
:A sum of products of #2 and #3 for all the mistakes.
 
;5. Project evaluation word count
 
;5. Project evaluation word count
:''Automatic word count'': The value from the "Total source words" field. Please see the [[Evaluation_report#Automatic_vs._manual_word_count|Automatic vs. manual word count]] page.
+
:''Automatic word count'': The value from the "Total source words" field in the "Evaluation details" section (not the Total source words of a file). Please see the [[Evaluation_report#Automatic_vs._manual_word_count|Automatic vs. manual word count]] page.
 
:''Manual word count'': The value from the "Evaluated source words" field (specified when starting the evaluation with a manual word count).
 
:''Manual word count'': The value from the "Evaluated source words" field (specified when starting the evaluation with a manual word count).
 
;6. 1000
 
;6. 1000
Line 19: Line 18:
 
The mistake severity scores, mistake type weights, and reports are based on this 1000-word amount. For example, a critical mistake with score of 20 with weight coefficient of 1 reduces the quality score by 20 per 1000 words (by 10 per 2000 words, accordingly, and so on).
 
The mistake severity scores, mistake type weights, and reports are based on this 1000-word amount. For example, a critical mistake with score of 20 with weight coefficient of 1 reduces the quality score by 20 per 1000 words (by 10 per 2000 words, accordingly, and so on).
  
For more information, please check the [[Quality score formula:Details|Quality score formula:Details]] page.
+
 
 +
For more information, please check the [[Quality score formula:Details and versions|Quality score formula:Details and versions]] page.
  
 
=='''Quality score calculation examples'''==
 
=='''Quality score calculation examples'''==
 +
 +
In the examples below, the following quality standard is used:
 +
 +
[[File:QS.png|border|300px]]
 +
 +
[[File:QS1.png|border|1000px]]
  
 
===Automatic word count===
 
===Automatic word count===
 +
‎<br />
 +
;File details&#58;
 +
:Total source words: 3126
 +
:Fully reviewed: yes
 +
:Number of units (segments): 392
 +
:Project specialization - marketing
 +
 +
;Evaluation settings&#58;
 +
[[File:EAS.png|border|300px]]
 +
 +
;Evaluation details&#58;
 +
:Total source words: 1749
 +
:Source words in corrected units: 1002
 +
 +
'''Mistakes:'''
 +
 +
# <span style="color:red">'''Major'''</span> ('''<span style="color:blue">3</span>''' points each):
 +
## Terminology: '''1''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
## Grammar: '''1''' (weight coefficient '''<span style="color:DarkTurquoise">1.2</span>''')
 +
# <span style="color:orange"> '''Minor'''</span> ('''<span style="color:blue">1</span>''' point each):
 +
## Grammar: '''3''' (weight coefficient '''<span style="color:DarkTurquoise">1.2</span>''')
 +
## Functional: '''2''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
# <span style="color:green"> '''Repetitive'''</span> ('''<span style="color:blue">0.01</span>''' point each):
 +
## Functional: '''6''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
## Layout: '''8''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
# <span style="color:#6C3483"> '''Non-scoring'''</span> ('''<span style="color:blue">0</span>''' points each):
 +
## Style: '''5''' (weight coefficient '''<span style="color:DarkTurquoise">1.2</span>''')
 +
## Terminology: '''3''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
 +
:'''Total mistakes''': '''29'''
 +
:'''SUM''': '''1'''*'''<span style="color:blue">3</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''1'''*'''<span style="color:blue">3</span>'''*'''<span style="color:DarkTurquoise">1.2</span>'''+'''3'''*'''<span style="color:blue">1</span>'''*'''<span style="color:DarkTurquoise">1.2</span>'''+'''2'''*'''<span style="color:blue">1</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''6'''*'''<span style="color:blue">0.01</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''8'''*'''<span style="color:blue">0.01</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''5'''*'''<span style="color:blue">0</span>'''*'''<span style="color:DarkTurquoise">1.2</span>'''+'''3'''*'''<span style="color:blue">0</span>'''*'''<span style="color:DarkTurquoise">1</span>'''=3+3.6+3.6+2+0.06+0.08+0+0='''12.34'''
 +
 +
 +
;Quality score calculation&#58;
  
 +
Using the [[Quality_score_formula#Quality_score_formula_visualisation_and_interpretation|formula]]:
 +
100-(12.34/1749*1000)=92.94
  
 +
[[File:QSA.png|border|300px]]
 +
 +
----
  
 
===Manual word count===
 
===Manual word count===
 +
 +
‎<br />
 +
;File details&#58;
 +
:Total source words: 3126
 +
:Fully reviewed: no
 +
:Number of words in a reviewed part of the file: around 1500
 +
:Number of units (segments): 392
 +
:Project specialization - marketing
 +
 +
;Evaluation settings&#58;
 +
:‎Evaluated source words: 1500<br />
 +
 +
;Evaluation details&#58;
 +
:Corrected units: 227
 +
:Total source words: 1500
 +
 +
'''Mistakes:'''
 +
 +
# <span style="color:red">'''Major'''</span> ('''<span style="color:blue">3</span>''' points each):
 +
## Terminology: '''1''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
## Grammar: '''1''' (weight coefficient '''<span style="color:DarkTurquoise">1.2</span>''')
 +
# <span style="color:orange"> '''Minor'''</span> ('''<span style="color:blue">1</span>''' point each):
 +
## Grammar: '''3''' (weight coefficient '''<span style="color:DarkTurquoise">1.2</span>''')
 +
## Functional: '''2''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
# <span style="color:green"> '''Repetitive'''</span> ('''<span style="color:blue">0.01</span>''' point each):
 +
## Functional: '''6''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
## Layout: '''8''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
# <span style="color:#6C3483"> '''Non-scoring'''</span> ('''<span style="color:blue">0</span>''' points each):
 +
## Style: '''5''' (weight coefficient '''<span style="color:DarkTurquoise">1.2</span>''')
 +
## Terminology: '''3''' (weight coefficient '''<span style="color:DarkTurquoise">1</span>''')
 +
 +
:'''Total mistakes''': '''29'''
 +
:'''SUM''': '''1'''*'''<span style="color:blue">3</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''1'''*'''<span style="color:blue">3</span>'''*'''<span style="color:DarkTurquoise">1.2</span>'''+'''3'''*'''<span style="color:blue">1</span>'''*'''<span style="color:DarkTurquoise">1.2</span>'''+'''2'''*'''<span style="color:blue">1</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''6'''*'''<span style="color:blue">0.01</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''8'''*'''<span style="color:blue">0.01</span>'''*'''<span style="color:DarkTurquoise">1</span>'''+'''5'''*'''<span style="color:blue">0</span>'''*'''<span style="color:DarkTurquoise">1.2</span>'''+'''3'''*'''<span style="color:blue">0</span>'''*'''<span style="color:DarkTurquoise">1</span>'''=3+3.6+3.6+2+0.06+0.08+0+0='''12.34'''
 +
 +
 +
;Quality score calculation&#58;
 +
Using the [[Quality_score_formula#Quality_score_formula_visualisation_and_interpretation|formula]]:
 +
100-(12.34/1500*1000)=91.77
 +
 +
[[File:QSM.png|border|300px]]

Latest revision as of 15:20, 28 January 2022

Quality score formula visualisation and interpretation

QSF.png

1. Account score limit
The highest possible score (100 by default). Can be set on this page: [Evaluation settings]
2. Mistake severity score
Score of mistake by its severity (for example, 1 point for minor and 5 points for major mistakes). Can be set on this page: [Mistake severities list]
3. Mistake type weight
Weight of a specific mistake type by specialization. Can be adjusted on this page [Mistake types list]
4. SUM
A sum of products of #2 and #3 for all the mistakes.
5. Project evaluation word count
Automatic word count: The value from the "Total source words" field in the "Evaluation details" section (not the Total source words of a file). Please see the Automatic vs. manual word count page.
Manual word count: The value from the "Evaluated source words" field (specified when starting the evaluation with a manual word count).
6. 1000
In the end, the result is always converted to 1000, a most optimal value.

The mistake severity scores, mistake type weights, and reports are based on this 1000-word amount. For example, a critical mistake with score of 20 with weight coefficient of 1 reduces the quality score by 20 per 1000 words (by 10 per 2000 words, accordingly, and so on).


For more information, please check the Quality score formula:Details and versions page.

Quality score calculation examples

In the examples below, the following quality standard is used:

QS.png

QS1.png

Automatic word count


File details:
Total source words: 3126
Fully reviewed: yes
Number of units (segments): 392
Project specialization - marketing
Evaluation settings:

EAS.png

Evaluation details:
Total source words: 1749
Source words in corrected units: 1002

Mistakes:

  1. Major (3 points each):
    1. Terminology: 1 (weight coefficient 1)
    2. Grammar: 1 (weight coefficient 1.2)
  2. Minor (1 point each):
    1. Grammar: 3 (weight coefficient 1.2)
    2. Functional: 2 (weight coefficient 1)
  3. Repetitive (0.01 point each):
    1. Functional: 6 (weight coefficient 1)
    2. Layout: 8 (weight coefficient 1)
  4. Non-scoring (0 points each):
    1. Style: 5 (weight coefficient 1.2)
    2. Terminology: 3 (weight coefficient 1)
Total mistakes: 29
SUM: 1*3*1+1*3*1.2+3*1*1.2+2*1*1+6*0.01*1+8*0.01*1+5*0*1.2+3*0*1=3+3.6+3.6+2+0.06+0.08+0+0=12.34


Quality score calculation:

Using the formula: 100-(12.34/1749*1000)=92.94

QSA.png


Manual word count


File details:
Total source words: 3126
Fully reviewed: no
Number of words in a reviewed part of the file: around 1500
Number of units (segments): 392
Project specialization - marketing
Evaluation settings:
‎Evaluated source words: 1500
Evaluation details:
Corrected units: 227
Total source words: 1500

Mistakes:

  1. Major (3 points each):
    1. Terminology: 1 (weight coefficient 1)
    2. Grammar: 1 (weight coefficient 1.2)
  2. Minor (1 point each):
    1. Grammar: 3 (weight coefficient 1.2)
    2. Functional: 2 (weight coefficient 1)
  3. Repetitive (0.01 point each):
    1. Functional: 6 (weight coefficient 1)
    2. Layout: 8 (weight coefficient 1)
  4. Non-scoring (0 points each):
    1. Style: 5 (weight coefficient 1.2)
    2. Terminology: 3 (weight coefficient 1)
Total mistakes: 29
SUM: 1*3*1+1*3*1.2+3*1*1.2+2*1*1+6*0.01*1+8*0.01*1+5*0*1.2+3*0*1=3+3.6+3.6+2+0.06+0.08+0+0=12.34


Quality score calculation:

Using the formula: 100-(12.34/1500*1000)=91.77

QSM.png