CQ Analyze Guide: Reviewer Performance Report

The Reviewer Performance Report in CQ Analyze offers a powerful way to assess the quality and consistency of your reviewers’ work. With this report, you can track key metrics across multiple projects, identify trends in performance, and make informed decisions about training, resourcing, or vendor management. Whether you're managing internal teams or external vendors, this report provides the transparency and insight needed to maintain high linguistic quality at scale.

Use Cases

• Monitoring individual reviewer performance over time

• Identifying high-performing reviewers or those needing coaching

• Comparing vendor reviewer teams

• Preparing data for internal reviews or client quality reports

• Ensuring evaluation consistency across languages or domains

How to Access the Report

1. Navigate to the Analyze --> Reports tab in your CQ workspace

2. In the Search field, type Reviewer Performance Report, or scroll down the list of available reports

3. Click on Reviewer Performance Report

4. Inside the report view, you’ll find filters connected to both evaluations and users. These allow you to customize the report for your specific use case. Moreover, you can choose there the timeframe which you want to be analyzed.

 

Step-by-Step: Track a Reviewer's Performance Over Time

This paragraph shows how to use the Reviewer Performance Report in ContentQuo Analyze to monitor the performance of a specific reviewer across a selected time period.

After you have found the Reviewer Performance Report in the Analyze section of your instance, you’re ready to dive into the data. Follow these steps to monitor an individual reviewer’s performance over time:

Step 1: Apply the Reviewer Filter

In the filters panel, select the Reviewer whose performance you want to monitor.
You can also combine this with filters such as Language, Evaluation name, or Evaluation status, etc. to narrow down the context.

Step 2: Choose the Time Range

Use the Time Range option to define the period you want to review (e.g., week, month, quarter, or a custom range). This allows you to observe performance trends and changes over time needed.

Step 3: Analyze the Chart

Scroll the report chart to see the reviewer’s score progression over time.

These patterns can help you identify training needs, workload issues, or successful improvement after feedback.

Step 4: Review the Score Range

Check the Score Range to evaluate how consistent the reviewer’s results are. Use the Edit Distance metric to see how much content was changed in each evaluation, it's helpful for understanding the scope and depth of edits.

Step 5: Inspect Evaluation Details

To see the exact evaluations grouped under each row in the report, simply click on the row. This will expand the section and display the list of evaluations included in that summary.

If you want to explore further, you can click on a specific evaluation to open its detailed view. There, you’ll be able to:

• Read reviewer or rebutter comments

• Check the exact issues raised

• Review segment-level annotations 

This drill-down functionality helps you understand not only the score but also the context behind it.

Step 6: Downloading results

If you need to share the data externally or keep a record for reporting purposes, you can easily download the Reviewer Performance Report.

To do this:

1. Scroll to the top-right corner of the report.

2. Click the Download icon

You will have the results in CSV format available for further analysis in Excel/Google Sheets

The Reviewer Performance Report in ContentQuo Analyze can gain deep insights into individual reviewer performance, identify trends, and take timely actions to improve quality.

If you need help collecting the necessary data or configuring your report, feel free to contact our Support Team. We’ll be happy to assist you!