Quality Assurance

Building a New Call Center Quality Assurance Scorecard

January 18, 2021
0 minute read

Building out a QA program—and the first scorecard that comes along with it—can be a daunting process. And with good reason - your scorecard is the backbone of your QA program! 😅

While it seems a bit scary, getting your first scorecard done (and done right!) means you’re able to generate key business insights about your call center’s performance and level up your team’s performance...but it can be tough to know where to start. 

If this sounds familiar to you, you’ve come to the right place.

We’ve boiled the scorecard building process down into five simple steps: identifying your values, creating and refining your questions, organizing questions into a framework, picking your QA scorecard tool, and launching (and testing!) your scorecard. 

Below, we’ll dive in deep to each step and talk actionable strategies for getting your first scorecard off the ground 🛫

maestroqa scorecard building checklist template

Step 1: Identify the Values that Drive Your Customer Interactions

Before we get into building a scorecard, you have to answer two key questions: 

  1. What makes your customer experiences stand out from the pack? Or—if you’re a new support team—what do you want to be the thing that makes your experiences stand out?
  2. What metrics are you tracking (or: what experiences will you start tracking) to make sure your customer experiences are amazing?

The answers to 1 and 2 should be tied together. For example, if you want your team to become well-known for always providing a speedy response, then you should track and create goals around AHT.

By answering these questions, you’ve identified the values that drive your customer interactions and your operational goals. We like writing them out in a checklist like this: 

research checklist for building quality assurance scorecard

Your values can include things like “effortless customer experiences”, a movement popularized by experts from customer loyalty at Gartner.

Your operational goals should be attainable targets like achieving an 80+% retention rate, which ClassPass managed to achieve with the help of their QA program, or reducing average handle time to under 10 minutes—a goal which the CX team at monday.com built a scorecard to help their team attain. Operational goals may also be process-oriented or compliance-related - which makes for really simple questions that simply have to be in your rubric (see step 2).

Either way - your team can now start the scorecard building process with your goals in mind!


Step 2: Create and Refine Your QA Scorecard Questions

Next step: draft questions that help you and your team address the values and operational goals outlined in step 1. 

Most of the time, you’ll be able to create questions that sit across the intersection of a value and an operational goal. For example, “Customer Delight” and “89% CSAT” are a CX value and an operational goal, respectively, but might give rise to a single question like “did the agent’s chosen resolution delight the customer?” 


Step 3: Organize Your Questions into Your Scorecard Framework.

As you develop questions to include in your QA scorecard, you’ll inevitably notice that some questions share common characteristics—and that’s a good thing! Most questions fall into one of these four categories:

  • Communication
  • Customer Connection
  • Compliance
  • Correct Content

These 4Cs are one example of a framework on which to organize your scorecard. 

The main point here is this: grouping similar questions into categories helps you to grade more efficiently—if you need to refer back to the actual ticket, you’ll be grouping these queries together heuristically, saving you time and effort.

We include other frameworks in our Ultimate Guide to CX QA Scorecards—such as our SIP framework: soft skills, issue resolution (also known as first call resolution or FCR), and procedure. The SIP framework allows your graders to grade quicker, increasing the quality of your QA data. Download your copy here!


Step 4: Pick a QA Scorecard Tool

maestroQA example of CX QA grading on spreadsheets

Spreadsheets are often the starting point for smaller teams or teams building out their first QA program. While they work in the short term, they don’t scale with teams as they grow. Just imagine grading and compiling QA scores for hundreds of agents in Google Sheets or Excel! 🤯🤯🤯


illustration of the MaestroQA grading platform


The other alternative—QA software. QA software often features automations that speed up the grading process (sometimes by up to 10x or more, as Pipedrive has discovered), reporting functionality that allows managers a birds-eye view of their team’s performance, as well as Screen Capture functionality that helps remote teams receive the coaching they need to succeed in a WFH environment.


Step 5: Test Your Scorecard

You’re almost ready to roll out your new QA scorecard!

Whether it’s your first QA scorecard or your twentieth, properly testing your scorecard out in the “real world” is a key step to ensure a successful rollout. Through user acceptance testing, and by involving stakeholders in your testing phase, you build up trust and gain buy-in from the people who will use and benefit from these scorecards the most.

Using a combination of A/B testing and User Acceptance Testing, you can earn the buy-in of your stakeholders and the wider CX team. We cover the basics of call center quality assurance scorecard testing here.


With these five simple steps in hand, you’re now ready to launch your brand new QA scorecard! Just remember—CX goals and objectives constantly change and evolve along with your company. You’ll find yourself wanting a QA scorecard update soon—so keep your copy of our Ultimate Guide to CX QA Scorecards handy for that.


Previous Article

Empowering Agents to Overcome Customer Service Challenges and Drive Brand Loyalty

Leanna Merrell

Navigating Legal Risks of AI in Employee Performance Management

Leanna Merrell

How QA is Transforming Sales

Leanna Merrell

Navigating AI Pitfalls and Enhancing CX in Call Centers

Leanna Merrell

Beyond VOC: The Future of Customer Service Conversation Intelligence

Leanna Merrell

How to Optimize Your Chatbot Strategy: QA’s Critical Role in Enhancing Accuracy & Effectiveness

Leanna Merrell

MaestroQA Achieves PCI DSS 4.0 Level 1 Compliance: Leading the Way in Secure QA Solutions

Lauren Alexander

Don't Settle. Dig Beneath The Surface For Customer Insights.

Team MaestroQA

Using Zendesk CSAT Reviews and Slack to Appreciate CX Agents

Customer Support Best Practices From The NYC Support Driven Meetup

Why Failure To Provide Great Customer Service Is A Risk To Company Success

Maintaining Quality Of Customer Support In The Face Of Hyper-Growth

Customer Service Quality Assurance and Soft Skills

The 2 Agent-Controlled Factors to Improve CSAT Scores

Guide to Building Call Center Quality Monitoring Scorecards

How To Improve CSAT Scores for Your Call Center in 3 Steps

Customer Service Quality Assurance for Higher CSAT Explained

How To Build Your First QA Scorecard — A Comprehensive Guide

Innovation in Quality Management with Freshly at The Art of Conversation

A maybe-too-honest perspective on our rebrand

How FabFitFun Uses Customer Service Quality Assurance To Manage A Best-In-Class Support Team

Team MaestroQA

How to Create A Customer Service Quality Assurance Form

See The Future: Be Proactive In Support Of Your Customers

Team MaestroQA

Quality Management and Customer Service Training Programs

Why Paving A Path To Resolution Is A Customer Service Best Practice

Team MaestroQA

CSAT Scores vs. Quality Assurance Metrics – Which Is Better?

5 Ways Quality Assurance Programs Can Improve CSAT Scores

MaestroQA Partnerships: Introducing Zendesk Suite

Is Your Quality Assurance Program Built For 2018?

Fresh Take: How Peer Review Can Identify Improvements

Roger That! Assume Nothing Until You Get Confirmation

Creating a Multi-Channel Quality Form For Contact Centers

The Art of Training with Harry's Razors and FuboTV

Building Customer Loyalty And Trust Through Service

Team MaestroQA

How ActiveCampaign Uses MaestroQA To Scale Their Support Team, And Improve Team Dynamics

Team MaestroQA

Omnichannel Support For Agents And Customers: A Necessity

2 Types Of Agent Skills That Impact Customer Satisfaction

Mastering Customer Interactions in the Age of DSAT

Leanna Merrell

How Shinesty Uses Alternative Positioning as a Best Practice

Dangers Of The 90%+ QA Scores

Using Positive Positioning to Improve Call Center CX

Team MaestroQA

Navigating AI Implementation Strategy in Customer Experience: Risks and Strategies

Leanna Merrell

Elevating Call Center Performance with Six Sigma and MaestroQA

Lauren Alexander

Elevating Business Excellence Through Non-Customer-Facing QA: A Strategic Imperative

Leanna Merrell

Elevating Trust and Safety through QA: How TaskRabbit Sets the Standard

Leanna Merrell

The Essential Guide to Chatbot Quality Assurance: Ensuring Excellence in Every Interaction

Leanna Merrell

Unlocking Superior CX: The Bombas Blueprint for Quality and Coaching

Leanna Merrell

Agent Empowerment: 5 Tactics for Customer Retention from Industry Leaders

Mastering Agent Onboarding: Quality Assurance Lessons from ClassPass

How Angi Unlocked Growth and Continuous Improvement with QA

The Transformation of QA: Driving Business Results - Key Takeaways from MaestroQA’s CX Summit

Lauren Alexander

Unleashing the Power of Customer Conversations: Top 6 Tech Trends Revealed at the CX Summit

Lauren Alexander

Important Factors to Consider when Exploring Sentiment Analysis in Customer Support QA: A CX Community Discussion

Driving Business Impact with Targeted QA: Insights from an Expert

The Art of Outsourcing Customer Support: Lessons from Stitch Fix's BPO Partnership

Larrita Browning

How to Revamp QA Scorecards for Enhanced Quality Assurance

De-Villainizing QA Scorecards with Hims & Hers Customer Service

How to Maximize Call Center & BPO Performance | MaestroQA

Larrita Browning

Writing the Auto QA Playbook & Transforming Customer Support

Larrita Browning

MaestroQA Named One of Comparably’s 2023 Best Workplaces in New York for the Second Consecutive Year

Larrita Browning

Advancing Customer Service Metrics with AI Classifiers

Lauren Alexander

MaestroQA Named on Comparably’s Best Workplaces in New York

Larrita Browning

CX Strategy: The Future of AI in Quality Assurance

Larrita Browning

Elevating Customer Satisfaction with Visibility & Coaching

Larrita Browning

How Customers Collaborate with Their BPO Partners Today

5 Key Strategies to Supercharge Your BPO Partnership

Larrita Browning

Champion-Challenger Model: Improve Customer Service In BPOs

Larrita Browning

Kick Start Your Customer Service BPO Partnership Successfully

Larrita Browning

BPO Call Centers: Best Practices for Quality Assurance

Larrita Browning

Call Calibration: What is It & What are the Benefits?

Larrita Browning

Increase QA Team Alignment with Call Calibration & GraderQA

Dan Rorke

Measuring An Organization's 3 Ps: People, Process and Product

Larrita Browning

Empathy in Customer Service: Everything You Need to Know

Larrita Browning

Average Handle Time (AHT): How to Calculate & Reduce It

How to Onboard Your Customer Service Team to a New QA Program

21 Key Customer Experience Definitions for QA Professionals

Should You Have Dedicated Quality Assurance Specialists?

How Top eCommerce Brands Ensure Exceptional Customer Service in a Remote World

The Top 4 CX Books Recommended by Our QA Community

A Guide to Customer Service Quality Assurance Programs

5 Key Components of a Remarkable Customer Service Experience

The Ultimate Guide to Improving First Call Resolution (FCR)

How to Refresh Your Call Center Quality Monitoring Scorecard

The Key to Customer Service Coaching Is More Data (and Fewer Opinions)

Call Center Quality Assurance with Zola and Peloton

How to Update Your QA Scorecard

3 Ways to Test Your Call Center Quality Assurance Scorecard

The 9 Customer Service KPIs Needed To Improve CX

What is DSAT and 5 Steps to Improve It

Leveraging Customer Sentiment to Improve CX in Call Centers

Larrita Browning

Customer Experience Management and Quality Assurance Jobs

How Deeper CX Analytics Lead to Better CSAT | MaestroQA

Customer Service Management 101: Everything You Need to Know

Beyond Low CSAT Scores: Finding the Root Cause of Poor CX

How to Create an Omnichannel Call Center Quality Assurance Scorecard

Achieving Effortless Customer Experiences (CX) with QA

This Is What an Effective Customer Service Coaching Session Looks Like

Customer Service Coaching 101: Improve Agent Performance

Auto-Fail in Call Center QA: What It Means and When to Use It

MaestroQA's Aircall Integration: Bring Your Calls to Life