AI & Technology in CX

Advancing Customer Service Metrics with AI Classifiers

Lauren Alexander
November 22, 2023
0 minute read

Negative customer feedback can significantly impact a business's reputation, resulting in churn and lost revenue. To mitigate this risk, businesses are looking to ramp up their Quality Assurance workflows to detect and mitigate friction points in the customer journey before they impact business growth. 

Leveraging AI Classifiers and Sentiment Analysis with Novo’s Customer Service

In a recent Fireside Chat, we had the opportunity to speak with Novo, a leading mobile banking platform for small businesses, to learn more about the success their team is having using MaestroQA’s automated QA workflows, KPI dashboard and AI Classifiers to identify actionable insights that will have the greatest impact on customer satisfaction levels. 

In our discussion with Marcus Tatum, Quality Assurance Manager, he shared how his team uses MaestroQA's workflow automation and call center sentiment analysis to identify low-scoring DSAT tickets to perform targeted QA. While this automation has served Marcus and his team very well by not only identifying gaps in agent performance but also providing Voice of the Customer (VOC) insights into product and policy, it only captures feedback from customers who complete the CSAT survey, leaving out a potentially significant number of dissatisfied customers. 

In an effort to get a more accurate picture of what’s causing negative feedback from customers, Novo’s team is now leveraging MaestroQA’s automated transcription to analyze 100% of their customers' interactions to take their analysis of DSAT to the next level. They are even taking call center sentiment analysis one step further by revamping their approach to tracking negative sentiment by using MaestroQA’s AI classifiers and buildable logic to scan and surface the most meaningful tickets — enabling a new level of analysis and deeper quality metrics that didn’t exist before. 

How MaestroQA’s AI Classifiers Work

As an example, teams can build an AI classifier to scan tickets for signs of negative sentiment based on keywords specific to their business that indicate a negative customer experience. While the previous method of a blanket scan for negative sentiment was like a "black box," this new system is a “transparent box” and can be tailored to individual businesses.

MaestroQA’s transcriptions and AI Classifiers

Using Transcriptions to Identify Customer Service Insights

Using MaestroQA, Novo was able to uncover an issue that was occurring with mobile check deposits, where specific checks from the California State Government were being repeatedly rejected by their banking software. With the use of AI Classifiers, Marcus will be able to build reports using keywords associated with the "check rejection" issue to determine its frequency, identify which agents are skilled at handling these situations, and assess the negative sentiment resulting from these customer interactions. MaestroQA's highly accurate transcriptions will even enable the Classifier to listen for key phrases such as "check rejected, California, or deposit error" to identify phone calls discussing this particular issue. Novo’s QA team can also pull in other metadata from his HelpDesk to identify tickets where a customer started the conversation upset but was satisfied with the agent's response or conversations where a customer initially felt fine but became upset due to the agent's service or policy.

Benefits of Using AI Classifiers for Quality Metrics

By using AI classifiers, businesses can gain a more comprehensive understanding of their customers' issues and needs. Instead of relying solely on Manual QA or feedback from NPS and CSAT surveys, they can leverage AI-driven sentiment analysis to capture feedback from all interactions and use it to make data-driven decisions. This can lead to more efficient and effective customer service, as well as improvements in product and process design. Furthermore, the customizable nature of the classifiers enables businesses to develop new Quality KPIs to help make decisions regarding agent coaching, outsourcing, processes, and even product decisions.

With MaestroQA's AI classifiers, Marcus's team will be able to grade 100% of their tickets, gaining insights into trends and sentiment that will help them make better decisions. Marcus says, "Being able to understand everything that's going on and its full context and how often it's happening and understand the trends that help us make better decisions for sure."

MaestroQA’s KPI Dashboard & Custom KPIs

Secure Handling of Sensitive Information with MaestroQA

As a financial institution, Novo requires a tool that can meet its unique needs and accommodate the sensitive information shared by its customers. 

"Something I've loved about Maestro is how we're able to filter out tickets with automation. We realized that certain tickets are related to a potential policy break. Then there are tickets that just don't have any of that sensitive information. And so there's an opportunity to create an automation that’s specific to policy sensitive information or policy sensitive tickets or handling."

MaestroQA allows customer service teams to handle sensitive information securely, protecting their customers' data and privacy. Marcus emphasizes the importance of protecting their customers' data and privacy, saying, "Being a financial institution, it's super important that we're protecting our customers and their information." MaestroQA's redaction of account and debit card information provides an additional layer of security. Marcus and his team plan to use the AI Classifier tool to build out reporting on agent compliance, furthering their efforts to protect and support their customers.

MaestroQA’s Customizable Rubrics & Root-Cause Analysis Checkboxes

The Future of Quality Assurance and Customer Service with MaestroQA's AI Classifiers

By automating and customizing the categorization of customer interactions, AI classifiers are revolutionizing how businesses approach quality metrics. As Marcus emphasizes, there's always an opportunity to use new tools to improve quality assurance and customer service. He notes, "I really think where MaestroQA goes, Novo goes. That's historically how it's been. Where we'll see new tools rolled out, and our mindset is we're going to use this platform to its fullest extent. We're looking to utilize every feature that Maestro offers." With MaestroQA, businesses can streamline their feedback analysis, protect their customers' data and privacy, and ultimately improve their bottom line.

Check out the full recording of our chat with Novo, and if you would like to learn more about what MaestroQA can do for your business, please request a demo today.

Previous Article

Empowering Agents to Overcome Customer Service Challenges and Drive Brand Loyalty

Leanna Merrell

Navigating Legal Risks of AI in Employee Performance Management

Leanna Merrell

How QA is Transforming Sales

Leanna Merrell

Navigating AI Pitfalls and Enhancing CX in Call Centers

Leanna Merrell

Beyond VOC: The Future of Customer Service Conversation Intelligence

Leanna Merrell

How to Optimize Your Chatbot Strategy: QA’s Critical Role in Enhancing Accuracy & Effectiveness

Leanna Merrell

MaestroQA Achieves PCI DSS 4.0 Level 1 Compliance: Leading the Way in Secure QA Solutions

Lauren Alexander

Don't Settle. Dig Beneath The Surface For Customer Insights.

Team MaestroQA

Using Zendesk CSAT Reviews and Slack to Appreciate CX Agents

Customer Support Best Practices From The NYC Support Driven Meetup

Why Failure To Provide Great Customer Service Is A Risk To Company Success

Maintaining Quality Of Customer Support In The Face Of Hyper-Growth

Customer Service Quality Assurance and Soft Skills

The 2 Agent-Controlled Factors to Improve CSAT Scores

Guide to Building Call Center Quality Monitoring Scorecards

How To Improve CSAT Scores for Your Call Center in 3 Steps

Customer Service Quality Assurance for Higher CSAT Explained

How To Build Your First QA Scorecard — A Comprehensive Guide

Innovation in Quality Management with Freshly at The Art of Conversation

A maybe-too-honest perspective on our rebrand

How FabFitFun Uses Customer Service Quality Assurance To Manage A Best-In-Class Support Team

Team MaestroQA

How to Create A Customer Service Quality Assurance Form

See The Future: Be Proactive In Support Of Your Customers

Team MaestroQA

Quality Management and Customer Service Training Programs

Why Paving A Path To Resolution Is A Customer Service Best Practice

Team MaestroQA

CSAT Scores vs. Quality Assurance Metrics – Which Is Better?

5 Ways Quality Assurance Programs Can Improve CSAT Scores

MaestroQA Partnerships: Introducing Zendesk Suite

Is Your Quality Assurance Program Built For 2018?

Fresh Take: How Peer Review Can Identify Improvements

Roger That! Assume Nothing Until You Get Confirmation

Creating a Multi-Channel Quality Form For Contact Centers

The Art of Training with Harry's Razors and FuboTV

Building Customer Loyalty And Trust Through Service

Team MaestroQA

How ActiveCampaign Uses MaestroQA To Scale Their Support Team, And Improve Team Dynamics

Team MaestroQA

Omnichannel Support For Agents And Customers: A Necessity

2 Types Of Agent Skills That Impact Customer Satisfaction

Mastering Customer Interactions in the Age of DSAT

Leanna Merrell

How Shinesty Uses Alternative Positioning as a Best Practice

Dangers Of The 90%+ QA Scores

Using Positive Positioning to Improve Call Center CX

Team MaestroQA

Navigating AI Implementation Strategy in Customer Experience: Risks and Strategies

Leanna Merrell

Elevating Call Center Performance with Six Sigma and MaestroQA

Lauren Alexander

Elevating Business Excellence Through Non-Customer-Facing QA: A Strategic Imperative

Leanna Merrell

Elevating Trust and Safety through QA: How TaskRabbit Sets the Standard

Leanna Merrell

The Essential Guide to Chatbot Quality Assurance: Ensuring Excellence in Every Interaction

Leanna Merrell

Unlocking Superior CX: The Bombas Blueprint for Quality and Coaching

Leanna Merrell

Agent Empowerment: 5 Tactics for Customer Retention from Industry Leaders

Mastering Agent Onboarding: Quality Assurance Lessons from ClassPass

How Angi Unlocked Growth and Continuous Improvement with QA

The Transformation of QA: Driving Business Results - Key Takeaways from MaestroQA’s CX Summit

Lauren Alexander

Unleashing the Power of Customer Conversations: Top 6 Tech Trends Revealed at the CX Summit

Lauren Alexander

Important Factors to Consider when Exploring Sentiment Analysis in Customer Support QA: A CX Community Discussion

Driving Business Impact with Targeted QA: Insights from an Expert

The Art of Outsourcing Customer Support: Lessons from Stitch Fix's BPO Partnership

Larrita Browning

How to Revamp QA Scorecards for Enhanced Quality Assurance

De-Villainizing QA Scorecards with Hims & Hers Customer Service

How to Maximize Call Center & BPO Performance | MaestroQA

Larrita Browning

Writing the Auto QA Playbook & Transforming Customer Support

Larrita Browning

MaestroQA Named One of Comparably’s 2023 Best Workplaces in New York for the Second Consecutive Year

Larrita Browning

Advancing Customer Service Metrics with AI Classifiers

Lauren Alexander

MaestroQA Named on Comparably’s Best Workplaces in New York

Larrita Browning

CX Strategy: The Future of AI in Quality Assurance

Larrita Browning

Elevating Customer Satisfaction with Visibility & Coaching

Larrita Browning

How Customers Collaborate with Their BPO Partners Today

5 Key Strategies to Supercharge Your BPO Partnership

Larrita Browning

Champion-Challenger Model: Improve Customer Service In BPOs

Larrita Browning

Kick Start Your Customer Service BPO Partnership Successfully

Larrita Browning

BPO Call Centers: Best Practices for Quality Assurance

Larrita Browning

Call Calibration: What is It & What are the Benefits?

Larrita Browning

Increase QA Team Alignment with Call Calibration & GraderQA

Dan Rorke

Measuring An Organization's 3 Ps: People, Process and Product

Larrita Browning

Empathy in Customer Service: Everything You Need to Know

Larrita Browning

Average Handle Time (AHT): How to Calculate & Reduce It

How to Onboard Your Customer Service Team to a New QA Program

21 Key Customer Experience Definitions for QA Professionals

Should You Have Dedicated Quality Assurance Specialists?

How Top eCommerce Brands Ensure Exceptional Customer Service in a Remote World

The Top 4 CX Books Recommended by Our QA Community

A Guide to Customer Service Quality Assurance Programs

5 Key Components of a Remarkable Customer Service Experience

The Ultimate Guide to Improving First Call Resolution (FCR)

How to Refresh Your Call Center Quality Monitoring Scorecard

The Key to Customer Service Coaching Is More Data (and Fewer Opinions)

Call Center Quality Assurance with Zola and Peloton

How to Update Your QA Scorecard

3 Ways to Test Your Call Center Quality Assurance Scorecard

The 9 Customer Service KPIs Needed To Improve CX

What is DSAT and 5 Steps to Improve It

Leveraging Customer Sentiment to Improve CX in Call Centers

Larrita Browning

Customer Experience Management and Quality Assurance Jobs

How Deeper CX Analytics Lead to Better CSAT | MaestroQA

Customer Service Management 101: Everything You Need to Know

Beyond Low CSAT Scores: Finding the Root Cause of Poor CX

How to Create an Omnichannel Call Center Quality Assurance Scorecard

Achieving Effortless Customer Experiences (CX) with QA

This Is What an Effective Customer Service Coaching Session Looks Like

Customer Service Coaching 101: Improve Agent Performance

Auto-Fail in Call Center QA: What It Means and When to Use It

MaestroQA's Aircall Integration: Bring Your Calls to Life