Back to blog
Articles
February 15, 2022
·
3 MIN READ

Intent Disambiguation

February 15, 2022
|
3 MIN READ

Latest content

Tutorials
5 min read

Optimizing RAG with Knowledge Base Maintenance

How to find gaps between knowledge base content and real user questions.
April 23, 2024
Tutorials
4 min read

Scaling Quality Assurance with HumanFirst and Google Cloud

How to use HumanFirst with Vertex AI to test, improve, and trust agent performance.
March 14, 2024
Announcements
2 min read

Full Circle: HumanFirst Welcomes Maeghan Smulders as COO

Personal and professional history might not repeat, but it certainly rhymes. I’m thrilled to join the team at HumanFirst, and reconnect with a team of founders I not only trust, but deeply admire.
February 13, 2024
Tutorials
4 min read

Accelerating Data Analysis with HumanFirst and Google Cloud

How to use HumanFirst with CCAI-generated data to accelerate data analysis.
January 24, 2024
Tutorials
4 min read

Exploring Contact Center Data with HumanFirst and Google Cloud

How to use HumanFirst with CCAI-generated data to streamline topic modeling.
January 11, 2024
Articles
5 min

Building In Alignment: The Role of Observability in LLM-Led Conversational Design

Building In Alignment: The Role of Observability in LLM-Led Conversational Design
December 6, 2023
Articles
5 min read

Rivet Is An Open-Source Visual AI Programming Environment

Rivet is suited for building complex agents with LLM Prompts, and it was Open Sourced recently.
September 27, 2023
Articles
6 min read

What Is The Future Of Prompt Engineering?

The skill of Prompt Engineering has been touted as the ultimate skill of the future. But, will prompt engineering be around in the near future? In this article I attempt to decompose how the future LLM interface might look like…considering it will be conversational.
September 26, 2023
Articles
4 min read

LLM Drift

A recent study coined the term LLM Drift. LLM Drift is definite changes in LLM responses and behaviour, over a relatively short period of time.
September 25, 2023
Tutorials
5 min read

Optimizing RAG with Knowledge Base Maintenance

How to find gaps between knowledge base content and real user questions.
April 23, 2024
Tutorials
4 min read

Scaling Quality Assurance with HumanFirst and Google Cloud

How to use HumanFirst with Vertex AI to test, improve, and trust agent performance.
March 14, 2024
Announcements
2 min read

Full Circle: HumanFirst Welcomes Maeghan Smulders as COO

Personal and professional history might not repeat, but it certainly rhymes. I’m thrilled to join the team at HumanFirst, and reconnect with a team of founders I not only trust, but deeply admire.
February 13, 2024

Let your data drive.

We’re moving away from first-generation chatbots and into the world of complex conversational AI strategies as a means of interacting and delivering on multi-faceted customer requests. This means that the volume of conversations across channels is scaling…quickly.

The need to disambiguate confusing messages is a common phenomenon in human interactions, so it’s no surprise that it’s also commonly present in human-to-robot conversations, especially with scale.

Importance of Disambiguation

Businesses competing on CX are required to tap into the long tail of data if implementing self-service NLU capabilities is in their plan. The ability to easily disambiguate intents into sub-intents is crucial to achieving truly good NLU, because as more intents are added to an ontology, the noisier it can get, the chances of overlapping increase, and the worse the end-user experience will be.

When a chatbot can match a query to an intent (in other words, it understands the users' message), a standard response is triggered based on the conversation's design flow. On the other hand, disambiguation flows are generally used when the bot is able to recognize the customers' message, but it has multiple matching intents. Disambiguation is the process of clarifying the user's intent.

Conversational AI platforms do offer ways to disambiguate. For example, conversation designers using IBM Watson can set up disambiguation dialogues, whereby the chatbot presents the top matching intents to the user, so they can choose the correct one. Other platforms, like LivePerson or Rasa, work in similar ways. However, this tends to be a long and daunting process for designers; it requires manually creating disambiguation dialogues for each node, without the help of data-driven or automated approaches.

IBM Watson

As users pick their true intent from the provided list of options, the NLU will improve and learn to propose better intents initially. But, this improvement process is painful to go through without tools like HumanFirst.

Disambiguation With HumanFirst

As projects evolve, chatbots need to distinguish between similar queries by eliminating any confusion, noise, or overlapping intents, and adding granularity to their ontology. Thus, the importance of a scalable disambiguation workflow.

HumanFirst allows you to run tests on your data to help uncover problems and optimize your NLU data so that you can easily identify which training examples belong to another intent in your corpus.

Once you've selected a problematic intent for re-labeling, you'll be shown a disambiguation tool. In this view, you can move training phrases between both intents to disambiguate them:

As you can see, it's easy to move utterances between intents and create sub-intents when needed.

It’s also data-driven. You're given the option to toggle a minimum confusion bar to use as a threshold. Once you’ve selected an utterance to relabel, you're provided the intent that is confused with the one you’ve selected, with an accompanying match score. The task of disambiguating confused intents is painless, quick, and scientific.

When your model contains 150+ intents with 1000+ training phrases, the manual process of creating disambiguation dialogs is no longer feasible, especially without sucking up valuable resources.To learn more about HumanFirsts’ disambiguation, reach out to our growth team here!

HumanFirst is like Excel, for Natural Language Data. A complete productivity suite to transform natural language into business insights and AI training data.

Subscribe to HumanFirst Blog

Get the latest posts delivered right to your inbox