Back to blog
Articles
Tutorials
November 13, 2020
·
3 MIN READ

Labeling Data at Scale with HumanFirst

November 13, 2020
|
3 MIN READ

Latest content

Tutorials
5 min read

Optimizing RAG with Knowledge Base Maintenance

How to find gaps between knowledge base content and real user questions.
April 23, 2024
Tutorials
4 min read

Scaling Quality Assurance with HumanFirst and Google Cloud

How to use HumanFirst with Vertex AI to test, improve, and trust agent performance.
March 14, 2024
Announcements
2 min read

Full Circle: HumanFirst Welcomes Maeghan Smulders as COO

Personal and professional history might not repeat, but it certainly rhymes. I’m thrilled to join the team at HumanFirst, and reconnect with a team of founders I not only trust, but deeply admire.
February 13, 2024
Tutorials
4 min read

Accelerating Data Analysis with HumanFirst and Google Cloud

How to use HumanFirst with CCAI-generated data to accelerate data analysis.
January 24, 2024
Tutorials
4 min read

Exploring Contact Center Data with HumanFirst and Google Cloud

How to use HumanFirst with CCAI-generated data to streamline topic modeling.
January 11, 2024
Articles
5 min

Building In Alignment: The Role of Observability in LLM-Led Conversational Design

Building In Alignment: The Role of Observability in LLM-Led Conversational Design
December 6, 2023
Articles
5 min read

Rivet Is An Open-Source Visual AI Programming Environment

Rivet is suited for building complex agents with LLM Prompts, and it was Open Sourced recently.
September 27, 2023
Articles
6 min read

What Is The Future Of Prompt Engineering?

The skill of Prompt Engineering has been touted as the ultimate skill of the future. But, will prompt engineering be around in the near future? In this article I attempt to decompose how the future LLM interface might look like…considering it will be conversational.
September 26, 2023
Articles
4 min read

LLM Drift

A recent study coined the term LLM Drift. LLM Drift is definite changes in LLM responses and behaviour, over a relatively short period of time.
September 25, 2023
Tutorials
5 min read

Optimizing RAG with Knowledge Base Maintenance

How to find gaps between knowledge base content and real user questions.
April 23, 2024
Tutorials
4 min read

Scaling Quality Assurance with HumanFirst and Google Cloud

How to use HumanFirst with Vertex AI to test, improve, and trust agent performance.
March 14, 2024
Announcements
2 min read

Full Circle: HumanFirst Welcomes Maeghan Smulders as COO

Personal and professional history might not repeat, but it certainly rhymes. I’m thrilled to join the team at HumanFirst, and reconnect with a team of founders I not only trust, but deeply admire.
February 13, 2024

Let your data drive.

Tutorials

Labeling Data at Scale with HumanFirst

ALEX DUBOIS
November 13, 2020
.
3 MIN READ

Learn how to make use of HumanFirst to accelerate the labeling process of conversational data.

HumanFirst makes the labeling of data (from both utterances and conversation logs) easy and efficient — let’s explore this workflow!

Full Text Search

You can use full text search to start your exploration and labeling if you are looking for a specific type of data to label (our pipeline automatically annotates all uploaded data to make full-text search instantaneous).

Filter by date

You can restrict search to unlabeled data from a specific time period (for example, if you want to focus on the last conversations your users had with your bot).

Similarity Search

You can click on “Show similar suggestions” at any time in order to find utterances semantically similar to the ones already selected. This allows you to accelerate the labeling process by efficiently grouping and labeling similar data in one shot:

Add training examples to an existing intent’s labeled data

After selecting utterances, you can immediately add them to an existing intent’s labeled data by clicking on “Label selected data”, hovering over the desired intent and clicking “Move here”.
You’ll be able to view the destination intent’s existing training data to make sure you’re labeling it in the right intent before confirming.

Real-time intent recommendation

When dealing with many different intents, it can become difficult to find the intent you wish to move utterances to — HumanFirst makes finding the right intent possible in just a few clicks.

Simply click on the flat list button in the upper right of the intent panel and intents will be ranked in a flat list based on their similarity to the selected utterances. All that’s left to do is click “Move here” and confirm the move as you would normally do when adding utterances to an existing intent.

Creating a New Intent

HumanFirst makes it easy to create new intents/labels on the fly, thanks to our flexible hierarchy — including creating sub-intents under existing intents.

Simply navigate to where you want to create a new intent, and click “Create here”. After selecting a name, the new intent will be created, with the selected utterances added to its labeled training data. You can later re-organize the hierarchy and re-organize your intents if you want to improve the structure of your data.

HumanFirst aids the labeling process in a variety of ways. From accelerating the discovery of similar utterances to simplifying the intent creation and management process, labeling data has never been easier — check out this use-case that shows how LimeChat went from 19s+ to 2s per utterance labeled (8.5x improvement in efficiency!)

Subscribe to HumanFirst Blog

Get the latest posts delivered right to your inbox