Back to blog
Articles
Articles
December 25, 2020
·
2 MIN READ

The crux of NLU is managing the long-tail of data.

December 25, 2020
|
2 MIN READ

Latest content

Tutorials
5 min read

Optimizing RAG with Knowledge Base Maintenance

How to find gaps between knowledge base content and real user questions.
April 23, 2024
Tutorials
4 min read

Scaling Quality Assurance with HumanFirst and Google Cloud

How to use HumanFirst with Vertex AI to test, improve, and trust agent performance.
March 14, 2024
Announcements
2 min read

Full Circle: HumanFirst Welcomes Maeghan Smulders as COO

Personal and professional history might not repeat, but it certainly rhymes. I’m thrilled to join the team at HumanFirst, and reconnect with a team of founders I not only trust, but deeply admire.
February 13, 2024
Tutorials
4 min read

Accelerating Data Analysis with HumanFirst and Google Cloud

How to use HumanFirst with CCAI-generated data to accelerate data analysis.
January 24, 2024
Tutorials
4 min read

Exploring Contact Center Data with HumanFirst and Google Cloud

How to use HumanFirst with CCAI-generated data to streamline topic modeling.
January 11, 2024
Articles
5 min

Building In Alignment: The Role of Observability in LLM-Led Conversational Design

Building In Alignment: The Role of Observability in LLM-Led Conversational Design
December 6, 2023
Articles
5 min read

Rivet Is An Open-Source Visual AI Programming Environment

Rivet is suited for building complex agents with LLM Prompts, and it was Open Sourced recently.
September 27, 2023
Articles
6 min read

What Is The Future Of Prompt Engineering?

The skill of Prompt Engineering has been touted as the ultimate skill of the future. But, will prompt engineering be around in the near future? In this article I attempt to decompose how the future LLM interface might look like…considering it will be conversational.
September 26, 2023
Articles
4 min read

LLM Drift

A recent study coined the term LLM Drift. LLM Drift is definite changes in LLM responses and behaviour, over a relatively short period of time.
September 25, 2023
Tutorials
5 min read

Optimizing RAG with Knowledge Base Maintenance

How to find gaps between knowledge base content and real user questions.
April 23, 2024
Tutorials
4 min read

Scaling Quality Assurance with HumanFirst and Google Cloud

How to use HumanFirst with Vertex AI to test, improve, and trust agent performance.
March 14, 2024
Announcements
2 min read

Full Circle: HumanFirst Welcomes Maeghan Smulders as COO

Personal and professional history might not repeat, but it certainly rhymes. I’m thrilled to join the team at HumanFirst, and reconnect with a team of founders I not only trust, but deeply admire.
February 13, 2024

Let your data drive.

Articles

The crux of NLU is managing the long-tail of data.

GREGORY WHITESIDE
December 25, 2020
.
2 MIN READ

> Until now, building and maintaining the training data needed to support a long-tail of intents has been a difficult problem — yet this is what is needed to go from a Gregory Whiteside.

Until now, building and maintaining the training data needed to support a long-tail of intents has been a difficult problem — yet this is what is needed to go from a “dumb” conversational AI to an experience that improves over time and leaves your users amazed. Training and deploying an NLU model is no longer the bottleneck; successfully scaling and managing the underlying training data has become the crux of the problem.

HumanFirst provides a data pipeline & workflow to label and manage training data at scale, with APIs to easily deploy NLU-powered features and analytics within your products, and integrations with 3rd party vendors to use this data at any time within your existing projects (including Rasa, DialogFlow, Watson, Luis, BotPress and others).

HumanFirst is future-proof and accelerates development in a few key areas — let’s explore them!

A scalable pipeline for unlabeled and NLU training data

HumanFirst’s data pipeline ingests unlabeled data (conversation logs, utterances, emails) and / or NLU training data (i.e: existing NLU/chatbot projects) and prepares it for processing; HumanFirst’s UX provides a powerful bottom-up workflow to label and organize this data, with machine-learning and active-learning assistance throughout.

Workflow with intents and training data as first class citizens

Much like code, data has the tendency to become “spaghetti” as projects evolve, and refactoring is necessary to be able to maintain quality (and sanity).

HumanFirst provides as much control over intents and training data you’d get from working with raw files (YAML, JSON, Excel etc), but with machine-learning powered workflows that make refactoring and maintaining this data 10x more efficient.

HumanFirst’s workflow supports

  • Organizing NLU training data in cascading hierarchies
  • Drag & Drop refactoring of intent structure as long-tail grows
  • Splitting intents (and automatically moving training data) into more specific sub-intents
  • Merging ambiguous intents and their training phrases together

Combined together, this unprecedented level of control allows teams to easily:

  • Improve the breadth and coverage of their NLU
  • Improve quality and reduce ambiguity in training data
The ability to organize labeled data in flexible hierarchies that can easily evolve over time also provides an elegant path to creating and managing catalogs of intents, across domains and verticals, that can be re-used across projects. Modularize and re-use! Just like code.

Multi-tenant ready

HumanFirst was built with multi-tenant scenarios in mind, to facilitate the re-usability of data across multiple projects.

Its data pipeline provides powerful abstractions to manage, share and control access to data across multiple workspaces and namespaces:

  • Workspaces are where data for any given project is managed. You can create any number of workspaces, and assign different access controls across them to your team. Workspaces can be cloned and conversational data can be shared across them.
  • Namespaces allow an organization to manage different teams and segregate access to data (a bit like Github Teams)
Note: Namespaces are particularly useful for teams building and managing projects for multiple clients (i.e. agencies, consultants, etc.)

Now what?

Getting started with HumanFirst is quick, easy and free. Simply signup at www.humanfirst.ai to create your account and invite your team.

Subscribe to HumanFirst Blog

Get the latest posts delivered right to your inbox