What data is processed by the voice assistant?

September 13, 2024

Voice assistants are becoming increasingly popular and have already found their way into our everyday lives, especially in the consumer sector. Nevertheless, there are often some questions, both for users and professionals, before either considering the use of a voice assistant or offering it to your own customers. In this blog post, I would like to introduce the topic of data in the context of voice assistants.

Let's start by introducing general categories of data used or generated by voice assistants. I will apply these to our SABOT, which is designed as a voice assistant for machines. In the context of operator-machine interaction, SABOT processes the following types of data:

1. Operator-related data

Operator speech is one of the most obvious types of data. The voice interface processes the operator's speech via the audio input, e.g. via the headset microphone or the audio input at the machine itself.

2. Machine-related data

Machine data can include a wide range of information, from machine manuals to data from IoT systems. We can divide it into three basic groups:

Static data: This is data such as machine manuals or guidelines and FAQs that relate to the operation or setting of the machine. This type of data is known in advance and serves as a source of information for the voice assistant.

Dynamic data: This is data that changes while the user interface is being used. Updating the machine status is an example of such data, e.g. the temperature of an oven that changes over time.

External data: This includes data such as machine settings that are managed in an administration portal. Operators can receive information about the latest firmware availability and be asked to apply it.

3. Business data

There may also be other data that influences the conversation between operators and machines, such as data from planning tools. For example, operators could ask for the daily schedule for the machine and change it according to the current circumstances.

4. External data

Examples of external data are weather forecasts or event calendars that can influence the number of customers visiting the store. The voice assistant makes requests to public services to obtain such information.

5. Data generated by the voice assistant

Voice assistant provides responses based on input from operator or according to updates from machine or any related external system. These responses must be curated to ensure that they consist of correct information and guarantee privacy and legal obligations.

In addition to the described data, we also need to consider other aspects of data processing, such as issues of data protection, data persistence or the lifespan of data. I will deal with these topics in the following posts.

‍

Facebook

view profile

Jaroslav is a core team member, dedicated to his work and trusting his common sense. He is not only a skilled .NET developer, project manager, and solution architect. He is also helpful in business and team development and he nurtures his team members in Olomouc. He keeps himself in shape by practicing Aikido, riding MTB. He loves Red Thai Curry, of course besides his wife and two daughters.