In Genezio, Topic / Scenario Relevance measures how well a scenario shows a real decision context in which answer engines talk about brands. The score is the percentage of conversations in which your brand or one of your competitors shows. Each scenario and each topic has a Relevance score. This score answers an important question: When Genezio runs this scenario, do answer engines really talk about brands in this category? If the answers frequently mention your brand or your competitors, the scenario has a high relevance. If the answers almost never mention brands, the scenario is possibly not well written. Or the scenario does not agree with how users really ask questions.

What Relevance represents

Relevance is the percentage of the conversations in which your brand or one of your competitors shows. Genezio uses this formula:
Example:
  • Conversations that Genezio ran: 50
  • Conversations in which one or more brands show: 40
Relevance:
This means that in 80% of the conversations from that scenario, the answer engine mentioned one or more relevant brands.

Why Topic / Scenario Relevance is important

A scenario simulates a realistic situation in which a user compares products or services. If the answers do not mention any brands, the scenario possibly does not show a realistic discovery question. For example, a scenario that is not clear or not well written can cause the answer engine to give general advice with no product recommendations. In these cases, the scenario has little value for the competitive analysis. Relevance helps you find these cases.

Interpret Relevance scores

High relevance (near 100%)

A relevance score near 100% shows that the scenario always causes the answer engine to talk about brands. This usually means that the scenario is well written. It shows correctly how users ask answer engines for recommendations. These scenarios are the best scenarios to measure Brand Visibility and the competitive position.

Moderate relevance

A relevance score in the middle range shows that brands show in some answers, but not in all answers. This can show that:
  • The scenario is not sufficiently clear.
  • The question is too general.
  • The answer engine sometimes replies with no product recommendations.

Low relevance

A low relevance score shows that answer engines almost never mention brands in the answers. This usually means that you must make the scenario better. Possible problems are:
  • The scenario is too abstract.
  • The question does not show that the user looks for a product.
  • The goal of the user is not clear.
When you make the scenario better, it can become much more useful for the analysis.

Relevance of a scenario and relevance of a topic

Genezio calculates Relevance at two levels.

Scenario Relevance

Each scenario has its own relevance score. Genezio calculates it from the conversations of that scenario.

Topic Relevance

The relevance of a topic is the average relevance of its scenarios. This helps users know if the topic gives useful conversations in which answer engines talk about brands.

Relevance and the quality of scenarios

Relevance is also a useful indicator of the quality of a scenario. A well-designed scenario must:
  • Clearly describe a situation of the user
  • Have a realistic goal
  • Cause the answer engine to recommend products
When a scenario has these conditions, answer engines usually reply with brand suggestions. Thus, the relevance score is higher.

Make Relevance better

If a scenario has a low relevance, you can frequently make it better. Make the goal of the user more clear. Do not use a scenario that is not clear, such as:
A stronger scenario describes a specific situation, such as:
This type of situation more frequently causes brand recommendations. For more guidance, refer to Scenarios.

Why Relevance keeps the analysis correct

With Relevance, the conversations that measure AI visibility show realistic decision situations. Without a relevance filter, the analysis can include conversations in which no brands show. Thus, the visibility metrics become less useful. When teams monitor Relevance, they can continuously make the scenarios better. Thus, the quality of the AI visibility analysis increases.

Next steps

To know how the brand mentions in relevant conversations count for the visibility metrics, refer to: