KB User's Guide - Semantic Search FAQ

This document answers some common questions about the new "semantic" search engine for the KB and how it compares to the original native search.

How does the new hybrid semantic search work, and how does it differ from the original search engine?

For an overview of how the two search engines compare, please see KB User's Guide - Understanding the New Semantic Search Engine.

What makes the new search engine a hybrid search?

When semantic search is enabled, the first set of results are a combination of semantic results and keyword results. By default, this first set will include up to 20 results, though this limit can be adjusted site-by-site.

When the results of the two engines are combined, any duplicates are removed. From there, the combined set of results are sorted for relevance using the following criteria (in order):

  1. Search priority ("top" priority docs are returned first, followed by "high", "normal", and "low" priority)
  2. Device matching (if the client OS / browser sort option is enabled, results matching the users device are prioritized)
  3. Keyword similarity (results in the combined set whose keywords match the search terms are prioritized)

Any additional docs matching the site's default search mode that were not included in the initial set of results, e.g. those that have exact matches in the title and keywords fields, will then be appended.

Are there certain types of searches where semantic search won't perform as well?

Generally, semantic search will outperform the native keyword/title search. The main limitations are with searches that include descriptive language related to services, tools, or other names that aren't part of standard English. 

For example, a search for "online discussion" won't necessarily promote results related to Canvas course software. This is because the Large Language Model (LLM) that drives the semantic search engine does know the word "canvas", but it does not know that the word "Canvas" relates to online courses in our specific context. 

However, the scope of this issue is fairly limited, since the semantic search engine will correctly match these terms when they are included in document keywords and titles. So, searching for "Canvas online discussion" will yield results where the word "Canvas" appears in the title and/or keywords. Similarly, documents about Canvas that contain the words "online" and "discussion" (or terms related to these words) will still appear in search results.

Similarly, searches that include acronyms will rely on said acronym being present in the document title and/or keywords. Likewise, it is important to spell out acronyms in your documents at least once. For example, if your document discusses the "Cloud Computing Infrastructure" service, you should be sure to include this full service name somewhere in the document, and not only refer to it by the acronym "CCI". This ensures that a user who just searches for "cloud hosting" will still easily find your document. This is considered best practice when using acronyms in general.

To help improve the semantic search engine's handling of these types of queries, we have introduced a "unique terms" table. We will use this to supply descriptive language and written-out acronyms to aid in the translation of these terms. This will further reduce the likelihood that a relevant result will be excluded from search results.

How do I enable semantic search for my site?

You can enable the semantic search engine for your internal and/or external site by following the steps outlined in KB User's Guide - Enabling Semantic Search for Your KB Site(s).

Can I disable semantic search for my site once it has been enabled?

Yes, if you decide that you want to switch back to the traditional keyword+title search, you can disable it at any time using the above instructions.

How can I tell if semantic search is enabled for a site I am searching?

To avoid confusion for end users, we do not have any explicit indicators that semantic search is enabled. However, you can generally tell by observing one or both of the following:

  • A larger number of search results, with some results lacking exact search terms in the title and keywords
  • A slightly different search success/failure message (does not apply if you have customized this message)
    • Standard message: "Not finding what you are looking for? Suggest a new document be created, or try adjusting your search criteria."
    • Semantic search message: "Not finding what you are looking for? Suggest a new document be created, or try searching again with multiple search terms."

Can a user switch back to the basic search if semantic search is enabled on a site?

At this time, end users cannot disable semantic search while searching.

Will changing the search mode dropdown have an effect on my results?

Currently, interacting with the "search mode" dropdown will only affect the second set of results, i.e. those that load after the initial set of semantic search results. 

How can I report a possible issue with the semantic search engine?

If you are getting unexpected search results from the semantic search engine, or if you believe it is otherwise not functioning as expected, please contact us at kb-team@doit.wisc.edu. 

Do I need to change my existing documents to make them work with semantic search?

You do not need to, but there are some good things to keep in mind when authoring or updating docs:

  • Follow formatting and structure best practices, such as using headings and lists to organize your content
  • Use plain language in your documentation; avoid jargon and overly technical terms whenever possible
  • Make sure you write out acronyms at least once
  • Avoid overly long documents; split up long content into multiple documents where possible

See Also


Keywords:
nlp natural language processing searches differences between native hybrid new engine results filters 
Doc ID:
142333
Owned by:
Leah S. in KB User's Guide
Created:
2024-09-11
Updated:
2025-08-27
Sites:
KB User's Guide