Skip to main content

Links

The Links tab in the Data Sources page allows you to add URLs from your app or website to generate training data for your AI assistant. These URLs can include documentation, help pages, or any relevant content that will help the assistant better understand your application.

You can skip steps 1 & 2 if you're already on the Data Sources page and on the Links tab.

To add a link, follow these steps:

  1. Go to the Data Sources page by clicking on the Data Sources button on the left side of your screen.

  2. Click on the Links tab.

    Links Tab

  3. Click on the Add Link button. You should see a form to add links.

    Links Tab Form

  4. Fill in the following fields:

    • Link: Enter the URL of the website or documentation you want to process.
    • Search Linked URLs: (Checkbox) Enable this option if you want Navigable to also fetch all the linked URLs on the specified page, allowing you to choose which ones to process. You can also use this option if you are using a sitemap URL.

If you do not enable the Search Linked URLs option, Navigable will directly process the single URL you entered. Here’s how it works:

  • Single Link Processing: Navigable will visit the specific URL you provided and automatically generate Knowledge (a set of Question and Answer pairs) based on the content of the page.
  • This option is best when you want to focus on a single page or specific documentation.

If you enable the Search Linked URLs option, Navigable AI will help you gather multiple links from a single page. Here’s what happens:

  • Crawl Linked URLs: Navigable AI will first visit the provided URL and search for all links found within that page.
  • Review and Select: After crawling, you will be shown a list of all the discovered links. You can select which ones you want to keep and process, and remove the ones you don’t need.
  • Once you’ve made your selections, Navigable will generate Knowledge (Question and Answer pairs) for each selected URL.
note

While crawling is happening, any links added for crawling will be shown above the list of added links with a loading icon next to it.

Links Crawling

If the crawling is complete, the loading icon will no longer be shown and you can review and select from the links that were found.

Links Crawling Completed

Once a link is added, it is processed by Navigable AI. While a link is being processed, it will show a loading icon next to it. During processing, you cannot delete the link.

Link Processing

After the processing is completed, Navigable would have generated Knowledge for the link. Once the Knowledge is generated, the loading icon will no longer be shown.

Link Processing Completed

Once a link is processed, you have the option to delete it. Deleting a link will also remove the Knowledge generated for it. However, if knowledge was edited by a user after a link was generated, that knowledge will not be deleted.

What next?​

You can add files with content related to your app, website, or product. Simply click on the Next button in the bottom right corner of your screen to get started.

If you do not have any files, you can click on the Next Section button in the bottom right corner and skip to the Data Pre-Processing section.