Knowledge

Ingest, scope, search, and read product documentation

Build one reviewable workspace corpus

Dubot can ingest product guidance from a public Help Center or supported document uploads, then make a defined scope available to wizards, Guidance, and the Resource Center.

Crawl a Help Center

Add a public source and collect the pages available under its configured path.

Upload documents

Add PDF, DOCX, Markdown, and text files.

Scope retrieval

Let an experience use all knowledge, selected articles, or none.

Monitor a crawl while discovered pages are added to the workspace knowledge corpus.

This demonstrates the live heartbeat, moving discovery and crawl counts, failures, and the existing corpus remaining available during a re-crawl.

Current product behavior

• Inspect sources and extracted articles for the workspace.
• Re-crawl an individual web source or sync all crawl sources.
• Enable weekly synchronization for crawl sources.
• Review article count, corpus size, sync state, and content no longer linked from its source.
• Remove a source and its extracted content.
• Search the configured scope during a wizard, Guidance, or Resource Center request.
• Read a matching article in bounded windows rather than loading the entire corpus into every request.

Accepted crawls and uploads automatically update the corpus used by existing experiences. There is no article-level Publish action. The experience’s saved or published configuration controls its retrieval scope. See when article changes become available.

Retrieval flow

public Help Center or uploaded documents
  -> deterministic extraction
    -> workspace corpus
      -> experience-specific scope
        -> search matching articles
          -> read the relevant article content

The current runtime exposes server-side knowledge search and article reading to eligible assistants. It does not imply unrestricted access to every article, authenticated Help Center crawling, or a particular future retrieval architecture.

Current boundaries

Area	Current behavior
Web access	Publicly accessible Help Center pages
Crawl rules	Source robots directives are honored
Uploads	PDF, DOCX, Markdown, and TXT
Freshness	Manual sync or optional weekly sync for web sources
Private sources	Authenticated crawling is not part of the current contract
Scope	All content, selected articles, or none
Resource Center search	Searches the delivered corpus and returns article cards; raw search text is not retained as analytics content

Ingestion and access are separate decisions. Review source ownership, exclusions, sensitivity, freshness, and experience-level scope before publishing knowledge-backed behavior.

Follow Add knowledge to your workspace for the current crawl, upload, review, and scoping workflow. Before deleting a source, follow the knowledge-removal checks.