Interface SitemapLoaderParams

Interface representing the parameters for initializing a SitemapLoader. SitemapLoaderParams

Hierarchy

Implemented by

Properties

chunkSize? filterUrls? selector? textDecoder? timeout?

Properties

Optional chunkSize

chunkSize?: number

The size to chunk the sitemap URLs into for scraping.

Default

{300}

Optional filterUrls

filterUrls?: string[]

Optional selector

selector?: SelectorType

The selector to use to extract the text from the document. Defaults to "body".

Optional textDecoder

textDecoder?: TextDecoder

The text decoder to use to decode the response. Defaults to UTF-8.

Optional timeout

timeout?: number

The timeout in milliseconds for the fetch request. Defaults to 10s.

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc