may not immediately gain access to this data, this data could leak
        into downstream systems (e.g., data loader is used to load data for indexing).
        This loader is a crawler and web crawlers should generally NOT be deployed
        with network access to any internal servers.
        Control access to who can submit crawling requests and what network access
        the crawler has.
        By default, the loader will only load URLs from the same domain as the sitemap
        if the site map is not a local file. This can be disabled by setting
        restrict_to_same_domain to False (not recommended).
        If the site map is a local file, no such risk mitigation is applied by default.
        Use the filter URLs argument to limit which URLs can be loaded.
        See https://python.langchain.com/docs/security
    """
[docs]    def __init__(
        self,
        web_path: str,
        filter_urls: Optional[List[str]] = None,
        parsing_function: Optional[Callable] = None,
        blocksize: Optional[int] = None,
        blocknum: int = 0,
        meta_function: Optional[Callable] = None,
        is_local: bool = False,
        continue_on_failure: bool = False,
        restrict_to_same_domain: bool = True,
        **kwargs: Any,
    ):
        """Initialize with webpage path and optional filter URLs.
        Args:
            web_path: url of the sitemap. can also be a local path
            filter_urls: a list of regexes. If specified, only
                URLS that match one of the filter URLs will be loaded.
                *WARNING* The filter URLs are interpreted as regular expressions.
                Remember to escape special characters if you do not want them to be