def _process_links(self, links):
        links = unique_list(links, key=lambda link: link.url) if self.unique else links
        return links
Normalize and filter extracted links
dataset/ETHPy150Open wcong/ants/ants/contrib/linkextractors/sgml.py/BaseSgmlLinkExtractor._process_links