[GenericLinkExtractor] RSS - Links with CDATA are not extracted

[sylvainroussy]

Hi,

I would to parse a RSS stream (https://medlineplus.gov/feeds/news_en.xml) but the Url values of link tags are enclosed in CDATA and it seems they're ignored by the GenericLinkExtractor.

Is there a way to catch them ?

Thanks.
Sylvain

Edit: somme corrections

[essiembre]

Right now, this would be possible by writing your own ILinkExtractor.

The default link extractor is GenericLinkExtractor and is geared towards HTML pages. There is a feature request (#236) to add the ability to use regex to extract links using custom patterns but that's not there yet.

To keep the generic link extractor and add yours for RSS feeds via XML config, you can do it like this:

    <linkExtractors>
        <extractor class="com.norconex.collector.http.url.impl.GenericLinkExtractor"/>
        <extractor class="your.custom.Extractor"/>
    </linkExtractors>

[sylvainroussy]

Ok, thank you.

[essiembre]

FYI, the latest snapshot release has a new XMLFeedLinkExtractor you can use.