add filters

[legrostdg]

It would be great to be able to use some kind of "filter". A filter would be configurable for each feed, and it would turn a specific webpage to a rss/atom feed, which would then be processed by imm internals.

I may help if the feeds were specified in the configuration file (and not the db), to be able to add haskell filters.

[k0ral]

I guess it's not too much effort to add an intermediate conduit between the input HTML and the RSS/Atom parser, as a placeholder for your filter. I'll have a look and come back to you.

[legrostdg]

Great!

I don't get how you could apply a specific filter to a specific feed, if you have the feeds specified in the db. Do you have an idea in mind?

[k0ral]

The behavior can be customized through the DSL/interpreter pattern (cf this module for more information). I can see at least 2 solutions:

• the intermediate conduit can be put in the HTTP interpreter, such that the feed URI can be used to choose a filter: filter :: URI -> Conduit Event m Event
• the intermediate conduit can be a new standalone interpreter, with access to the DatabaseEntry to choose a filter (which includes URI and even a category name): filter :: DatabaseEntry -> Conduit Event m Event

[legrostdg]

OK, I did not think about these two possibilities. Maybe the first one would be easier? It would be great to have some kind of helpers.

[k0ral]

Actually, after second though, I'm creating a new XML parser interpreter, where your filter will fit nicely.

[k0ral]

Implemented in dcc7021. Could you please check out master branch and validate that it meets your requirements, before I make an official release out of it ?

[legrostdg]

Could you update the example in Imm.Boot to use coXmlParser? It would help there was some logic to select some different filters based on the uri.

[legrostdg]

It seems great! Thanks a lot, I guess I'll obsolete perfeed and use imm soon :-).

[k0ral]

Updated example in Imm.Boot.

[k0ral]

Integrated in release 1.2.0.0 .