Duplicate article detection for BBC

[OmegaDL2]

Capy Reader occasionally pulls the same article multiple times or re-fetches older articles that have already been processed
I propose adding an optional toggle in the settings to automatically detect and remove duplicate posts.
I suggest the logic of this detection mechanism should check for identical titles and matching publication dates

As seen in the attached screenshot, the feed shows two sets of two identical entries with the same title, timestamp.
(feed shown in screenshot: feeds.bbci.co.uk/news/world/europe/rss.xml)

[jocmp]

Hey @OmegaDL2, thanks for sponsoring! A developer on NetNewsWire just today broke down the BBC problem in great detail. Worth a read to understand the problem if you're interested.

I've been thinking about this off and on, and I'm still trying to find a solution that doesn't require checking if every feed is from the BBC.

[OmegaDL2]

Hi @jocmp , that's a very interesting and insightful article, I didn't find it while searching for this problem.
I understand not wanting to check if an article is from the BBC because it would be a waste of resources. And the people that should fix this is the BBC, sadly I don't expect that to happen.

Since as far as I know the only feed that this happens is from the BBC it's not that big of a problem (or at least this is my opinion) and for now this issue can be somewhat ignored.

If you whish to close this as wont fix or something similar I'll be okay with it. I can ignore the duplicate articles.

Thank you very much for your help and making such a simple and useful rss feeder.

Kind regards.