fix(readnovelfull): fix chapter pagination and bypass cloudflare for FWN & LibRead

[Mohking1]

Closes #2288
Closes #2281
Closes #2279

FreeWebNovel and LibRead recently updated their site structures to use AJAX pagination for chapters, which caused the plugin to only load the first 40 or so chapters. This PR implements multi-page fetching to get the full list again.

While fixing the pagination, Cloudflare started blocking the multiple requests needed to get the full list. I bypassed this by spoofing the Referer and X-Requested-With headers so the requests pass through cleanly.

Also noticed a small bug in popularNovels where encountering a null/empty filter caused the list fetching to break, so I went ahead and fixed that too.

Checklist

• Update version code if an existing plugin was modified
• Test changes in Plugin Playground or the app
• Reference related issues in the PR body (e.g. Closes #xyz)

[Copilot]

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

[MonomoySama]

Closes #2288 Closes #2281 Closes #2279

FreeWebNovel and LibRead recently updated their site structures to use AJAX pagination for chapters, which caused the plugin to only load the first 40 or so chapters. This PR implements multi-page fetching to get the full list again.

While fixing the pagination, Cloudflare started blocking the multiple requests needed to get the full list. I bypassed this by spoofing the Referer and X-Requested-With headers so the requests pass through cleanly.

Also noticed a small bug in popularNovels where encountering a null/empty filter caused the list fetching to break, so I went ahead and fixed that too.

Checklist

• Update version code if an existing plugin was modified
• Test changes in Plugin Playground or the app
• Reference related issues in the PR body (e.g. Closes #xyz)

FWN got a problem of Chapter name duplication after merging this. Please check code again

[K1ngfish3r]

fuck me man, none of this multpage is required

[Mohking1]

@K1ngfish3r Did I overdo something, i added flag cause 2 sources were using this but this was in multi-source . Also I changed and fixed duplicate code, i was testing some things and accidentaly left second method of title fetch. Should I add the PR or are you taking over ?

[K1ngfish3r]

making my own PR, dont mind me

[K1ngfish3r]

for reference, theres a way to get all chapters without resorting to pagination, unless you guys already ruled that out somehow... i havent checked the discord honestly

[Mohking1]

Well none on discord have tried anything, but from what I tried there was no way to get this without pagination but I am no expert but by any chance you don't find any better fix I have given out PR for duplicate chater and I am sorry for bad pr if that was the case and good luck

[K1ngfish3r]

no worries, its my bad anyways