Commit Graph
59 Commits
Author SHA1 Message Date
nextcloud486153andBenjamin Brahmer 032d48ad7b Fix malformed feeds (without GUIDs) stopping the update process (fixes #1738)
Signed-off-by: nextcloud486153 <78801830+nextcloud486153@users.noreply.github.com>
2022-04-18 13:16:01 +02:00
Benjamin Brahmer a5eaf9ec42 Use rawurlencode as it encodes spaces correctly as %20
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2022-02-27 20:04:14 +01:00
Michael HamannandBenjamin Brahmer f071c05a48 Fix catching connect exceptions while fetching feed logos #1570
Display the message instead of the response when catching an exception
during feed logo fetching. As there is no response and thus no method
`getResponse()` in `ConnectException`, this fixes a "call to undefined
method"-error that prevented feeds from fetching if fetching the logo
resulted in a `ConnectException`.

Signed-off-by: Michael Hamann <michael@content-space.de>
2021-11-30 23:39:39 +01:00
Benjamin Brahmer 9f3b63b5f9 Catch network errors while fetching feed logos, fixes #1570
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-11-14 20:16:16 +01:00
Benjamin BrahmerandSean Molenaar 137af71bb3 Smarter error logging
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>

Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-10-18 17:57:18 +02:00
Benjamin BrahmerandSean Molenaar 74586396f8 make use of constant
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>

Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-10-18 17:57:18 +02:00
Benjamin Brahmer 59a888481f make use of base_url to handle relative urls
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-10-18 17:57:18 +02:00
Benjamin Brahmer 7d61a1cb09 Download feed logos via guzzle to have better error handling
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-10-18 17:57:18 +02:00
Benjamin Brahmer 56ebffbf76 [Backport] Prevent some of the favicon fetching errors
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-05-03 10:19:23 +02:00
anoyandSean Molenaar 91db7113a8 replace deprecated getDescription call
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2021-04-24 14:21:57 +02:00
Chris DanserandGitHub 6e845124df Null check category label before trying to decode (#1282)
* Null check category label before trying to decode

Signed-off-by: skiingwiz <skiingwiz@gmail.com>
2021-04-08 08:10:41 +02:00
Sean MolenaarandSean Molenaar 2baa7a2b91 Make PHPstan stricter
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-03-25 18:47:38 +01:00
Marco NassabainandSean Molenaar 7e0aab358c 🎨 Item: store categories as json & add helper fns
+ added setter/getters that work with arrays to simplify use case

Signed-off-by: Marco Nassabain <marco.nassabain@hotmail.com>
2021-03-17 08:58:42 +01:00
Jimmy HuynhandSean Molenaar 3dfbf64a6b ♻️ Renaming 'tags' into 'categories'
Signed-off-by: Jimmy Huynh <jimmy.huynh@etu.unistra.fr>
2021-03-17 08:58:42 +01:00
Jimmy HuynhandSean Molenaar fd13be0f7a Update FeedFetcher: import 'tags' to 'item'
Signed-off-by: Jimmy Huynh <jimmy.huynh@etu.unistra.fr>
2021-03-17 08:58:42 +01:00
Benjamin Brahmer 6cd83ea1da remove unused lastModified from feed fetcher
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-02-16 11:01:10 +01:00
Benjamin BrahmerandSean Molenaar c09b4d8d33 prefer the feeds logo over the favicon
The logo of the feed is prefered if it is a square picture,
else the favicon is returned.

Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-02-16 10:16:15 +01:00
Sean MolenaarandSean Molenaar b4fa772bc5 Remove V1 item API
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-02-13 13:22:57 +01:00
Sean MolenaarandSean Molenaar 8fa1537cbf Fetcher: Update client and add test
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-01-20 22:52:09 +01:00
Sean MolenaarandSean Molenaar 67b6c4e1b0 Fix psalm issues
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-01-12 13:29:08 +01:00
Sean MolenaarandSean Molenaar 05377d023e Remove PHPunit integration tests
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-12-30 11:21:44 +01:00
Kevin DecherfandBenjamin Brahmer 42ea24f2f4 Remove LastModified-based cursor when updating feeds
We remove the call to readSince() as some feeds push new articles with
pubDate prior to the lastModified time stored for these feeds (e.g.
lemonde.fr). As we go through all items of a feed again and again, we
prevent the constant update of an item's lastModified timestamp by
keeping the previous one if its fingerprint does not change.

Fixes #921

Signed-off-by: Kevin Decherf <kevin@kdecherf.com>
2020-12-15 20:02:21 +01:00
anoyandBenjamin Brahmer cb32a2c4ed remove deprecated YouTube playlist API
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2020-11-07 09:57:20 +01:00
Sean MolenaarandSean Molenaar 48a130d3c0 Allow titles to be null
Issue GH-867

Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-10-12 21:40:23 +02:00
Sean MolenaarandBenjamin Brahmer e528361141 Add feed autodiscovery
Issue GH-415

Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29 21:15:53 +02:00
Sean MolenaarandBenjamin Brahmer 35b53ecd40 OPML export command and fixes
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29 14:56:07 +02:00
Sean MolenaarandBenjamin Brahmer bc01761221 Fix repair step and test it
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29 13:02:03 +02:00
Sean MolenaarandBenjamin Brahmer d00d1ab2a2 Create V2 mapper, Service and management commands
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-27 15:35:31 +02:00
Sean MolenaarandBenjamin Brahmer 60ab4941cc Move to nextcloud config and update phpunit
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-25 19:18:04 +02:00
Gioele FalcettiandBenjamin Brahmer bf0e693e23 Fix crash if full-text is enabled and the news item does not provide an URL to be fetched
Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2020-08-31 00:59:43 +02:00
81d2407e6c fix 'If-Modified-Since' causing BAD REQUEST (#684)
fix 'If-Modified-Since' causing BAD REQUEST

Signed-off-by: Chris Noxz <chris@noxz.tech>
Co-authored-by: kesselb <mail@danielkesselberg.de>
2020-04-28 18:25:34 +02:00
Éloi RivardandGitHub 306d3cdc60 Basic Media-RSS support (#599)
Signed-off-by: Éloi Rivard <azmeuk@gmail.com>
2020-02-16 14:26:06 +01:00
kesselbandBenjamin Brahmer f045bd0ba3 Update httpLastModified from the feed response (#594)
LastModified is used (in a feed context to see if a user edited a feed). httpLastModified to store the last-modified response from the source.

Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>
2019-12-27 03:51:06 +01:00
DriverXXandBenjamin Brahmer 6673cbc3d9 Reimplement full-text scraping (#563)
Add readability.php scraper
Fixes #482
Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2019-12-24 09:33:19 +01:00
b_bandBenjamin Brahmer 35c6c91e26 Get content:encoded of item if available (#565)
Get content:encoded of item if available fixes #564

Signed-off-by: brunob <bruno@eliaz.fr>
2019-11-16 14:21:40 +01:00
Benjamin BrahmerandGitHub ae99d52aad Update to feedio 4+ (#494)
- bumped dependencies to last supported version
travis:
- removed php 7.0
- move main target to nc 16
- drop support for nc 14 & 15

Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2019-08-16 07:57:34 +02:00
Sean MolenaarandSean Molenaar b37e237c7a Fix xkcd commics 2019-03-26 09:31:03 +01:00
Sean MolenaarandBenjamin Brahmer 62bd42cb17 Stop assuming encoding of xml, let simplexml throw silently (#457) 2019-03-22 09:19:05 +01:00
Sean MolenaarandBenjamin Brahmer c69bcb8e68 Allow empty-ish lastmodified and clean up FeedFetcher Test (#458) 2019-03-21 05:16:35 +01:00
Jasper KnockaertandSean Molenaar 84af098d01 reset modified since filter when updating feeds
When updating feeds the modified since date is added as a filter. This needs to be reset when looping over the feeds. Fixes #444.
2019-03-20 07:51:45 +01:00
Sean MolenaarandSean Molenaar 9b915e24af Use a copy of the FeedIO client that doesn't specify a useragent 2019-03-18 10:39:32 +01:00
Sean MolenaarandBenjamin Brahmer 2698214c41 fix/allow CDATA encoding (#428) 2019-03-17 08:23:37 +01:00
Sean MolenaarandBenjamin Brahmer f416213993 Fix email and password not being encoded 2019-03-12 19:58:06 +01:00
Sean MolenaarandSean Molenaar 9d5ac4b039 Catch FeedIO reader exception.
Closes #413

Closes #412
2019-03-12 13:30:05 +01:00
Sean Molenaar 7c17b2c24b Allow empty update time 2019-02-23 16:11:28 +01:00
Sean Molenaar ee6bb6ce70 Fix mismatched interface 2019-01-31 13:40:52 +01:00
Sean Molenaar d61a57bd2d Make feed failing more verbose 2019-01-31 10:23:56 +01:00
Sean Molenaar a3246a927d Parser: Switch to feedIO for parsing instead of picoFeed 2019-01-30 20:36:40 +01:00
Sean Molenaar becce6b752 Define an official codestyle and adhere to it. 2018-12-14 07:54:43 +01:00
Sean MolenaarandBernhard Posselt 5b94705cf3 Core: Fix compatibility with nextcloud codestyle (#280) 2018-03-27 15:35:06 +02:00