Commit Graph
49 Commits
Author SHA1 Message Date
nextcloud486153andBenjamin Brahmer 032d48ad7b Fix malformed feeds (without GUIDs) stopping the update process (fixes #1738)
Signed-off-by: nextcloud486153 <78801830+nextcloud486153@users.noreply.github.com>
2022-04-18 13:16:01 +02:00
Benjamin Brahmer a5eaf9ec42 Use rawurlencode as it encodes spaces correctly as %20
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2022-02-27 20:04:14 +01:00
Michael HamannandBenjamin Brahmer f071c05a48 Fix catching connect exceptions while fetching feed logos #1570
Display the message instead of the response when catching an exception
during feed logo fetching. As there is no response and thus no method
`getResponse()` in `ConnectException`, this fixes a "call to undefined
method"-error that prevented feeds from fetching if fetching the logo
resulted in a `ConnectException`.

Signed-off-by: Michael Hamann <michael@content-space.de>
2021-11-30 23:39:39 +01:00
Benjamin Brahmer 9f3b63b5f9 Catch network errors while fetching feed logos, fixes #1570
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-11-14 20:16:16 +01:00
Benjamin BrahmerandSean Molenaar 137af71bb3 Smarter error logging
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>

Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-10-18 17:57:18 +02:00
Benjamin BrahmerandSean Molenaar 74586396f8 make use of constant
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>

Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-10-18 17:57:18 +02:00
Benjamin Brahmer 59a888481f make use of base_url to handle relative urls
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-10-18 17:57:18 +02:00
Benjamin Brahmer 7d61a1cb09 Download feed logos via guzzle to have better error handling
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-10-18 17:57:18 +02:00
Benjamin Brahmer 56ebffbf76 [Backport] Prevent some of the favicon fetching errors
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-05-03 10:19:23 +02:00
anoyandSean Molenaar 91db7113a8 replace deprecated getDescription call
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2021-04-24 14:21:57 +02:00
Chris DanserandGitHub 6e845124df Null check category label before trying to decode (#1282)
* Null check category label before trying to decode

Signed-off-by: skiingwiz <skiingwiz@gmail.com>
2021-04-08 08:10:41 +02:00
Sean MolenaarandSean Molenaar 2baa7a2b91 Make PHPstan stricter
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-03-25 18:47:38 +01:00
Marco NassabainandSean Molenaar 7e0aab358c 🎨 Item: store categories as json & add helper fns
+ added setter/getters that work with arrays to simplify use case

Signed-off-by: Marco Nassabain <marco.nassabain@hotmail.com>
2021-03-17 08:58:42 +01:00
Jimmy HuynhandSean Molenaar 3dfbf64a6b ♻️ Renaming 'tags' into 'categories'
Signed-off-by: Jimmy Huynh <jimmy.huynh@etu.unistra.fr>
2021-03-17 08:58:42 +01:00
Jimmy HuynhandSean Molenaar fd13be0f7a Update FeedFetcher: import 'tags' to 'item'
Signed-off-by: Jimmy Huynh <jimmy.huynh@etu.unistra.fr>
2021-03-17 08:58:42 +01:00
Benjamin Brahmer 6cd83ea1da remove unused lastModified from feed fetcher
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-02-16 11:01:10 +01:00
Benjamin BrahmerandSean Molenaar c09b4d8d33 prefer the feeds logo over the favicon
The logo of the feed is prefered if it is a square picture,
else the favicon is returned.

Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-02-16 10:16:15 +01:00
Kevin DecherfandBenjamin Brahmer 42ea24f2f4 Remove LastModified-based cursor when updating feeds
We remove the call to readSince() as some feeds push new articles with
pubDate prior to the lastModified time stored for these feeds (e.g.
lemonde.fr). As we go through all items of a feed again and again, we
prevent the constant update of an item's lastModified timestamp by
keeping the previous one if its fingerprint does not change.

Fixes #921

Signed-off-by: Kevin Decherf <kevin@kdecherf.com>
2020-12-15 20:02:21 +01:00
Sean MolenaarandSean Molenaar 48a130d3c0 Allow titles to be null
Issue GH-867

Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-10-12 21:40:23 +02:00
Sean MolenaarandBenjamin Brahmer e528361141 Add feed autodiscovery
Issue GH-415

Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29 21:15:53 +02:00
Sean MolenaarandBenjamin Brahmer bc01761221 Fix repair step and test it
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29 13:02:03 +02:00
Sean MolenaarandBenjamin Brahmer d00d1ab2a2 Create V2 mapper, Service and management commands
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-27 15:35:31 +02:00
Sean MolenaarandBenjamin Brahmer 60ab4941cc Move to nextcloud config and update phpunit
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-25 19:18:04 +02:00
Gioele FalcettiandBenjamin Brahmer bf0e693e23 Fix crash if full-text is enabled and the news item does not provide an URL to be fetched
Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2020-08-31 00:59:43 +02:00
Éloi RivardandGitHub 306d3cdc60 Basic Media-RSS support (#599)
Signed-off-by: Éloi Rivard <azmeuk@gmail.com>
2020-02-16 14:26:06 +01:00
kesselbandBenjamin Brahmer f045bd0ba3 Update httpLastModified from the feed response (#594)
LastModified is used (in a feed context to see if a user edited a feed). httpLastModified to store the last-modified response from the source.

Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>
2019-12-27 03:51:06 +01:00
DriverXXandBenjamin Brahmer 6673cbc3d9 Reimplement full-text scraping (#563)
Add readability.php scraper
Fixes #482
Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2019-12-24 09:33:19 +01:00
b_bandBenjamin Brahmer 35c6c91e26 Get content:encoded of item if available (#565)
Get content:encoded of item if available fixes #564

Signed-off-by: brunob <bruno@eliaz.fr>
2019-11-16 14:21:40 +01:00
Sean MolenaarandSean Molenaar b37e237c7a Fix xkcd commics 2019-03-26 09:31:03 +01:00
Sean MolenaarandBenjamin Brahmer 62bd42cb17 Stop assuming encoding of xml, let simplexml throw silently (#457) 2019-03-22 09:19:05 +01:00
Sean MolenaarandBenjamin Brahmer c69bcb8e68 Allow empty-ish lastmodified and clean up FeedFetcher Test (#458) 2019-03-21 05:16:35 +01:00
Jasper KnockaertandSean Molenaar 84af098d01 reset modified since filter when updating feeds
When updating feeds the modified since date is added as a filter. This needs to be reset when looping over the feeds. Fixes #444.
2019-03-20 07:51:45 +01:00
Sean MolenaarandBenjamin Brahmer 2698214c41 fix/allow CDATA encoding (#428) 2019-03-17 08:23:37 +01:00
Sean MolenaarandBenjamin Brahmer f416213993 Fix email and password not being encoded 2019-03-12 19:58:06 +01:00
Sean Molenaar 7c17b2c24b Allow empty update time 2019-02-23 16:11:28 +01:00
Sean Molenaar ee6bb6ce70 Fix mismatched interface 2019-01-31 13:40:52 +01:00
Sean Molenaar d61a57bd2d Make feed failing more verbose 2019-01-31 10:23:56 +01:00
Sean Molenaar a3246a927d Parser: Switch to feedIO for parsing instead of picoFeed 2019-01-30 20:36:40 +01:00
Sean Molenaar becce6b752 Define an official codestyle and adhere to it. 2018-12-14 07:54:43 +01:00
Sean MolenaarandBernhard Posselt 5b94705cf3 Core: Fix compatibility with nextcloud codestyle (#280) 2018-03-27 15:35:06 +02:00
Daniel OpitzandBernhard Posselt a97dd58e3b Split binary to booleans (#203)
* replaced old status with 2 flags for unread and starred

* add fields to db, replace int(1,0) with booleans in sql queries, removed StatusFlags class + refactor code relying to it

* add repair step for migration

* again use integer(1,0) instead of bool in sql queries, because of sqlite doesn't support true/false

* add/fix unit tests for new boolean status

* set unread/starred flags as statements in sql

* fixed mysql unknown column items.unread, fixed marking of read items on repair step

* remove unnecessary bool casts

* add empty checks to Items::is* methods

* update migration to use native sql instead of the querybuilder

* don't cast the flags manually, let the api do the work
2017-08-14 10:34:53 +02:00
rakeknivenandBernhard Posselt 0fa82e88d7 Rakekniven patch 1 (#204)
* Update FeedFetcher.php

* Update part.content.warnings.php

* Update part.content.warnings.php
2017-07-13 16:52:30 +02:00
rakeknivenandBernhard Posselt e09a146941 Update FeedFetcher.php (#200)
Small l10n fix
2017-07-09 09:04:04 +02:00
Robin AppelmanandBernhard Posselt bc27596f70 Add postprocessor for getting lwn subscriber articles (#72) 2017-01-04 11:10:19 +01:00
Daniel SchaalandBernhard Posselt 04f66c9710 Add updatedDate to item model (#81)
* Update picoFeed to v0.1.28

* Add updated_date to database and bump version to 10.1.1

* Add updatedDate to item model

* Check for updatedDate when updating a feed

* Fix unit test to check for newer updatedDate
2017-01-04 11:09:46 +01:00
Bernhard Posselt 8d63975360 revert 2016-10-02 18:05:49 +02:00
Daniel SchaalandBernhard Posselt e45511f6ba Add updatedDate to item model (#43)
* Update picoFeed to 0.1.25

* Add updated_date to database

* Add updatedDate to item model

* Bump version to 9.0.5

* Check for updatedDate when updating a feed

* Fix unit test to check for newer updatedDate
2016-10-01 08:34:40 +02:00
Bernhard Posselt 7a3a22bd27 Adjust copyright header 2016-07-23 21:32:42 +02:00
Bernhard Posselt 004fcbbcc7 Move to new directory structure 2016-07-23 21:24:54 +02:00