| Commit message (Collapse) | Author | Age | Files | Lines |
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
|
|
|
|
|
| |
This commit also decouples the "import" and "update" functions inside
ContentProxy. If a content array is available, it must be passed to the
new importEntry method.
|
|
|
|
| |
Down from 2.2 minutes to 1.39 minutes
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Entry API can now have these new fields:
- content
- language
- preview_picture
- published_at
Re-use the ContentProxy to be able to do the same using the web UI (in the future).
htmLawed is used to clean stuff from content, I hope it’ll be enough to avoid security breach.
Lower content validation when we want to update an entry with content already defined. Before, language & content_type were required. If there weren’t provided, we re-fetched the content using graby. I think these fields aren’t required for an entry to be created. So I removed them.
Which means some import from the v1 export won’t be re-fetched since they provide content, url & title.
Also, remove liberation link from Readability import to avoid overlaping import (from wallabag v1, which had the same link)
|
| |
|
|
|
|
| |
Signed-off-by: Thomas Citharel <tcit@tcit.fr>
|
| |
|
|
|
|
| |
Also update ImportController with latest import (chrome, firefox & instapaper).
|
|\
| |
| | |
Import Firefox & Chrome bookmarks into wallabag
|
| |
| |
| |
| |
| | |
With real data, the previous looks more than a Chrome converted file.
Also, fix date conversion (hope so).
|
| | |
|
| | |
|
|/
|
|
| |
Using `getScheduledEntityInsertions()` we can retrieve not yet flushed but already persisted entities and then avoid tags duplication on import.
|
|
|
|
| |
Instead of just say “Failed to save entry” we’ll save the entry at all cost and try to fetch content. If fetching content failed, the entry will still be saved at least, but without content.
|
| |
|
| |
|
|
|
|
|
| |
Add generated files from `composer up`
Add more articles for Readability tests
|
|
|
|
|
|
|
|
| |
- using javibravo/simpleue
- internal config value are now `import_with_redis` & `import_with_rabbit` which are more clear
- if both option are enable rabbit will be choosen
- services imports related to async are now splitted into 2 files: `redis.yml` & `rabbit.yml`
-
|
| |
|
|
|
|
| |
Also update Symfony deps
|
|
|
|
|
| |
5000 by 5000.
Also, retrieve newest item first.
|
|
|
|
|
| |
Instead of queing real Entry to process, we queue all the item to import from Pocket in a raw format.
Then, the worker retrieve that information, find / create the entry and save it.
|
| |
|
| |
|
| |
|
|
|
|
|
|
|
|
|
| |
graby will throw an Exception in some case (like a bad url, a restricted url or a secured pdf).
Import doesn't handle that case and break the whole import.
With that commit the import isn't stopped but the entry is just skipped.
Also, as a bonus, I've added extra test on WallabagImportV2 when the json is empty.
|
|
|