Lomanic
/
NewLeaf
mirror of https://git.sr.ht/~cadence/NewLeaf
1
0
Fork 0
Code Issues Releases Wiki Activity
126 Commits 1 Branch 0 Tags 298 KiB
Commit Graph

32 Commits

Author SHA1 Message Date
Cadence Ember 97b7661cc7 Fix feed channel IDs not starting with UC 2023-10-18 23:18:52 +13:00
Cadence Ember f53dd28ada /channels/latest: author ID fallback in video entry 2023-03-27 21:17:27 +13:00
Cadence Ember 412b4934ed
Support new channel layout 2022-11-06 13:55:22 +13:00
Cadence Ember 714f1030fb
Channel path fixes I'm pretty sure I already did? 
- use "channels" as default path, not "user"
- cache based on the combination of the path and the id
- fix channel latest
 2022-09-12 23:13:37 +12:00
Lomanic ac1aa07108 #29 Extract named channels using dynamic endpoint with second__path param instead of /user/ 2022-08-18 18:48:11 +12:00
Lomanic 29a3894337 #42 Return UNKNOWN error for not explicitly handled errors for channel extraction instead of stacktrace 2022-08-18 18:20:06 +12:00
Cadence Ember 68cfbb809f
Remove `with requests` when it is unnecessary 2022-01-16 21:51:26 +13:00
Cadence Ember 73b4fbabf7
Do not actually write out pages. 2022-01-10 13:23:04 +13:00
Cadence Ember 36ae18c12f
Report errors when an account has been terminated 2022-01-10 13:02:08 +13:00
Cadence Ember 1ea86101fd
Support premiere videos on channel 2021-07-01 23:42:53 +12:00
Lomanic 7d3b79b1cd
Change cookies to skip EU cookie consent page 
See https://github.com/benbusby/whoogle-search/issues/311 for some
context.
We're now implementing
a726009987/youtube_dl/extractor/youtube.py (L263-L264)
 2021-05-15 22:29:44 +12:00
Cadence Ember 57b0a88a2e
Detect channels that do not exist 
If error alerts exist, they will be logged. But it is reasonable to
assume that not all errors will be fatal, so we don't necessarily quit
parsing if we find one.

This also normalises the text error of the /latest response for a
missing channel, without changing its identifier.
 2021-05-02 01:20:53 +12:00
bopol aaf7d65b32
change CONSENT cookie value 
FX is accept all tracking, PENDING should imply no tracking
 2021-04-04 14:45:54 +12:00
Lomanic 5f47e1a71b
Fix extracting with cookie consent page in EU 
Fix #27 use maintained yt-dlp lib instead of youtube-dlc

Because of the following changes in YT, we have to switch to a
maintained library https://github.com/ytdl-org/youtube-dl/issues/28604
While yt-dlp is not fixed today, youtube-dl is fixed in master and as
yt-dlp is quick to merge upstream changes back to their repo, we can
hope the issue will also be fixed there timely.

For requests sent by us directly, we include the cookies.

Ref https://github.com/ytdl-org/youtube-dl/issues/28604
 2021-04-03 15:09:58 +13:00
Cadence Ember c8b4699922
Support topic channels with no videos tab 
https://second.cadence.moe/api/v1/channels/UCr-iHMODX8D4a6MVQ_RtdQg
 2021-02-19 01:17:54 +13:00
Lomanic 80b41c7725
Fix broken channel videos extraction failing with KeyError: 'gridVideoRenderer' 2021-02-19 00:59:55 +13:00
Cadence Ember 39425f994a
Fix subscriber count extraction 2021-01-17 14:56:17 +13:00
Cadence Ember f1ddf66f50
Touch up Bopol's patch 2021-01-17 14:55:57 +13:00
bopol 6cc921c2dc
fix channel extraction when header is not available 2021-01-17 14:30:34 +13:00
Cadence Ember e95d814709
Fix channel extraction when subscribers not available 2020-12-09 16:53:22 +13:00
Cadence Ember 10f8009101
Gracefully fail on feed fetch for invalid channel 2020-12-06 15:39:28 +13:00
Cadence Ember 87c7730fbc
Fetch pages using en locale 2020-10-25 18:02:05 +13:00
Cadence Ember 0b9874a4f4
Fix channels having videos 2020-10-04 18:38:41 +13:00
Cadence Ember e1bcc306b3
Fix for if channel has no videos 2020-10-03 01:17:23 +13:00
Cadence Ember c506f65c71
Use empty string instead of null if no description 2020-09-24 01:06:47 +12:00
Cadence Ember caee795b7e
Fix extracting empty description 2020-09-24 00:56:16 +12:00
Cadence Ember e18efc9591
Thread lock when using channel data cache 2020-09-06 00:31:17 +12:00
Cadence Ember 951c62d1a9
Remove useless print 2020-08-31 20:27:17 +12:00
Cadence Ember 105161299f
TTL cache for channel latest 2020-08-31 03:16:57 +12:00
Cadence Ember 0a6a07838d
Add publishedText to /channels/latest 2020-08-31 02:26:46 +12:00
Cadence Ember 4a4f48e9d9
Author banners and thumbnails are optional 2020-08-30 00:48:33 +12:00
Cadence Ember 40759efb03
Refactor everything to separate files 2020-08-14 02:20:11 +12:00