7d740e7dc7
[23video] Relax _VALID_URL ( #26870 )
2020-10-20 00:56:23 +07:00
4eda10499e
[utils] Don't attempt to coerce JS strings to numbers in js_to_json ( #26851 )
...
The current logic in `js_to_json` tries to rewrite octal/hex numbers to
decimal. However, when the logic actually happens the `"` or `'` have
already been trimmed off. This causes what were originally strings, that
happen to look like octal/hex numbers, to get rewritten to decimal and
returned as a number rather than a string.
In practive something like:
```js
{
"0x40": "foo",
"040": "bar",
}
```
would get rewritten as:
```json
{
64: "foo",
32: "bar
}
```
This is problematic since this isn't valid JSON as you cannot have
non-string keys.
2020-10-18 00:10:41 +07:00
605535776a
[ustream] Add support for video.ibm.com ( #26894 )
2020-10-17 23:14:46 +07:00
1050e0d09f
[iqiyi] Fix typo ( #26884 )
2020-10-17 23:02:17 +07:00
d65d89183f
[expressen] Add support for di.se ( closes #26670 )
2020-09-24 07:37:10 +07:00
0c92f1e96b
[iprima] Improve video id extraction ( #26507 ) ( closes #26494 )
2020-09-24 06:46:58 +07:00
c5764b3f89
[downloader/http] Properly handle missing message in SSLError ( closes #26646 )
2020-09-22 07:01:59 +07:00
0837992a22
[downloader/http] Fix access to not yet opened stream in retry
2020-09-22 06:44:14 +07:00
b55715934b
release 2020.09.20
2020-09-20 12:30:45 +07:00
1ca5f821c8
[redtube] Extend _VALID_URL ( #26506 )
2020-09-20 11:39:42 +07:00
defc820b70
[twitch] Switch streams to GraphQL and refactor ( closes #26535 )
2020-09-20 10:05:00 +07:00
82ef02e936
[telequebec] Fix issues ( closes #26368 )
2020-09-19 07:56:00 +07:00
b856b3997c
[telequebec] Add support for brightcove videos ( closes #25833 )
2020-09-19 07:52:57 +07:00
cd85a1bb8b
[pornhub] Extract metadata from JSON-LD ( closes #26614 )
2020-09-19 06:34:34 +07:00
ce5b904050
[extractor/common] Relax interaction count extraction in _json_ld
2020-09-19 06:33:17 +07:00
ad06b99dd4
[extractor/common] Extract author as uploader for VideoObject in _json_ld
2020-09-19 06:13:42 +07:00
540b9f5164
[pornhub] Fix view count extraction ( #26621 ) (refs #26614 )
2020-09-19 05:59:19 +07:00
6e65a2a67e
[downloader/hls] Fix incorrect end byte in Range HTTP header for media segments with EXT-X-BYTERANGE ( #24512 ) ( closes #14748 )
...
The end of the byte range is the first byte that is NOT part of the to
be downloaded range. So don't include it into the requested HTTP
download range, as this additional byte leads to a broken TS packet and
subsequently to e.g. visible video corruption.
Fixes #14748 .
2020-09-18 05:26:56 +07:00
f8c7bed133
[extractor/common] Handle ssl.CertificateError in _request_webpage ( closes #26601 )
...
ssl.CertificateError is raised on some python versions <= 3.7.x
2020-09-18 03:41:16 +07:00
cdc55e666f
[downloader/http] Improve timeout detection when reading block of data (refs #10935 )
2020-09-18 03:32:54 +07:00
86b7c00adc
[downloader/http] Retry download when urlopen times out ( #26603 ) (refs #10935 )
2020-09-18 03:15:44 +07:00
e8c5d40bc8
release 2020.09.14
2020-09-14 03:37:36 +07:00
bff857a8af
[postprocessor/embedthumbnail] Fix issues ( closes #25717 )
...
* Fix WebP with wrong extension processing
* Fix embedding of thumbnails with % character in path
2020-09-14 03:28:31 +07:00
a31a022efd
[postprocessor/embedthumbnail] Add support for non jpeg/png thumbnails ( closes #25687 )
2020-09-14 03:10:01 +07:00
45f6362464
[rtlnl] Extend _VALID_URL for new embed URL schema
2020-09-13 21:42:06 +07:00
97f34a48d7
[rtlnl] Extend _VALID_URL ( #26549 ) ( closes #25821 )
2020-09-13 21:38:16 +07:00
ea74e00b3a
[youtube] Fix empty description extraction ( #26575 ) ( closes #26006 )
2020-09-13 21:23:21 +07:00
06cd4cdb25
[srgssr] Extend _VALID_URL ( closes #26555 , closes #26556 , closes #26578 )
2020-09-13 21:07:25 +07:00
da2069fb22
[googledrive] Use redirect URLs for source format ( closes #18877 , closes #23919 , closes #24689 , closes #26565 )
2020-09-13 20:49:32 +07:00
95c9810015
[svtplay] Fix id extraction ( closes #26576 )
2020-09-13 18:59:37 +07:00
b03eebdb6a
[redbulltv] improve support for rebull.com TV localized URLS( #22063 )
2020-09-13 11:26:11 +01:00
1f7675451c
[redbulltv] Add support for new redbull.com TV URLs( closes #22037 )( closes #22063 )
2020-09-12 19:27:58 +01:00
aa27253556
[soundcloud] Reduce pagination limit to fix 502 Bad Gateway errors when listing a user's tracks. ( #26557 )
...
Per the documentation here https://developers.soundcloud.com/blog/offset-pagination-deprecated the maximum limit is 200, so let's respect that (even if a higher value sometimes works).
Co-authored-by: tfvlrue <tfvlrue>
2020-09-12 09:35:11 +00:00
d51e23d9fc
release 2020.09.06
2020-09-06 13:00:41 +07:00
50e9fcc1fd
[nrktv:episode] Improve video id extraction ( closes #25594 , closes #26369 , closes #26409 )
2020-09-06 12:43:50 +07:00
16ee69c1b7
[youtube] Fix age gate content detection ( #26100 ) ( closes #26152 , closes #26311 , closes #26384 )
2020-09-06 11:44:53 +07:00
67171ed7e9
[youtube:user] Extend _VALID_URL ( closes #26443 )
2020-09-06 11:31:28 +07:00
1d9bf655e6
[utils] Recognize wav mimetype ( closes #26463 )
2020-09-06 11:19:53 +07:00
62ae19ff76
[xhamster] Improve initials regex ( #26526 ) ( closes #26353 )
2020-09-06 11:10:27 +07:00
5ed05f26ad
[svtplay] Fix svt id extraction ( closes #26425 , closes #26428 , closes #26438 )
2020-09-06 10:45:57 +07:00
841b683804
[twitch] Rework extractors ( closes #12297 , closes #20414 , closes #20604 , closes #21811 , closes #21812 , closes #22979 , closes #24263 , closes #25010 , closes #25553 , closes #25606 )
...
* Switch to GraphQL.
+ Add support for collections.
+ Add support for clips and collections playlists.
2020-09-06 10:45:34 +07:00
f5863a3ea0
[biqle] improve video_ext extraction
2020-08-27 19:20:41 +01:00
10709fc7c6
[xhamster] Extend _VALID_URL ( closes #25927 )
2020-08-12 21:51:50 +07:00
a7e348556a
[xhamster] Fix extraction ( closes #26157 ) ( #26254 )
2020-08-12 21:42:17 +07:00
6cb30ea5ed
[xhamster] Extend _VALID_URL ( closes #25789 ) ( #25804 )
2020-08-12 21:37:22 +07:00
a4ed50bb84
release 2020.07.28
2020-07-28 05:13:03 +07:00
e450f6cb63
[youtube] Fix sigfunc name extraction ( closes #26134 , closes #26135 , closes #26136 , closes #26137 )
2020-07-28 05:05:38 +07:00
a115e07594
[youtube] Improve description extraction ( closes #25937 ) ( #25980 )
2020-07-14 12:01:15 +01:00
718393c632
[wistia] Restrict embed regex ( closes #25969 )
2020-07-11 18:27:19 +07:00
07af16b92e
[youtube] Prevent excess HTTP 301 ( #25786 )
2020-07-01 02:56:16 +07:00
e942cfd1a7
[youtube:playlists] Extend _VALID_URL ( closes #25810 )
2020-06-28 10:30:03 +07:00
9a7e5cb88a
[bellmedia] add support for cp24.com clip URLs( closes #25764 )
2020-06-23 15:09:13 +01:00
2391941f28
[brightcove] Improve embed detection ( closes #25674 )
2020-06-16 17:38:25 +07:00
9ff6165a81
release 2020.06.16.1
2020-06-16 06:22:01 +07:00
ee0b726cd7
[youtube] Force old layout ( closes #25682 , closes #25683 , closes #25680 , closes #25686 )
2020-06-16 06:17:53 +07:00
dbeafce5d5
[youtube] Fix categories and improve tags extraction
2020-06-16 03:13:39 +07:00
ed604ce7bc
release 2020.06.16
2020-06-16 02:53:33 +07:00
a6211d237b
[youtube] Fix uploader id and uploader URL extraction
2020-06-16 02:43:09 +07:00
7b16239a49
[youtube] Improve view count extraction
2020-06-16 02:38:45 +07:00
37357d21a9
[youtube] Fix upload date extraction
2020-06-16 02:37:19 +07:00
b477fc1314
[youtube] Fix thumbnails extraction and remove uploader id extraction warning ( closes #25676 )
2020-06-16 02:29:04 +07:00
d84b21b427
[youtube] Fix playlist and feed extraction ( closes #25675 )
2020-06-16 02:01:12 +07:00
48bd042ce7
[facebook] Support single-video ID links
...
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
2020-06-14 13:17:51 +02:00
84213ea8d4
[youtube] Extract chapters from JSON ( closes #24819 )
2020-06-06 04:22:10 +07:00
562de77f41
[kaltura] Add support for multiple embeds on a webpage ( closes #25523 )
2020-06-06 02:14:35 +07:00
e1723c4bac
release 2020.06.06
2020-06-06 01:51:39 +07:00
a5b6102ea8
[tele5] Bypass geo restriction
2020-06-06 01:45:05 +07:00
b77888228d
[jwplatform] Add support for bypass geo restriction
2020-06-06 01:44:36 +07:00
0b1eaec3bc
[tele5] Prefer jwplatform over nexx ( closes #25533 )
2020-06-06 01:35:09 +07:00
b37e47a3f9
[twitch:stream] Expect 400 and 410 HTTP errors from API
2020-06-06 00:57:40 +07:00
ce3735df02
[twitch:stream] Fix extraction ( closes #25528 )
2020-06-06 00:55:29 +07:00
a0455d0ffd
[twitch] Pass v5 accept header and fix thumbnails extraction ( closes #25531 )
2020-06-06 00:12:47 +07:00
c8b232cc48
[brightcove] Sort imports
2020-06-05 23:35:57 +07:00
b4eb0bc7bd
[brightcove] Fix subtitles extraction ( closes #25540 )
2020-06-05 23:33:14 +07:00
d5147b65ac
[malltv] Add support for sk.mall.tv ( #25445 )
2020-06-01 21:11:31 +07:00
7b0b53ea69
[twitter:broadcast] Add untitled periscope broadcast test
2020-06-01 20:32:57 +07:00
7016e24ebe
[periscope] Fix untitled broadcasts ( #25482 )
2020-06-01 20:31:51 +07:00
bef4688c72
[jwplatform] Improve embeds extraction ( closes #25467 )
2020-05-31 11:10:31 +07:00
228c1d685b
release 2020.05.29
2020-05-29 03:33:13 +07:00
fe515e5c75
[ard:beta] Extend _VALID_URL ( closes #25405 )
2020-05-29 02:01:51 +07:00
1db5ab6b34
[youtube] Add support for more invidious instances ( #25417 )
2020-05-27 01:26:45 +07:00
2791e80b60
[postprocessor/ffmpeg] Embed series metadata with --add-metadata
2020-05-23 12:28:15 +07:00
8f841fafcd
[giantbomb] Extend _VALID_URL ( #25222 )
2020-05-21 04:30:50 +07:00
a54c5f83c0
[ard] Improve _VALID_URL ( closes #25134 ) ( #25198 )
2020-05-20 04:08:08 +07:00
cd13343ad8
[redtube] Improve formats extraction and extract m3u8 formats ( closes #25311 , closes #25321 )
2020-05-20 03:39:41 +07:00
9cd5f54e31
[utils] Fix file permissions in write_json_file ( closes #12471 ) ( #25122 )
2020-05-20 03:21:52 +07:00
9a269547f2
[indavideo] Switch to HTTPS for API request ( #25191 )
2020-05-20 02:13:06 +07:00
bf097a5077
[redtube] Improve title extraction ( #25208 )
2020-05-20 02:11:05 +07:00
52c50a10af
[vimeo] improve format extraction and sorting( closes #25285 )
2020-05-15 15:57:06 +01:00
b334732709
[soundcloud] reduce API playlist page limit( closes #25274 )
2020-05-15 14:13:02 +01:00
384bf91f88
[youtube] Add support for yewtu.be ( #25226 )
2020-05-14 05:54:42 +07:00
adc13b0748
[mailru] Fix extraction ( closes #24530 ) ( #25239 )
2020-05-14 05:51:40 +07:00
327593257c
[bbccouk] PEP8
2020-05-14 05:11:42 +07:00
9d8f3a12a6
[spike] fix Bellator mgid extraction( closes #25195 )
2020-05-12 20:49:08 +01:00
b002bc433a
release 2020.05.08
2020-05-08 18:10:37 +07:00
fa3db38333
[youtube] Improve signature cipher extraction ( closes #25188 )
2020-05-08 17:42:30 +07:00
30fa5c6087
[iprima] Improve extraction ( closes #25138 )
2020-05-06 23:20:14 +07:00
6c907eb33f
[downloader/http] Request last data block of exact remaining size
...
Always request last data block of exact size remaining to download if possible not the current block size.
2020-05-05 21:43:39 +07:00
f7b42518dc
[downloader/http] Finish downloading once received data length matches expected
...
Always do this if possible, i.e. if Content-Length or expected length is known, not only in test.
This will save unnecessary last extra loop trying to read 0 bytes.
2020-05-05 21:43:39 +07:00
ce7db64bf1
[uol] fix extraction( closes #22007 )
2020-05-05 11:19:40 +01:00
Hannu Hartikainen