Mirrors
/
yt-dlp
mirror of https://github.com/yt-dlp/yt-dlp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
21,433 Commits 3 Branches 99 Tags 113 MiB
Commit Graph

1827 Commits

Author SHA1 Message Date
pukkandan 2314b4d89f
Allow plugin extractors to replace the built-in ones 
This allows easier plugin chaining; e.g.
- https://gist.github.com/pukkandan/24f13ff1ed385c5a390c1d7bd130d8f7
- https://gist.github.com/pukkandan/fcf5ca1785c80f64e471f0ee14f990fb
 2022-09-16 17:02:52 +05:30
pukkandan deae7c1711
[cleanup] Misc 2022-09-10 03:46:54 +05:30
pukkandan 0cb0fdbbfe
[extractor/common] Escape `%` in `representation_id` of m3u8 
Closes #4877
 2022-09-10 03:42:14 +05:30
coletdjnz 0831d95c46
[extractor/BiliIntl] Support uppercase lang in `_VALID_URL` 
Seen in some rare cases
Authored by: coletdjnz
 2022-09-10 10:06:48 +12:00
coletdjnz c26f9b991a
[extractor/youtube] Support changing extraction language (#4470) 
Adds `--extractor-args youtube:lang=<supported lang code>` extractor arg to prefer translated fields (e.g. title and description) of that language, if available, for all YouTube extractors. See README or error message for list of supported language codes.

Closes https://github.com/yt-dlp/yt-dlp/issues/387

Authored by: coletdjnz
 2022-09-09 05:16:46 +00:00
CplPwnies 0c0b78b273
[extractor/adobepass] Add MSO AlticeOne (Optimum TV) (#4875) 
* Suddenlink rebrand to Optimum. Fixes #4874

Authored by: CplPwnies
 2022-09-09 10:22:05 +05:30
coletdjnz 3ffb2f5bea
[extractor/youtube] Fix video like count extraction 
Support new combined button layout
Authored by: coletdjnz
 2022-09-09 12:34:39 +12:00
pukkandan 1015ceeeaf
[extractor/MLBTV] Detect live streams 2022-09-08 06:18:35 +05:30
pukkandan 17ffed1842
[docs] Improvements 
* Move detailed installation instructions to https://github.com/yt-dlp/yt-dlp/wiki/Installation
* Link to wiki where applicable
* Fix some mistakes. Closes #4853, Closes #4855, Closes #4852
* Improve some error messages
 2022-09-07 17:38:05 +05:30
pukkandan be9c0884d7
[extractor/BiliIntlSeries] Fix `_VALID_URL` 
Closes #4825
 2022-09-07 17:29:05 +05:30
Elyse 69082b38dc
[phantomjs] Fix bug in 587021cd9f (#4833) 
Authored by: elyse0
 2022-09-03 12:14:01 +05:30
coletdjnz aa824dd10b
[extractor/mediaworksnzvod] Add extractor (#4817) 
Authored by: coletdjnz
 2022-09-03 03:19:48 +00:00
TokyoBlackHole a12d03e15d
[extractor/animeondemand] Remove extractor (#4830) 
Authored by: TokyoBlackHole
 2022-09-03 03:41:25 +05:30
Lesmiscore 3c7a276234
[extractor/amazonstore] Retry to avoid captcha page (#4811) 
Authored by: Lesmiscore
 2022-09-02 15:51:12 +09:00
bashonly d6f8871964
[extractor/triller] Fix auth token (#4813) 
Authored by: bashonly
 2022-09-02 03:38:05 +05:30
pukkandan 5469a4ab11
[extractor/motorsport] Support native embeds 
Closes #4749
 2022-09-02 02:01:58 +05:30
pukkandan 2c475e48b5
[extractor/bandcamp] Extract `uploader_url` 
Closes #4755
 2022-09-02 02:01:57 +05:30
pukkandan 7c6eb424d3
[extractor/youtube] Detect `lazy-load-for-videos` embeds 
Closes #4812
 2022-09-02 02:01:57 +05:30
pukkandan d2c8aadf79
[cleanup] Misc 
Closes #4710, Closes #4754, Closes #4723
Authored by: pukkandan, MrRawes, DavidH-2022
 2022-09-01 16:49:03 +05:30
pukkandan 05deb747bb
[jsinterp] Fix escape in regex 2022-09-01 16:46:32 +05:30
pukkandan b505e8517a
[extractor/youtube] Fallback regex for nsig code extraction 2022-09-01 16:46:32 +05:30
pukkandan f2e9fa3ef7
[FormatSort] Fix `aext` for `--prefer-free-formats` 
Closes #4735
 2022-09-01 16:46:31 +05:30
coletdjnz 1ff88b7aec
[extractor/youtube] Add `no-youtube-prefer-utc-upload-date` compat option (#4771) 
This option reverts 992f9a730b and 17322130a9 to prefer the non-UTC upload date in microformats.

Authored by: coletdjnz, pukkandan
 2022-09-01 10:02:28 +00:00
bashonly 92aa6d6883
[extractor/triller] Add extractor (#4712) 
Closes #4703
Authored by: bashonly
 2022-09-01 15:20:54 +05:30
Elyse b2a4db425b
[VQQ] Add extractors (#4706) 
Closes #1666
Authored by: elyse0
 2022-09-01 12:42:34 +05:30
Yifu Yu de49cdbe9d
[extractor/bilibili] Extract `flac` with premium account (#4759) 
Authored by: jackyyf
 2022-08-31 23:22:16 +05:30
HobbyistDev 11734714c2
[extractor/eurosport] Add extractor (#4613) 
Closes #2487
Authored by: HobbyistDev
 2022-08-31 22:32:33 +05:30
pukkandan b86ca447ce
[extractor/mediaset] Fix embed extraction 
Closes #4804
 2022-08-31 22:24:41 +05:30
Tejas Arlimatti f8c7ba9984
[extractor/epoch] Add extractor (#4772) 
Closes #4714
Authored by: tejasa97
 2022-08-31 22:16:26 +05:30
DepFA 76f2bb175d
[extractor/stripchat] Don't modify input URL (#4781) 
Authored by: dfaker
 2022-08-31 21:10:59 +05:30
Lesmiscore bfbecd1174
[extractor/newspicks] Add extractor (#4725) 
Authored by: Lesmiscore
 2022-08-31 02:07:55 +09:00
Jeff Huffman 459262ac97
[extractor/crunchyroll:beta] Use anonymous access (#4704) 
Closes #4692
Authored by: tejing1
 2022-08-30 22:04:13 +05:30
pukkandan da4db748fa
[utils] Add `deprecation_warning` 
See https://github.com/yt-dlp/yt-dlp/pull/2173#issuecomment-1097021515
 2022-08-30 21:03:07 +05:30
pukkandan d81ba7d491
[jsinterp, extractor/youtube] Minor fixes 2022-08-30 18:13:37 +05:30
OHaiiBuzzle 5135ed3d4a
[extractor/huya] Fix stream extraction (#4798) 
Closes #4658
Authored by: ohaiibuzzle
 2022-08-30 16:14:16 +05:30
pukkandan c4b2df872d
[jsinterp] Fix `_separate` 
Ref: https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1231126941
 2022-08-30 16:06:40 +05:30
Samantaz Fox 224b5a35f7
[extractor/youtube] Update iOS Innertube clients (#4792) 
Authored by: SamantazFox
 2022-08-29 03:36:55 +00:00
coletdjnz 50ac0e5416
[extractor/youtube] Use device-specific user agent (#4770) 
Thwart latest fingerprinting attempt (see https://github.com/iv-org/invidious/issues/3230#issuecomment-1226887639)

Authored by: coletdjnz
 2022-08-28 22:59:54 +00:00
Lesmiscore e0992d5558
[extractor/IslamChannel] Add extractors (#4779) 
Authored by: Lesmiscore
 2022-08-28 01:37:25 +09:00
pukkandan 5e01315aa1
[cache, extractor/youtube] Invalidate old cache 2022-08-27 07:25:14 +05:30
pukkandan 4e4982ab5b
[extractor/generic] Don't return JW player without formats 
CLoses #4765
 2022-08-27 06:21:17 +05:30
cgrigis 89e4d86171
[extractor/arte] Bug fix (#4769) 
Closes #4768
Authored by: cgrigis
 2022-08-27 05:58:01 +05:30
Shreyas Minocha a1af516259
[extractor/screencastomatic] Support `--video-password` (#4761) 
Authored by: shreyasminocha
 2022-08-26 08:59:45 +05:30
pukkandan 1d64a59547
[extractor/vimeo:user] Fix _VALID_URL 
Closes #4758
 2022-08-26 06:29:03 +05:30
pukkandan e5458d1d88
Fix lazy extractor bug in fe7866d0ed 
and add test

Fixes https://github.com/yt-dlp/yt-dlp/pull/3234#issuecomment-1225347071
 2022-08-24 15:19:58 +05:30
pukkandan 2516cafb28
Fix bug in fe7866d0ed 2022-08-24 08:21:39 +05:30
pukkandan fe7866d0ed
Add option `--use-extractors` 
Deprecates `--force-generic-extractor`

Closes #3234, Closes #2044

Related: #4307, #1791
 2022-08-24 07:47:51 +05:30
pukkandan 13db4e7b9e
[extractor/mixcloud] All formats are audio-only 
Closes #4740
 2022-08-23 04:11:27 +05:30
Joshua Lochner 07275b708b
[extractor/medaltv] Fix extraction (#4739) 
Authored by: xenova
 2022-08-23 01:34:12 +05:30
Elyse b85703d11a
[extractor/rtbf] Fix jwt extraction (#4738) 
Closes #4683
Authored by: elyse0
 2022-08-23 00:15:46 +05:30
pukkandan 992dc6b486
[jsinterp] Implement timeout 
Workaround for #4716
 2022-08-22 06:19:06 +05:30
pukkandan 8d1ad6378f
[extractor/BiliBiliSearch] Don't sort by date 
Related #4682
 2022-08-21 05:19:20 +05:30
pukkandan 2d1019542a
[extractor/BiliBiliSearch] Fix infinite loop 
Closes #4682
 2022-08-21 05:19:20 +05:30
pukkandan b25cac650f
[extractor/youtube] Fix bug in format sorting 2022-08-21 00:56:27 +05:30
pukkandan 90a1df305b
[test] Fix test_youtube_signature 2022-08-21 00:51:03 +05:30
pukkandan 0a6b4b82e9
[extractor/uktv] Improve _VALID_URL 
Closes #4707
Authored by: dirkf
 2022-08-20 05:00:45 +05:30
pukkandan 1704c47ba8
[extractor/bitchute] Mark errors as expected 
Closes #4685
 2022-08-20 04:53:05 +05:30
pukkandan a831c2ea90
[cleanup] Misc 2022-08-19 05:08:21 +05:30
bashonly 8a3da4c68c
[extractor/instagram] Fix bugs in 7d3b98be4c (#4701) 
Authored by: bashonly
 2022-08-19 03:45:49 +05:30
nixxo 4d37d4a77c
[extractor/rai] Minor fix (#4700) 
Closes #4691, #4690
 2022-08-19 02:28:59 +05:30
bashonly 7d3b98be4c
[extractor/instagram] Fix extraction (#4696) 
Closes #4657, #4532, #4475
Authored by: bashonly, pritam20ps05
 2022-08-19 02:27:46 +05:30
Elyse 2b3e43e247
[extractor/rtbf] Fix stream extractor (#4671) 
Closes #4656
Authored by: elyse0
 2022-08-19 01:42:04 +05:30
Alexander Seiler f60ef66371
[extractor/zattoo] Fix Zattoo resellers (#4675) 
Closes #4630
Authored by: goggle
 2022-08-19 01:27:51 +05:30
pukkandan 25836db6be
[extractor/youtube] Add fallback to phantomjs 
Related #4635
 2022-08-18 21:35:18 +05:30
pukkandan 587021cd9f
[phantomjs] Add function to execute JS without a DOM 
Authored by: MinePlayersPE, pukkandan
 2022-08-18 21:34:47 +05:30
pukkandan 580ce00782
[youtube] Improve signature caching 
and refactor related functions
 2022-08-18 21:33:30 +05:30
ChillingPepper 2f1a299c50
[extractor/SovietsCloset] Fix extractor (#4688) 
Closes #4200 
Authored by: ChillingPepper
 2022-08-18 16:44:45 +05:30
pukkandan f6ca640b12
[jsinterp] Fix for youtube player 1f7d5369 
Closes #4635 again
 2022-08-18 16:38:35 +05:30
pukkandan 3ce2933693
[youtube] Fix error reporting of "Incomplete data" 
Related: #4669
 2022-08-16 22:01:48 +05:30
pukkandan 5c6d2ef9d1
[youtube] Improve format sorting for IOS formats 
When no itag/resolution is available for reference, use the closest resolution
 2022-08-15 14:04:05 +05:30
pukkandan 1e4fca9a87
[cleanup] Misc 2022-08-15 03:41:45 +05:30
pukkandan 48732becfe
Fix bug in 1155ecef29 2022-08-15 03:31:48 +05:30
masta79 ef6342bd07
[extractor/toggo] Improve `_VALID_URL` (#4663) 
Authored by: masta79
 2022-08-15 03:31:41 +05:30
ischmidt20 e183bb8c9b
[extractor/MLB] New extractor (#4586) 
Authored by: ischmidt20
 2022-08-15 01:47:18 +05:30
HobbyistDev 7695f5a0a7
[extractor/moview] Add extractor (#4607) 
Authored by: HobbyistDev
 2022-08-15 01:39:05 +05:30
Ben Welsh cb7cc448c0
[extractor/truth] Add extractor (#4609) 
Closes #3865
Authored by: palewire
 2022-08-15 01:36:04 +05:30
bashonly 63be30e3e0
[extractor/facebook] Add reel support (#4660) 
Closes #4039 
Authored by: bashonly
 2022-08-15 01:33:24 +05:30
Ben Welsh 43cf982ac3
[extractor/parler] Add extractor (#4616) 
Authored by: palewire
 2022-08-15 01:31:16 +05:30
nixxo 7e82397441
[extractor/rai] Misc fixes (#4600) 
Authored by: nixxo
 2022-08-15 01:17:55 +05:30
Aldo Ridhoni 66c4afd828
[extractor/doodstream] Add `wf` domain (#4648) 
Authored by: aldoridhoni
 2022-08-15 01:13:03 +05:30
Lesmiscore 62b58c0936
[docs] Consistent use of `e.g.` (#4643) 
Authored by: Lesmiscore
 2022-08-14 17:34:13 +05:30
pukkandan 8f53dc44a0
[jsinterp] Handle new youtube signature functions 
Closes #4635
 2022-08-14 05:12:32 +05:30
Jacob Truman 1cddfdc52b
[extractor/aenetworks] Add formats parameter (#4645) 
Closes #4047
Authored by: jacobtruman
 2022-08-13 22:56:41 +05:30
coletdjnz cea4b857f0
[patreon] Ignore erroneous media attachments (#4638) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/4608
Authored by: coletdjnz
 2022-08-13 00:25:20 +00:00
shirt ffcd62c289
[extractor/tubitv] Extract additional formats (#4646) 
Authored by: shirt-dev
 2022-08-13 05:10:49 +05:30
pukkandan 5da42f2b9b
[extractor/crunchyroll] Improve `_VALID_URL`s 
Closes #4633
 2022-08-12 13:13:11 +05:30
pukkandan 1155ecef29
[extractor/zattoo] Fix resellers 
Fixes #4630
 2022-08-12 12:53:46 +05:30
pukkandan 7e798d725e
[extractor] Fix format sorting of `channels` 2022-08-11 07:23:46 +05:30
pukkandan 16d4535abc
Update to ytdl-commit-adb5294 
[aenetworks] Update _THEPLATFORM_KEY and _THEPLATFORM_SECRET
adb5294177
 2022-08-09 02:55:30 +05:30
Elyse 2a5e5477bc
[extractor/redbee] Unify and update extractors (#4479) 
Closes #4443
Authored by: elyse0
 2022-08-09 02:41:47 +05:30
Eren Kemer e251986cbe
[extractor/harpodeon] Add extractor (#4540) 
Closes #4450
Authored by: eren-kemer
 2022-08-09 02:39:37 +05:30
coletdjnz c7dcf0b31e
[extractor/youtube] Add `androidSdkVersion` parameter to Android Innertube clients 
Required to prevent YouTube returning a bad player response in some cases.

See: https://github.com/yt-dlp/yt-dlp/pull/4593, https://github.com/TeamNewPipe/NewPipe/issues/8713, https://github.com/iv-org/invidious/issues/3230, https://github.com/Tyrrrz/YoutubeExplode/issues/647

Authored by: coletdjnz
 2022-08-08 12:03:10 +12:00
Djeson 298d9c0e89
[extractor/ninegag] Extract uploader (#4597) 
Closes #4587
Authored by: DjesonPV
 2022-08-08 01:51:53 +05:30
pukkandan a416623436
[extractor/youtube] Extract more format info 2022-08-08 01:47:07 +05:30
pukkandan b8ed0f15d4
[extractor] Add field `audio_channels` 2022-08-08 01:35:36 +05:30
pukkandan 22b22b7d5c
[extractor/WASDTV:record] Fix `_VALID_URL` 2022-08-07 21:48:40 +05:30
HobbyistDev 1f6b90ed8d
[extractor/tviplayer] Improve `_VALID_URL` (#4585) 
Closes #4578
Authored by: HobbyistDev
 2022-08-07 20:14:28 +05:30
coletdjnz a3e9642116
[extractor/youtube] Prevent redirect to unwanted videos (#4593) 
Example: https://www.youtube.com/watch?v=aQvGIIdgFDM

Authored by: coletdjnz
 2022-08-07 19:13:20 +05:30
pukkandan 43aebb7db4
Bugfix for bfd973ece3 
`_extract_embed_urls` is not a list

Closes #4581
 2022-08-07 03:30:30 +05:30
Yash Kumar 061a17abd3
[extractor/FIFA] Change API endpoint (#4577) 
Closes #4566
Authored by: yashkc2025, Bricio
 2022-08-06 16:43:55 +05:30
HobbyistDev d380fc1614
[extractor/kompas] Add extractor (#4562) 
Authored by: HobbyistDev
 2022-08-05 20:19:45 +05:30
HobbyistDev ad26f15a06
[extractor/vidio] Support embed link (#4564) 
Authored by: HobbyistDev
 2022-08-05 18:36:42 +05:30
Bojidar Qnkov aeaf905e22
[extractor/NovaPlay] Fix extractor (#4415) 
Closes #4439
Authored by: Bojidarist
 2022-08-05 02:27:58 +05:30
Jeff Huffman f62f553d46
[extractor/crunchyroll:beta] Use streams API (#4555) 
Closes #4452
Authored by: tejing1
 2022-08-04 23:35:58 +05:30
pukkandan 4080efeb01
[extractor/vimeo] Bugfix in bfd973ece3 2022-08-04 15:45:47 +05:30
Jeff Huffman b99ba3df09
[extractor/crunchyroll:beta] Extract timestamp and fix tests (#4535) 
Closes #4533
Authored by: tejing1
 2022-08-03 02:48:40 +05:30
coletdjnz a0c830f488
[extractor/youtube] Bump Innertube client versions 
YouTube may be requiring new versions soon. See https://github.com/iv-org/invidious/issues/3230, https://github.com/TeamNewPipe/NewPipe/issues/8713

Authored by: coletdjnz
 2022-08-02 19:02:05 +12:00
Galiley d8657ff76f
[extractor/xfileshare] Add Referer (#4494) 
Authored by: Galiley
 2022-08-02 04:01:51 +05:30
pukkandan 5770293d25
[extractor/orf:radio] Rewrite extractors 
Closes #4522
 2022-08-02 03:59:47 +05:30
pukkandan 0647d9251f
Minor bugfixes 2022-08-02 03:52:23 +05:30
pukkandan be5c1ae862
Standardize retry mechanism (#1649) 
* [utils] Create `RetryManager`
* Migrate all retries to use the manager
* [extractor] Add wrapper methods for convenience
* Standardize console messages for retries
* Add `--retry-sleep` for extractors
 2022-08-02 01:43:18 +05:30
pukkandan bfd973ece3 [extractors] Use new framework for existing embeds (#4307) 
`Brightcove` is difficult to migrate because it's subclasses may depend
on the signature of the current functions. So it is left as-is for now

Note: Tests have not been migrated
 2022-08-02 01:08:16 +05:30
pukkandan 1e8fe57e5c [extractor] Support multiple archive ids for one video (#4307) 
Closes #4352
 2022-08-02 01:08:16 +05:30
pukkandan f14a2d8382 [extractor/html5] Separate into own extractor (#4307) 
Closes #4291

Authored by: coletdjnz, pukkandan
 2022-08-02 01:08:16 +05:30
pukkandan 5fff2e576f [extractor/camtasia] Separate into own extractor (#4307) 
Authored by: coletdjnz
 2022-08-02 01:08:16 +05:30
pukkandan f2e8dbcc00 [extractor, test] Basic framework for embed tests (#4307) 
and split download tests so they can be more easily run in CI

Authored by: coletdjnz
 2022-08-02 01:08:16 +05:30
pukkandan 8f97a15d1c [extractor] Framework for embed detection (#4307) 2022-08-02 01:08:16 +05:30
nixxo 47304e07dc
[extractor/rai] Add raisudtirol extractor (#4524) 
Closes #4206
Authored by: nixxo
 2022-08-02 00:55:48 +05:30
Lesmiscore 565a4c5944
[extractor/YahooJapanNews] Fix extractor (#4480) 
Authored by: Lesmiscore
 2022-08-01 11:47:25 +09:00
pukkandan 2ebe6fefbe
[extractor/yandexmusic] Extract higher quality format 
Closes #4512
 2022-08-01 07:36:08 +05:30
Juhmer Tena e1bd953f45
[extractor/angel] Add extractor (#4410) 
Closes #1243
Authored by: AxiosDeminence
 2022-08-01 05:27:28 +05:30
sqrtNOT 98a60600b2
[extractors/holodex] Add extractor (#4434) 
Closes #726 
Authored by: sqrtNOT, pukkandan
 2022-08-01 05:17:32 +05:30
lazypete365 e325a21a1f
[extractor/youtube] Add `live_status=post_live` (#4495) 
Related: https://github.com/yt-dlp/yt-dlp/issues/1564
Authored by: lazypete365
 2022-08-01 01:42:04 +05:30
pukkandan 31b532a1f2
[cleanup] Misc 2022-07-31 03:35:16 +05:30
pukkandan c646d76f67
[webvtt, extractor/youtube] Extract auto-subs from livestream VODs 
Closes #4130

Authored by: pukkandan, fstirlitz
 2022-07-31 02:20:11 +05:30
pukkandan 07b47084ba
[extractor/youtube] Parse translated subtitles only when requested 
Closes #4274
 2022-07-31 02:20:11 +05:30
ischmidt20 2eae7d507c
[extractor/ESPN] Extract duration (#4499) 
Authored by: ischmidt20
 2022-07-31 02:17:28 +05:30
mpeter50 1cdf69c57e
[extractor/twitch] Extract chapters for single chapter VODs (#4453) 
Closes #4421 
Authored by: mpeter50
 2022-07-30 21:41:27 +05:30
Galiley b6cd135ac2
[extractor/doodstream] Support more domains (#4493) 
Authored by: Galiley
 2022-07-30 17:36:58 +05:30
Anant Murmu befcac11a0
[extractor/stripchat] Fix _VALID_URL (#4491) 
Closes https://github.com/yt-dlp/yt-dlp/issues/4486

Authored by: freezboltz
 2022-07-30 17:05:07 +05:30
haobinliang 7f71cee020
[extractor/cloudflarestream] Fix video_id padding (#4384) 
Fixes https://github.com/ytdl-org/youtube-dl/issues/26640

Authored by: haobinliang
 2022-07-30 16:27:54 +05:30
Elyse db5f248204
[extractor/ina] Improve extractor (#4487) 
Closes #4419
Authored by: elyse0
 2022-07-30 14:21:19 +05:30
coletdjnz 871a8929bc
[extractor/archiveorg] Improve handling of formats (#4461) 
* Ignore private formats if not logged in (fixes https://github.com/yt-dlp/yt-dlp/issues/3832)
* Prefer original formats
* Support mpg formats

Authored by: coletdjnz, pukkandan
 2022-07-29 05:09:36 +00:00
ajj8 edebb65170
[extractor/bbc] Fix news articles (#4472) 
Authored by: ajj8
 2022-07-28 18:30:33 +05:30
pukkandan f640e42ffa
[extractor/arte] Fix title extraction 
Fixes: https://github.com/yt-dlp/yt-dlp/pull/3302#issuecomment-1197568420
 2022-07-28 11:44:24 +05:30
Mehavoid 59f63c8f0f
[extractor/vk] Fix extractor (#4128) 
Closes #4437
Authored by: Mehavoid
 2022-07-28 02:01:03 +05:30
ping bfbb5a1bb1
[extractor/NaverNow] Change endpoint (#4457) 
Authored by: ping
 2022-07-28 00:20:13 +05:30
Felix S 051d6b450c
[extractor/arte] Move to v2 API (#3302) 
Closes #3622, #3502, #3086

Authored by: fstirlitz, pukkandan
 2022-07-28 00:05:39 +05:30
HobbyistDev 67685a541d
[extractor/tempo] Add extractor (#4463) 
Authored by: HobbyistDev
 2022-07-27 17:18:42 +05:30
pukkandan 964b5493a4
Bugfix for f1042989c1 2022-07-27 17:13:04 +05:30
pukkandan f1042989c1
[crunchyroll] Fix language code in _VALID_URLs 
Closes #4451
 2022-07-27 17:10:26 +05:30
ischmidt20 e2884db36a
[extractor/Go] Extract timestamp (#4186) 
Authored by: ischmidt20
 2022-07-26 21:19:40 +05:30
winterbird-code 2c646fe42c
[extractor/hidive] Fix cookie login when netrc is also given (#4447) 
Closes #3336

Authored by: winterbird-code
 2022-07-26 18:52:18 +05:30
pukkandan 693f060040
[youtube,twitch] Allow waiting for channels to become live 
Closes #2597
 2022-07-26 09:33:19 +05:30
Burve 7d0f6f0c45
[extractor/Crunchyroll] Handle missing metadata correctly (#4405) 
Closes #4399

Authored by pukkandan, Burve
 2022-07-26 09:11:52 +05:30
Sipherdrakon 26bafe7028
[extractor/dplay] Add MotorTrend extractor (#4446) 
Authored by: Sipherdrakon
 2022-07-26 09:09:40 +05:30
nixxo 0cd2810379
[extractor/rai] Fix RaiNews extraction (#4380) 
Authored by: nixxo

Closes #3911
 2022-07-24 19:44:26 +05:30
m4tu4g 0f7247f88e
[extractor/zee5] Update Device ID (#4423) 
Closes #4378

Authored by: m4tu4g
 2022-07-24 14:03:39 +05:30
sqrtNOT 2dc4970e08
[extractor/tubi] Exclude playlists from playlist entries (#4416) 
Closes #4409 

Authored by: sqrtNOT
 2022-07-23 11:40:48 +05:30
coletdev 4f08e58655
[extractor/patreon] Fix and improve extractors (#4398) 
* Add workaround for 403s - Fixes https://github.com/yt-dlp/yt-dlp/issues/3631
* Support m3u8 post file videos - Fixes https://github.com/yt-dlp/yt-dlp/issues/2277
* Raise useful error messages - Fixes https://github.com/yt-dlp/yt-dlp/issues/2914
* `--write-comments` support

Authored by: coletdjnz, pukkandan
 2022-07-22 22:23:54 +00:00
sqrtNOT dcbf7394ab
[vgtv] Support tv.vg.no (#4404) 
Closes #4400 
Authored by: sqrtNOT
 2022-07-21 17:53:41 +05:30
Bricio c40f327a16
[extractor/globo:article] Remove false positives (#4396) 
Authored by: Bricio
 2022-07-20 10:07:13 +05:30
pukkandan b79f9e302d
`--compat-option no-live-chat` should disable danmaku 
Closes #4387
 2022-07-19 15:29:28 +05:30
Lesmiscore bc83b4b06c
[extractor/AbemaTVTitle] Implement paging (#4376) 
Authored by: Lesmiscore
 2022-07-18 22:06:54 +09:00
pukkandan 6929b41a21
Remove Python 3.6 support 
Closes #3764
 2022-07-18 06:31:14 +05:30
pukkandan c6e07cf1e1
[cleanup] Misc 2022-07-18 05:14:55 +05:30
pukkandan ce7f6aa660
Fix bug in 2aab569f1c 
Closes #4371
 2022-07-18 05:02:31 +05:30
pukkandan 1765c6039e
[extractor/MangoTV] Fix subtitle languages 
Closes #4315
 2022-07-18 05:02:30 +05:30
pukkandan fbb888a3d5
[extractor/BiliIntl] Fix subtitle extraction 
Closes #4359
Authored by: MinePlayersPE
 2022-07-18 03:11:31 +05:30
Elyse 2aab569f1c
[extractor/wetv] Add extractors (#4330) 
Closes #1115
Authored by: elyse0
 2022-07-18 02:11:33 +05:30
Ehtisham Sabir 2e2c60c4ba
[extractor/wikimedia] Add extractor (#4314) 
Based on https://github.com/ytdl-org/youtube-dl/pull/30796
Authored by: EhtishamSabir, pukkandan
 2022-07-18 01:52:24 +05:30
HobbyistDev 306770819e
[extractor/Netverse] Improve playlist extractor (#3854) 
Authored by: HobbyistDev
 2022-07-18 01:41:17 +05:30
chris dfa6661e0f
[extractor/rtvsl] Add extractor (#2586) 
Authored by: iw0nderhow, pukkandan
 2022-07-18 01:27:30 +05:30
sqrtNOT 956f1cf805
[extractor/philharmoniedeparis] Fix extractor (#4367) 
Closes #4297
Authored by: sqrtNOT
 2022-07-17 16:29:56 +05:30
sqrtNOT 129dfa5f45
[extractor/WSJArticle] Fix video id extraction (#4268) 
Closes #4249
Authored by: sqrtNOT
 2022-07-17 16:04:33 +05:30
pukkandan 3df6a603e4
[extractor/WatchESPN] Improve _VALID_URL 
Closes #4362
Authored by: dirkf, IONECarter
 2022-07-17 05:08:19 +05:30
Pritam Das e3e606de12
[extractor/instagram] Fix post/story extractors (#4074) 
Closes #4343, #3077, #2736, #3002
Authored by: pritam20ps05, pukkandan
 2022-07-15 22:14:43 +05:30
Ferdinand Bachmann 49afc1d84a
[extractor/TubeTuGraz] Add extractor (#2397) 
Based on https://github.com/ytdl-org/youtube-dl/pull/26778
Authored by: Ferdi265, pukkandan
 2022-07-15 16:18:21 +05:30
pukkandan 6edf28081f
[extractor] Passthrough `errnote=False` to parsing 2022-07-15 16:10:47 +05:30
HobbyistDev 5f2da312fa
[extractor/rtl.lu] Add extractor (#4222) 
Closes #1721
Authored by: HobbyistDev
 2022-07-14 11:54:27 +05:30
Tim Weber eb2333bce1
[extractor/StarTrek] Add extractor (#4191) 
Authored by: scy
 2022-07-13 23:59:44 +05:30
u-spec-png 660c0c4efd
[extractor/Trovo] Fix extractor (#4208) 
Authored by: u-spec-png
 2022-07-13 23:46:47 +05:30
Locke fe588ce8ef
[extractor/acfun] Add extractors (#4228) 
Closes #3545
Authored by: lockmatrix
 2022-07-13 23:32:18 +05:30
HobbyistDev 26b92a919d
[extractor/tviplayer] Add extractor (#4281) 
Closes #2134
Authored by: HobbyistDev
 2022-07-13 23:26:57 +05:30
HobbyistDev 8f47b39b27
[extractor/detik] Add extractor (#4284) 
Closes #4283
Authored by: HobbyistDev
 2022-07-13 23:25:45 +05:30
llamasblade 2f1b7afe32
[extractor/hytale] Add extractor (#4326) 
Authored by: llamasblade, pukkandan
 2022-07-13 23:23:22 +05:30
Locke dd634acd71
[extractor/Ximalaya] Fix extractors (#4339) 
Authored by: lockmatrix
 2022-07-13 19:48:03 +05:30
HobbyistDev cbd4f237b4
[extractor/cellebrite] Add extractor (#4333) 
Closes #4014
Authored by: HobbyistDev
 2022-07-13 12:33:18 +05:30
ftk 418bbfd722
[extractor/twitch] Support storyboards for VODs (#4342) 
Authored by: ftk
 2022-07-13 01:57:50 +05:30
ftk 45e8a04e48
[extractor/youtube] More metadata for storyboards (#4334) 
Authored by: ftk
 2022-07-12 20:46:45 +05:30
Dosychev Peter 4e7f375c94
[extractor/theholetv] Add extractor (#4325) 
Authored by: dosy4ev
 2022-07-11 04:48:12 +05:30
pukkandan 56b5b832bf
[extractor/crunchyroll] Improve _VALID_URL 
<http://www.crunchyroll.com/series/GR24PVM76/nichijou-my-ordinary-life>
should be handled by Generic

Closes #4322
 2022-07-11 01:13:32 +05:30
HobbyistDev 65ea4cba29
[extractor/mocha] Add extractor (#4213) 
Closes https://github.com/yt-dlp/yt-dlp/issues/3752
Authored by: HobbyistDev
 2022-07-11 01:02:12 +05:30
Misael Aguayo 17a23f0930
[extractor/syvdk] Add extractor (#4250) 
Closes https://github.com/yt-dlp/yt-dlp/issues/4077
Authored by: misaelaguayo
 2022-07-11 00:52:30 +05:30
pukkandan a3fb1ca5ab
[extractor/youtube] Fix duration check for post-live manifestless mode 2022-07-10 09:59:32 +05:30
Lesmiscore (Naoya Ozaki) 1275aeb955
[extractor/bigo] Fix extractor (#4312) 
Closes #4139

Authored by: Lesmiscore
 2022-07-09 15:00:34 +05:30
ischmidt20 170a031386
[extractor/fifa] Fix extractor (#4272) 
Authored by: ischmidt20
 2022-07-09 13:23:49 +05:30
Felix S 65493f64e1
[extractor/Audiodraft] Add extractors (#4288) 
Based on https://github.com/yt-dlp/yt-dlp/pull/4259
Closes https://github.com/yt-dlp/yt-dlp/issues/4028

Authored by: fstirlitz, Ashish0804
 2022-07-09 13:16:57 +05:30
HobbyistDev 63e66cd0ad
[extractor/liputan6] Add extractor (#4304) 
Closes #4303

Authored by: HobbyistDev
 2022-07-09 09:45:47 +05:30
Andrew 12a1b2254d
[extractor/youtube, cleanup] Fix tests (#4293) 
Authored by: sheerluck
 2022-07-08 02:50:02 +05:30
pukkandan 6154438178
[extractor/generic] Remove HEAD request 2022-07-07 12:09:30 +05:30
pukkandan a3976e0760
Improve chapter sanitization 2022-07-07 11:28:56 +05:30
pukkandan 385f7f3895
[extractor/iq] Set language correctly for Korean subtitles 
Closes #3500
 2022-07-02 19:19:21 +05:30
pukkandan ae61d108dd
[cleanup] Misc cleanup 2022-06-29 06:43:27 +05:30
pukkandan 47046464fa
[extractor] Fix empty `BaseURL` in MPD 
Closes #4113
 2022-06-29 06:43:26 +05:30
nomevi 844086505f
[extractor/livestreamfails] Add extractor (#4204) 
Authored by: nomevi
 2022-06-29 05:41:38 +05:30
FestplattenSchnitzel 1db1461272
[extractor/ViMP] Add playlist extractor (#4147) 
Authored by: FestplattenSchnitzel
 2022-06-29 05:36:25 +05:30
HobbyistDev 5fb450a64c
[extractor/steam] Add broadcast extractor (#4137) 
Closes #4083

Authored by: HobbyistDev
 2022-06-28 18:21:18 +05:30
Abubukker Chaudhary 2c60eae899
[extractor/Scrolller] Add extractor (#4010) 
Closes #3635
Authored by: LunarFang416
 2022-06-28 17:40:43 +05:30
crazymoose77756 962ffcf89c
[cleanup] Fix some typos (#4194) 
Authored by: crazymoose77756
 2022-06-26 17:50:06 -07:00
MMM 8a40bffaf9
[exractor/lbry] Use HEAD request for redirect URL (#4181) 
and misc cleanup 

Authored by: flashdagger
 2022-06-26 17:33:31 -07:00
pukkandan e08f72e675
[extractor/mediaset] Improve `_VALID_URL` 
Fixes https://github.com/yt-dlp/yt-dlp/issues/4141#issuecomment-1166521057
 2022-06-26 18:49:34 +05:30
pukkandan 1685d46007
[extractor/ertflix] Improve `_VALID_URL` 
Closes #4180
 2022-06-26 17:30:01 +05:30
ischmidt20 8d214c484c
[extractor/CWTV] Extract thumbnail (#4185) 
Authored by: ischmidt20
 2022-06-25 17:37:36 -07:00
HobbyistDev 30d22d775b
[extractor/premiershiprugby] Add extractor (#4129) 
Closes #2980
Authored by: HobbyistDev
 2022-06-25 07:43:32 -07:00
pukkandan c043c24625
[extractor] Fix `_create_request` when headers is None 
Closes #4164
 2022-06-25 19:41:22 +05:30
FestplattenSchnitzel 74900105be
[extractor/ViMP] Add thumbnail and support more sites (#4147) 
Authored by: FestplattenSchnitzel
 2022-06-25 19:06:24 +05:30
HobbyistDev d1bf2e199c
[extractor/fuyin] Add extractor (#4151) 
Closes #2871

Authored by: HobbyistDev
 2022-06-25 06:14:58 -07:00
pukkandan 14f25df2b6
[compat] Remove deprecated functions from core code 2022-06-25 00:14:12 +05:30
pukkandan 54007a45f1
[cleanup] Consistent style for file heads 2022-06-25 00:08:58 +05:30
pukkandan ac66811112
[compat] Remove more functions 
Removing any more will require changes to a large number of extractors
 2022-06-25 00:08:55 +05:30
Brett824 06cc8f103b
[extractor/youtube] Mark videos as fully watched (#4146) 
* Also fixes videos appearing as shorts in watch history

Closes #2555
Authored by: Brett824
 2022-06-23 16:30:17 -07:00
Jelle Besseling 34baaced11
[extractor/dropout] Support cookies and login only as needed (#4075) 
Closes #4035
Authored by: pingiun, pukkandan
 2022-06-23 16:21:03 -07:00
pukkandan 9809740ba5
[extractor, cleanup] Reduce direct use of `_downloader` 2022-06-23 09:57:26 +05:30
zenerdi0de 37e40d693b
[extractor/tennistv] Rewrite extractor (#2324) 
Closes #2177
Authored by: zenerdi0de, pukkandan
 2022-06-22 19:01:34 -07:00
pukkandan 0c36dc00d7
[extractor/npr] Implement e50c3500b4 differently 
Closes #4141
 2022-06-23 01:46:49 +05:30
pukkandan 471d0367c7
[youtube:clips] Support downloading clips 
Closes #2543
 2022-06-22 02:50:55 +05:30
pukkandan 3975b4d2e8
Allow extractors to specify section_start/end for clips 2022-06-22 02:44:28 +05:30
pukkandan 95032f302c
[f4m] Bugfix 2022-06-21 13:03:29 +05:30
pukkandan 8102a5991b
[extractor/mediaset] Improve `_VALID_URL` 2022-06-21 13:03:28 +05:30
HobbyistDev c27eaf8920
[extractor/kicker.de] Add extractor (#4073) 
Closes #3670
Authored by: HobbyistDev
 2022-06-21 00:30:43 -07:00
pukkandan dfb855b42d
[extractor/BiliIntl] Fix subtitle extraction 
Closes #3123

Authored by: HobbyistDev
 2022-06-20 14:08:32 +05:30
pukkandan 612f2be5d3
Bugfix for 7b2c3f47c6 2022-06-20 12:03:35 +05:30
pukkandan 6d1b34896e
Update to ytdl-commit-8a158a9 
[NHK] Use new API URL
6508688e88

Closes #2337, Closes #4063
 2022-06-20 11:44:57 +05:30
pukkandan 7b2c3f47c6
[cleanup] Misc 2022-06-20 11:44:55 +05:30
HobbyistDev 695b28afaa
[DailyWire] Add extractors (#4084) 
Closes #3139
Authored by: HobbyistDev, pukkandan
 2022-06-19 20:50:45 -07:00
ischmidt20 0a4fb0d3fe
[WatchESPN] Support free videos and BAM_DTC (#4118) 
Authored by: ischmidt20
 2022-06-19 20:06:37 -07:00
pukkandan 8072ef2bbd
[extractor/BiliIntl] Fix metadata extraction 
Closes #4116
 2022-06-20 03:05:46 +05:30
Elyse 40268a7974
[extractor/foxnews] Update embed extraction (#4043) 
Authored by: elyse0
 2022-06-19 18:59:48 +05:30
HobbyistDev 697ebe4d31
[extractor/ixigua] Add Extractor (#3953) 
Closes #2840
Authored by: HobbyistDev
 2022-06-18 20:48:50 -07:00
bubbleguuum 38d86f4d45
[extractor/radiofrance] Add more radios (#4065) 
Closes #4087 
Authored by: bubbleguuum
 2022-06-18 18:36:14 -07:00
pukkandan f254d6ccd9
[extractor/dropbox] Extract the correct `mountComponent` 2022-06-19 06:46:46 +05:30
coletdev f0bc6e2019
[extractor] Add `default` parameter to `_search_json` (#4057) 
Authored by: pukkandan, coletdjnz
 2022-06-18 17:55:18 -07:00
MMM 9fde8a6b12
[extractor/lbry] Update livestream API (#4042) 
Authored by: flashdagger
 2022-06-18 17:10:22 -07:00
Elyse 612e31f5ea
[extractor/substack] Add extractor (#4011) 
Closes #3722
Authored by: elyse0
 2022-06-18 17:08:53 -07:00
Abubukker Chaudhary 7a2e40dd48
[extractor/MirrorCoUK] Add extractor (#3999) 
Authored by: LunarFang416, pukkandan
 2022-06-18 16:59:57 -07:00
HobbyistDev 60ba603ab5
[extractor/netverse] Add extractors (#3854) 
Authored by: HobbyistDev, pukkandan
 2022-06-19 05:08:45 +05:30
Zhymabek Roman a79cba0c95
[exctractor/digitalconcerthall] Fix extractor (#4105) 
Authored by: ZhymabekRoman
 2022-06-18 23:28:25 +05:30
Lesmiscore 4f2a58c9c5
[extractor/pornhub] Extract `uploader_id` field (#4104) 
Authored by: Lesmiscore
 2022-06-19 00:06:12 +09:00
pukkandan a70635b8a1
[cleanup, utils] Don't use kwargs for `format_field` 2022-06-18 08:13:22 +05:30
christoph-heinrich e121e3cee7
[cleanup] Minor fixes (#4096) 
Authored by: christoph-heinrich
 2022-06-17 18:57:22 -07:00
pukkandan 0df111a371
[youtube] Extract `comment_count` from webpage 
Closes #4091
 2022-06-17 12:00:55 +05:30
pukkandan a39a7ba8d6
[extractor/tiktok] Extract `SIGI_STATE` 
Based on #3624, https://github.com/ytdl-org/youtube-dl/pull/30479

Closes #3551

Authored by dirkf, sulyi, pukkandan
 2022-06-17 11:24:09 +05:30
pukkandan f0c9fb9682
[utils] `Popen`: Refactor to use contextmanager 
Fixes https://github.com/yt-dlp/yt-dlp/issues/3531#issuecomment-1156223597
 2022-06-16 06:23:50 +05:30
pukkandan 560738f34d
[extractor] Import `_ALL_CLASSES` lazily 
This significantly speeds up `import yt_dlp` in the absence of `lazy_extractors`
 2022-06-16 06:23:50 +05:30
pukkandan 99d10bf607
[cleanup, extractor] Rename `extractors.py` to `_extractors.py` 
This should be considered part of the next commit,
but is separated so that `git` can detect the renaming better
 2022-06-16 06:23:49 +05:30
Evan Spensley 145c5a83a8
[extractor/GoogleDrive] Add folder extractor (#4009) 
Closes #3388
Authored by: evansp, pukkandan
 2022-06-14 06:33:29 -07:00
pukkandan e3aae45a6f
[extractor/zdf] Fix bug in 62b2b736e7 
Closes #4061
 2022-06-13 19:13:59 +05:30
pukkandan f3c0c77304
[extractor] Handle `json_ld` with multiple `@type`s 
Closes: #4022
 2022-06-13 19:12:34 +05:30
pukkandan 79e591b59b
[extractor/rumble] Detect JS embed 
Closes #4064
 2022-06-13 19:08:01 +05:30
pukkandan 21a73e9f39
[extractor/generic] Revert e6ae51c123 
85553414ae made it unnecessary
 2022-06-13 18:40:33 +05:30
coletdjnz 4ce05f5759
[extractor/youtube] Fix live chat for videos with content warning 
Fixes #4051
Authored by: coletdjnz
 2022-06-12 17:56:50 +12:00
Lesmiscore 2523702718
[extractor/tver] Fix bug in 6837633a4a 
This corrects a mistake in 64fa820ccf
Authored by: Lesmiscore
Closes #4054
 2022-06-12 12:06:00 +09:00
pukkandan 55baa67c7c
[extractor/jwplatform] Look for `data-video-jw-id` 
Closes #3821
 2022-06-12 03:26:00 +05:30
pukkandan 64fa820ccf
[cleanup] Misc fixes (see desc) 
* [tvver] Fix bug in 6837633a4a - Closes #4054
* [rumble] Fix tests - Closes #3976
* [make] Remove `cat` abuse - Closes #3989
* [make] Revert #3684 - Closes #3814
* [utils] Improve `get_elements_by_class` - Closes #3993
* [utils] Inherit `Namespace` from `types.SimpleNamespace`
* [utils] Use `re.fullmatch` for matching filters
* [jsinterp] Handle quotes in `_separate`
* [make_readme] Allow overshooting last line

Authored by: pukkandan, kwconder, MrRawes, Lesmiscore
 2022-06-12 00:08:16 +05:30
pukkandan 56ba69e4c9
[cleanup] Misc fixes 
Closes #4027
 2022-06-11 05:00:12 +05:30
Aurélien Grosdidier d05460e5fe
[extractor/FranceCulture] Fix extractor (#3874) 
Closes #3742
Authored by: aurelg, pukkandan
 2022-06-10 16:22:34 -07:00
ping 14c3a98049
[extractor/naver] Add `navernow` extractor (#3866) 
Authored by: ping
 2022-06-10 15:38:32 -07:00
Elyse e0a4a3d5bf
[extractor/freetv] Add extractor (#3587) 
Closes #3486
Authored by: elyse0
 2022-06-10 15:34:09 -07:00
Elyse 62b2b736e7
[extractor/zdf] Improve format sorting (#4040) 
Closes #4020

Authored by: elyse0
 2022-06-10 15:22:14 -07:00
Lesmiscore 6837633a4a
[extractor/tver] Fix extractor (#4033) 
Authored by: Lesmiscore
 2022-06-09 23:55:58 +09:00
coletdev 2ae778b8fc
[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args (#3916) 
Allows user to override Innertube API host or key for all requests
Authored by: coletdjnz
 2022-06-08 22:18:01 +00:00
Ashish Gupta c82a4a8fce
[extractor/atscaleconfevent] Add extractor (#3971) 
Closes #3961
Authored by: Ashish0804
 2022-06-07 15:36:46 -07:00
vkorablin 6e7c9201cd
[extractor/ccc] Extract view_count (#3939) 
Authored by: vkorablin
 2022-06-07 15:20:42 -07:00
Angel Toloza bde0132e15
[extractor/southpark] Add `southpark.lat` extractor (#4008) 
Authored by: darkxex
 2022-06-07 15:12:56 -07:00
Daniel Lindholm 0d6bafbfa7
[expressen] Fix extractor (#4006) 
Authored by: aejdl
 2022-06-07 06:00:27 -07:00
MMM 36195c4461
[dash] Show fragment count with `--live-from-start` (#3493) 
Authored by: flashdagger
 2022-06-07 05:44:08 -07:00
coletdjnz 65141660ab
[extractor/youtube] Fix bug in b7c47b7438 
Closes #3997

Authored by: coletdjnz
 2022-06-07 12:26:36 +12:00
pukkandan b7c47b7438
[extractor] Add `_search_json` 
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
 2022-06-06 19:46:45 +05:30
Lesmiscore 0bea4fd807
[extractor/0000studio] Add extractors (#3959) 
Authored by: Lesmiscore
 2022-06-05 14:37:05 +09:00
ischmidt20 b5770743fe
[extractor/espn] Add `WatchESPN` extractor (#2283) 
Authored by: ischmidt20, pukkandan
 2022-06-03 20:02:15 -07:00
pukkandan 1890fc6389
[cleanup] Misc fixes 
Cherry-picks from: #3498, #3947
Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
 2022-06-03 21:45:35 +05:30
pukkandan c4910024f3
[extractor] Fix bug in 617f658b7e 
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only

Closes #3954
 2022-06-03 17:25:20 +05:30
coletdev c7a7baaa13
[extractor/youtube] Fix `:ytnotifications` extractor (#3775) 
Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775

Authored by: coletdjnz
 2022-06-03 07:04:39 +00:00
siddharth ravikumar e50c3500b4
[extractor/npr] Use stream url from json-ld (#3455) 
Closes #1934
Authored by: r5d
 2022-06-02 17:51:11 -07:00
pukkandan 09d02ea429
[extractor] Fix bug in f95b9dee45 
Closes #3951
 2022-06-03 06:16:01 +05:30
sqrtNOT ac05fb9338
[extractor/niconico:series] Fix extractor (#3935) 
Authored by: sqrtNOT
 2022-06-02 09:02:42 -07:00
pukkandan 28786529dc
[extractor/dropout] Login is not mandatory 
Workaround for #3931
 2022-06-01 02:03:25 +05:30
pukkandan 6b0b0a289a
[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries` 2022-06-01 02:03:24 +05:30
pukkandan f95b9dee45
[extractor] Add dev option `--load-pages` 2022-06-01 02:03:22 +05:30
pukkandan 617f658b7e
[extractor, cleanup] Refactor `_download_...` methods 2022-06-01 01:57:16 +05:30
Lesmiscore 9c0412cf6b
[extractor/vevo] Fix extractor (#3921) 
Authored by: Lesmiscore
 2022-06-01 01:10:53 +09:00
gamer191 84131d0351
[extractor/animelab] Remove extractor (#3922) 
https://www.animelab.com/sunset

Authored by: gamer191
 2022-05-31 08:51:22 -07:00
Lesmiscore 1cd6cba306
[extractor/PokemonSoundLibrary] Remove extractor (#3918) 
Authored by: Lesmiscore
 2022-05-31 18:02:29 +09:00
Lesmiscore 661e7253a2
[extractor/iwara:user] Make paging better (#3901) 
Authored by: Lesmiscore
 2022-05-31 10:52:42 +09:00
Lesmiscore 222a230871
[extractor/common] Recognize `src` attribute from HTML5 media elements (#3899) 
Authored by: Lesmiscore
 2022-05-29 22:48:04 +09:00
coletdjnz ee27297f82
[extractor/youtube] Fix initial player response extraction 
Authored by: pukkandan, coletdjnz
 2022-05-29 19:54:22 +12:00
Stefan Borer ee164987c7
[extractor/playsuisse] Add extractor (#845) 
Authored by: sbor23, pukkandan
 2022-05-28 16:44:17 -07:00
pukkandan 0fe51254cb
[extractor/youtube] Bring back `_extract_chapters_from_description` 
Closes #3886
 2022-05-29 01:00:41 +05:30
pukkandan 52023f1291
[extractor/youtube] Make signature extraction non-fatal 
and reduce verbosity of it's warning

Closes #3882
 2022-05-29 00:00:24 +05:30
mozbugbox 5bbe631e04
[extractor/duboku] Fix for hostname change (#3891) 
Authored by: mozbugbox
 2022-05-28 06:35:10 -07:00
miseran 520876fa09
[extractor/zattoo] Fix live streams (#3812) 
Authored by: miseran
 2022-05-27 09:29:19 -07:00
pukkandan 829bbd1d05
[youtube] Add warning for PostLiveDvr 
Closes #3746, Related #1564
 2022-05-27 05:07:00 +05:30
pukkandan 8a82af3511
[cleanup] Misc fixes and cleanup 
Closes #3780, Closes #3853, Closes #3850
 2022-05-27 04:43:43 +05:30
pukkandan 8246f8402b
[spotify:show] Fix extractor 
Closes #3768
 2022-05-27 04:33:03 +05:30
monnef d2ff2c91bb
[curiositystream] Get `auth_token` from cookie (#3836) 
Closes #3753
Authored by: mnn
 2022-05-26 16:02:20 -07:00
m4tu4g 7879e79d11
[bloomberg] Change playback endpoint (#3857) 
Closes #3787
Authored by: m4tu4g
 2022-05-24 02:05:23 -07:00
Lesmiscore 8a3e7b1c95
[yahoo:gyao] Fix extractor 
This fixes 400 error for /title/ URLs.
 2022-05-24 03:01:52 +09:00
Felix S 92922fe7f9
[rumble] Extract subtitles (#3823) 
Closes #3132
Authored by: fstirlitz
 2022-05-21 05:00:32 -07:00
pukkandan c487cf0010
[cleanup] Misc 2022-05-21 16:01:53 +05:30
pukkandan 2762dbb17e
[compat] Add `functools.cached_property` 2022-05-20 21:06:37 +05:30
adamanldo 854b0d325e
[StreamCZ] Fix extractor (#3789) 
Closes #3579
Authored by: dirkf, adamanldo
 2022-05-20 06:19:13 -07:00
Elyse 79c318937b
[ina] Fix extractor (#3807) 
Closes #2463
Authored by: elyse0
 2022-05-20 03:17:32 -07:00
Jeff Huffman 88d62206b4
[crunchyroll:beta] Fix extractor after API change (#3801) 
Closes #2052
Authored by: Burve, tejing1
 2022-05-19 17:37:04 -07:00
pukkandan b801cd7179
[tiktok] Detect embeds 
Closes #3799
 2022-05-20 06:01:08 +05:30
pukkandan 21633673c3
[cleanup] Minor fixes 2022-05-18 09:04:30 +05:30
pukkandan 80e8493ee7
[utils] `is_html`: Handle double BOM 
Closes #2885
 2022-05-18 07:03:50 +05:30
pukkandan aedaa455d9
[vimeo] Fix extractors 
Closes #3037, Closes #2858, Closes #2880, Closes #3712
May also fix #3602, #3360
 2022-05-18 05:16:08 +05:30
pukkandan d6bf1161db
[generic] Refactor `_extract_rss` 
Closes #3738
 2022-05-18 04:17:59 +05:30
pukkandan b2a2d91310
[adobepass] Allow cookies for authenticating MSO 
Possible workaround for #1034
 2022-05-17 00:07:46 +05:30
pukkandan 2414649192
[cleanup] Misc cleanup 2022-05-17 00:07:43 +05:30
pukkandan 5d5c0f7e99
[Hotstar] Bugfix for a1ddaa899c 
Closes #3595
 2022-05-17 00:07:41 +05:30
Dzmitry Neviadomski 3ac7b66047
[goodgame] Add extractor (#3686) 
Authored by: nevack
 2022-05-15 10:05:27 -07:00
P-reducible c9b2b368b3
[rokfin:search] Add extractor (#2992) 
Authored by: P-reducible, pukkandan
 2022-05-15 09:49:19 -07:00
pukkandan e037c405ad
[rokfin] Implement login (#2992) 
Authored by: P-reducible, pukkandan
 2022-05-15 22:17:04 +05:30
Conner 4bf72cc1c9
[Podchaser] Add extractors (#3665) 
Authored by; connercsbn
 2022-05-15 08:53:34 -07:00
Elyse 25f0e68f97
[wat] Fix extraction of multi-language videos and subtitles (#3739) 
Closes #982, closes #1683
Authored by: elyse0
 2022-05-15 05:09:14 -07:00
Elyse 3358f89361
[adn] Update AES key (#3743) 
Closes #2002
Authored by: elyse0
 2022-05-15 04:57:53 -07:00
Henrik Heimbuerger f3b3fe16af
[nebula] Add support for subscriptions (#3719) 
Closes #3609 
Authored by: hheimbuerger
 2022-05-15 04:55:44 -07:00
Jordan Weatherby d1c4f6d4da
[youtube] Added piped instance urls (#3714) 
Closes #3661
Authored by: JordanWeatherby
 2022-05-12 13:52:13 -07:00
pukkandan 82d020804d
[extractor] Use classmethod/property where possible 
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
 2022-05-13 00:23:26 +05:30
Filip Hedman 7ddbf09c25
[DRTV] Improve `_VALID_URL` (#3708) 
Authored by: vertan
 2022-05-12 11:12:01 -07:00
pukkandan 8dcce6a89c
[extractor] Document netrc machines 
Closes #3169
 2022-05-11 22:10:15 +05:30
pukkandan 0f06bcd759
[cleanup] Minor fixes (See desc) 
* [youtube] Fix `--youtube-skip-dash-manifest`
* [build] Use `$()` in `Makefile`. Closes #3684
* Fix bug in 385ffb467b
* Fix bug in 43d7f5a5d0
* [cleanup] Remove unnecessary `utf-8` from `str.encode`/`bytes.decode`
* [utils] LazyList: Expose unnecessarily "protected" attributes
and other minor cleanup
 2022-05-09 17:59:26 +05:30
ca-za d239db0306
[toggo] Improve `_VALID_URL` (#3689) 
Authored by: ca-za
 2022-05-09 04:42:22 -07:00
pukkandan 385ffb467b
[wistia] Fix `_VALID_URL` 
Closes #2866
Authored by: dirkf
 2022-05-09 09:14:21 +05:30
Evan Spensley 5f8ea7e0d8
[Jamendo] Extract more metadata (#3672) 
Authored by: evansp
 2022-05-07 15:48:34 -07:00
MMM 5747d4f4e8
[kaltura] Update API calls (#3657) 
Authored by: flashdagger
 2022-05-07 09:06:05 -07:00
Lesmiscore 1f8b4ab733
[radiko] Fix extractor (#3655) 
Authored by: Lesmiscore
 2022-05-08 00:47:51 +09:00
pukkandan d4736fdb43
Remove warning for videos with an empty title 2022-05-07 19:45:33 +05:30
pukkandan 895aeb71d7
[toggo] Fix `_VALID_URL` 
Closes #2610
 2022-05-07 19:24:04 +05:30
pukkandan 6b70527f9d
[cleanup, zingmp3] Refactor extractors 2022-05-07 18:39:58 +05:30
Teemu Ikonen a0fe51d562
[ruutu] Support hs.fi embeds (#3547) 
Authored by: tpikonen, pukkandan
 2022-05-07 04:24:41 -07:00
diegorodriguezv bd18c5d170
[cleanup, tmz] Update tests (#3654) 
Authored by: diegorodriguezv
 2022-05-07 04:21:55 -07:00
Ha Tien Loi 54044decd0
[ZingMp3] Add chart and user extractors (#3423) 
Authored by: hatienl0i261299
 2022-05-07 03:25:58 -07:00
Ha Tien Loi 89f383c4ee
[gronkh] Add playlist extractors (#3337) 
Closes #3300
Authored by: hatienl0i261299
 2022-05-07 01:44:41 -07:00
pukkandan 91e5e839d3
[youtube] Deprioritize format 22 
Reduces chance of encountering #3372
 2022-05-07 08:05:32 +05:30
FestplattenSchnitzel 10fa2471fc
[VideocampusSachsen] Improve extractor (#3604) 
Authored by: FestplattenSchnitzel
 2022-05-05 10:31:54 -07:00
i6t ff4d7860d5
[iwara] Add playlist extractors (#3639) 
Authored by: i6t
 2022-05-04 08:49:46 -07:00
rand-net 4f7a98c565
[KhanAcademy] Fix extractor (#3462) 
Authored by: rand-net
 2022-05-04 07:26:45 -07:00
Lesmiscore b58f8d8f2c
[TVer] Improve extraction (#3634) 
Authored by: Lesmiscore
 2022-05-04 23:16:56 +09:00
Ha Tien Loi f963b7ab18
[Likee] Add extractor (#3625) 
Closes #3603
Authored by: hatienl0i261299
 2022-05-04 07:13:52 -07:00
pukkandan 86925f6334
[Fifa] Sort formats 
Closes #3632
 2022-05-04 19:07:34 +05:30
m4tu4g 468f104ce7
[masters] Add extractor (#3358) 
Closes #3240
Authored by: m4tu4g
 2022-05-02 14:36:37 -07:00
Bricio cbc6ee10da
[Fifa] Add Extractor (#3414) 
Closes #3408
Authored by: Bricio
 2022-05-02 14:26:28 -07:00
nyuszika7h 6ef5ad9e29
[trovo] Update to new API (#3509) 
Closes #3457
Authored by: nyuszika7h
 2022-05-02 08:13:18 -07:00
HE7086 b4f536626a
[BilibiliLive] Add extractor (#3406) 
Authored by: HE7086, pukkandan
 2022-05-01 19:09:11 -07:00
Marwen Dallel 1a7cd9c487
[LCI] Fix extractor (#3534) 
Authored by: MarwenDallel
 2022-05-01 17:59:48 -07:00
coletdev 6e634cbe42
[youtube] Add YoutubeStoriesIE (#3362) 
Get channel stories with `ytstories:<channel UCID>`

Authored-by: coletdjnz
 2022-05-01 06:46:28 +00:00
pukkandan 3fe75fdc80
[cleanup] Misc fixes (see desc) 
* Do not warn when fixup is skipped for existing file
* [fragment] Fix `--skip-unavailable-fragments` for HTTP Errors
* [utils] write_string: Fix bug in 59f943cd50
* [utils] parse_codecs: Subtitle codec is generally referred to as `scodec`. https://github.com/yt-dlp/yt-dlp/pull/2174#discussion_r790156048
* [docs] Remove note about permissions. Closes #3597
 2022-05-01 04:58:38 +05:30