Simon Sawicki
39d79c9b9c
[utils] Fix `join_nonempty`, add `**kwargs` to `unpack` ( #11559 )
...
Authored by: Grub4K
2024-11-15 22:06:15 +01:00
sepro
197d0b03b6
[cleanup] Misc ( #11347 )
...
Closes #11361
Authored by: avagordon01, bashonly, grqz, Grub4K, seproDev
Co-authored-by: Ava Gordon <avagordon01@gmail.com>
Co-authored-by: bashonly <bashonly@protonmail.com>
Co-authored-by: N/Ame <173015200+grqz@users.noreply.github.com>
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2024-11-04 01:33:21 +01:00
bashonly
b6dc2c49e8
[utils] Allow partial application for more functions ( #11391 )
...
Also adds the `trim_str` traversal helper
Authored by: bashonly, Grub4K
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2024-10-30 21:53:41 +00:00
Simon Sawicki
85b87c991a
[utils] `sanitize_path`: Reimplement function ( #11198 )
...
Authored by: Grub4K
2024-10-13 04:10:12 +02:00
rakslice
8f4ea14680
Fix format sorting bug with vp9.2 vcodec ( #10884 )
...
Authored by: rakslice
2024-09-27 21:32:39 +00:00
bashonly
6daf2c27c0
[utils] `unified_timestamp`: Recognize Sunday ( #10589 )
...
Authored by: bashonly
2024-07-29 05:35:46 +00:00
bashonly
cc0070f649
[utils] `parse_codecs`: Fix parsing of mixed case codec strings
...
Authored by: bashonly
2024-07-14 22:56:28 -05:00
Simon Sawicki
5ce582448e
[core] Disallow unsafe extensions (CVE-2024-38519)
...
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-79w7-vh3h-8g4j
Authored by: Grub4K
2024-07-02 00:58:40 +02:00
sepro
add96eb9f8
[cleanup] Add more ruff rules ( #10149 )
...
Authored by: seproDev
Reviewed-by: bashonly <88596187+bashonly@users.noreply.github.com>
Reviewed-by: Simon Sawicki <contact@grub4k.xyz>
2024-06-12 01:09:58 +02:00
coletdjnz
96a134dea6
[ie/youtube] Extract upload timestamp if available ( #9856 )
...
Closes #4962 , Closes #9829
Authored by: coletdjnz
2024-05-26 21:13:12 +00:00
Simon Sawicki
7e26bd53f9
[core/windows] Fix tests for `sys.executable` with spaces (Fix for 64766459e3
)
...
Authored by: Grub4K
2024-04-28 15:47:55 +02:00
Simon Sawicki
64766459e3
[core/windows] Improve shell quoting and tests ( #9802 )
...
Authored by: Grub4K
2024-04-27 10:37:26 +02:00
Simon Sawicki
ff07792676
[core] Prevent RCE when using `--exec` with `%q` (CVE-2024-22423)
...
The shell escape function now properly escapes `%`, `\\` and `\n`. `utils.Popen` as well as `%q` output template expansion have been patched accordingly.
Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-hjq6-52gw-2g7p for more details.
Authored by: Grub4K
2024-04-09 18:36:13 +02:00
Simon Sawicki
979ce2e786
[test] `traversal`: Separate traversal tests ( #9574 )
...
Authored by: Grub4K
2024-03-30 19:32:07 +01:00
pukkandan
47ab66db0f
[docs] Misc Cleanup ( #8977 )
...
Closes #8355 , #8944
Authored by: bashonly, Grub4k, Arthurszzz, seproDev, pukkandan
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
Co-authored-by: bashonly <bashonly@protonmail.com>
Co-authored-by: Arthurszzz <minecraftgamerarthur@gmail.com>
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>
2024-03-11 00:48:47 +05:30
Simon Sawicki
ffbd4f2a02
[utils] `traverse_obj`: Support `xml.etree.ElementTree.Element` ( #8911 )
...
Authored by: Grub4K
2024-01-05 21:26:17 +01:00
Simon Sawicki
f9fb3ce86e
[cleanup] Misc ( #8598 )
...
Authored by: bashonly, pukkandan, seproDev, Grub4K
Co-authored-by: bashonly <bashonly@protonmail.com>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
2023-12-30 22:27:36 +01:00
coletdjnz
196eb0fe77
[networking] Strip whitespace around header values ( #8802 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/8729
Authored by: coletdjnz
2023-12-20 19:15:38 +13:00
Simon Sawicki
0b6f829b1d
[utils] `traverse_obj`: Move `is_user_input` into output template ( #8673 )
...
Authored by: Grub4K
2023-12-06 21:46:45 +01:00
Awal Garg
9d7ded6419
[utils] `js_to_json`: Fix `Date` constructor parsing ( #8295 )
...
Authored by: awalgarg, Grub4K
2023-10-08 01:57:23 +02:00
Simon Sawicki
088add9567
[cleanup] Misc
...
Authored by: Grub4K
2023-09-24 02:35:23 +02:00
Simon Sawicki
de015e9307
[core] Prevent RCE when using `--exec` with `%q` (CVE-2023-40581)
...
The shell escape function is now using `""` instead of `\"`. `utils.Popen` has been patched to properly quote commands.
Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-42h4-v29r-42qg for reference.
Authored by: Grub4K
2023-09-24 02:29:01 +02:00
bashonly
52414d64ca
[utils] `js_to_json`: Handle `Array` objects
...
Authored by: Grub4K, std-move
Co-authored-by: std-move <26625259+std-move@users.noreply.github.com>
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
2023-09-21 16:51:57 -05:00
pukkandan
3f7965105d
[utils] HTTPHeaderDict: Handle byte values
2023-07-30 03:18:10 +05:30
coletdjnz
4bf912282a
[networking] Remove dot segments during URL normalization ( #7662 )
...
This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process.
Closes #3355 , #6526
Authored by: coletdjnz
2023-07-28 22:40:20 +00:00
bashonly
af86873218
[utils] Improve `parse_duration`
...
Authored by: bashonly
2023-07-20 08:40:31 -05:00
coletdjnz
227bf1a33b
[networking] Rewrite architecture ( #2861 )
...
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.
User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
- Closes https://github.com/yt-dlp/yt-dlp/issues/6325 , https://github.com/ytdl-org/youtube-dl/issues/22618 , https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`
Authored by: coletdjnz
2023-07-15 16:18:35 +05:30
pukkandan
c365dba843
[networking] Add module ( #2861 )
...
No actual changes - code is only moved around
2023-07-15 16:18:34 +05:30
Mahmoud Abdel-Fattah
2af4eeb772
[utils] `clean_podcast_url`: Handle more trackers ( #7556 )
...
Authored by: mabdelfattah, bashonly
Closes #7544
2023-07-11 06:30:38 +05:30
pukkandan
4823ec9f46
Update to ytdl-commit-d1c6c5
...
[YouTube] [core] Improve platform debug log, based on yt-dlp
d1c6c5c4d6
Except:
* 6ed34338285f722d0da312ce0af3a15a077a3e2a [jsinterp] Add short-cut evaluation for common expression
* There was no performance improvement when tested with https://github.com/ytdl-org/youtube-dl/issues/30641
* e8de54bce50f6f77a4d7e8e80675f7003d5bf630 [core] Handle `/../` sequences in HTTP URLs
* We plan to implement this differently
2023-05-24 23:30:43 +05:30
Simon Sawicki
b079c26f0a
[utils] `traverse_obj`: More fixes ( #6959 )
...
- Fix result when branching with `traverse_string`
- Fix `slice` path on `dict`s
- Fix tests and docstrings from 21b5ec86c2
- Add `is_iterable_like` helper function
Authored by: Grub4K
2023-04-30 19:50:22 +02:00
Simon Sawicki
21b5ec86c2
[utils] `traverse_obj`: Allow iterables in traversal ( #6902 )
...
Authored by: Grub4K
2023-04-24 19:56:35 +02:00
Simon Sawicki
0898c5c8cc
[utils] `js_to_json`: Implement template strings ( #6623 )
...
Authored by: Grub4K
2023-03-25 19:41:28 +01:00
Simon Sawicki
6839ae1f6d
[utils] `traverse_obj`: Fix more bugs
...
and cleanup uses of `default=[]`
Continued from b1bde57bef
2023-02-10 19:36:55 +05:30
Simon Sawicki
b1bde57bef
[utils] `traverse_obj`: Fix several behavioral problems
...
See #6180 for further info
Authored by: Grub4K
2023-02-08 04:11:08 +01:00
Simon Sawicki
776995bc10
[utils] `traverse_obj`: Various improvements
...
- Add `set` key for transformations/filters
- Add `re.Match` group names
- Fix behavior for `expected_type` with `dict` key
- Raise for filter function signature mismatch in debug
Authored by: Grub4K
2023-02-02 06:40:19 +01:00
pukkandan
fbb7383306
Add `weba` to known extensions
2022-12-30 15:32:47 +05:30
ChillingPepper
d5f043d127
[utils] js_to_json: Fix bug in f55523c
( #5771 )
...
Authored by: ChillingPepper, pukkandan
2022-12-30 12:08:38 +05:30
Simon Sawicki
a71b812f53
[utils] `js_to_json`: Improve escape handling ( #5217 )
...
Authored by: Grub4K
2022-10-13 01:52:17 +05:30
Matthew
4c9a1a3ba5
[extractor/wordpress:mb.miniAudioPlayer] Add embed extractor ( #5087 )
...
Closes https://github.com/yt-dlp/yt-dlp/issues/4994
Authored by: coletdjnz
2022-10-09 05:55:26 +00:00
Simon Sawicki
7b0127e1e1
[utils] `traverse_obj`: Allow `re.Match` objects ( #5174 )
...
Authored by: Grub4K
2022-10-09 07:01:37 +05:30
Simon Sawicki
f99bbfc983
[utils] `traverse_obj`: Always return list when branching ( #5170 )
...
Fixes #5162
Authored by: Grub4K
2022-10-09 06:57:32 +05:30
Simon Sawicki
ab029d7e92
[utils] `traverse_obj`: Rewrite, document and add tests ( #5024 )
...
Authored by: Grub4K
2022-09-26 02:33:19 +05:30
Elyse
7657ec7ed6
[utils] `base_url`: URL paths can contain `&` ( #4841 )
...
Authored by: elyse0
Closes #4187
2022-09-04 08:39:45 +05:30
pukkandan
8f53dc44a0
[jsinterp] Handle new youtube signature functions
...
Closes #4635
2022-08-14 05:12:32 +05:30
pukkandan
97d9c79e92
Fix tests for 989a01c261
2022-08-05 00:07:05 +05:30
Lauren N. Liberda
fc61aff41b
Determine merge container better (See desc) ( #1482 )
...
* Determine the container early. Closes #4069
* Use codecs instead of just file extensions
* Obey `--prefer-free-formats`
* Allow fallbacks in `--merge-output`
Authored by: pukkandan, selfisekai
2022-08-04 06:12:12 +05:30
nixxo
47304e07dc
[extractor/rai] Add raisudtirol extractor ( #4524 )
...
Closes #4206
Authored by: nixxo
2022-08-02 00:55:48 +05:30
pukkandan
88f60feb32
Fix a904a7f8c6
2022-07-15 21:45:05 +05:30
Lesmiscore
a904a7f8c6
Allow users to specify encoding in each config files ( #4357 )
...
Authored by: Lesmiscore
2022-07-15 20:52:14 +09:00