fea7295b14
[brightcove] relax embed_in_page regex
2016-03-31 10:48:22 +01:00
9cf01f7f30
[nbc] add new extractor for csnne.com( #5432 )
2016-03-31 00:26:42 +01:00
ce548296fe
[cnbc] fix test
2016-03-31 00:25:11 +01:00
c02ec7d430
[cnbc] Add new extractor( closes #8012 )
2016-03-30 23:18:31 +01:00
6b820a2376
[myspace] improve extraction
2016-03-30 21:18:07 +01:00
e621a344e6
[kwuo] Port to new API and enable --cn-verification-proxy
2016-03-31 02:27:52 +08:00
3ae6f8fec1
[kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
...
Following the idea proposed in 19dbaeece3
2016-03-31 02:11:21 +08:00
597d52fadb
[kuwo:song] Correct song ID extraction ( fixes #9033 )
...
Bug introduced in daef04a4e7
2016-03-31 02:00:50 +08:00
afca767d19
[tumblr] Improve _VALID_URL ( Closes #9027 )
2016-03-30 22:26:43 +06:00
6e359a1534
[comcarcoff] don not depend on crackle extractor( closes #8995 )
...
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995 .
2016-03-30 12:27:00 +01:00
33f3040a3e
[YoutubeDL] Fix sanitizing subtitles' url
2016-03-28 03:13:39 +06:00
03442072c0
[pornhub] Fix typo ( Closes #9008 )
2016-03-28 01:21:44 +06:00
c8b13fec02
[foxnews] Restore upload time fields in test
2016-03-28 01:14:12 +06:00
87d105ac6c
[amp] Fix upload timestamp extraction ( Closes #9007 )
2016-03-28 01:13:47 +06:00
3454139576
[pornhub:uservideos] Add support for multipage videos ( Closes #9006 )
2016-03-28 00:50:46 +06:00
3a23bae9cc
[pornhub:playlistbase] Do not include videos not from playlist
2016-03-28 00:32:57 +06:00
8f9a477e7f
[pornhub:playlistbase] Use orderedSet
2016-03-28 00:21:08 +06:00
a1cf3e38a3
[bbc] Extend vpid regex ( Closes #9003 )
2016-03-27 23:22:51 +06:00
a122e7080b
release 2016.03.27
2016-03-27 16:56:33 +02:00
b22ca76204
[extractor/common] Filter out unsupported encrypted media for f4m formats ( Closes #8573 )
2016-03-27 07:42:38 +06:00
f7df343b4a
[downloader/f4m] Extract routine for removing unsupported encrypted media
2016-03-27 07:41:19 +06:00
19dbaeece3
Remove _sort_formats from _extract_*_formats methods
...
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.
Closes #8051
2016-03-27 07:03:08 +06:00
395fd4b08a
[twitter] Handle another form of embedded Vine
...
Fixes #8996
2016-03-27 04:36:02 +08:00
8018028d0f
[pluralsight] Extract chapter metadata ( Closes #8993 )
2016-03-27 02:10:52 +06:00
00322ad4fd
[lynda] Extract chapter metadata ( #8993 )
2016-03-27 02:00:36 +06:00
4cf3489c6e
[vevo] Update videoservice API URL ( Closes #8900 )
2016-03-27 01:11:11 +06:00
b24ab3e341
[udemy] Improve paid course detection
2016-03-27 00:09:12 +06:00
af4116f4f0
[udemy] Improve format_id
2016-03-27 00:02:52 +06:00
f973e5d54e
[udemy] Drop outputs' formats
...
Always results in 403
2016-03-26 23:55:07 +06:00
62f55aa68a
[udemy] Add outputs metadata to view_html formats
2016-03-26 23:54:12 +06:00
02d7634d24
[udemy] Fix outputs' formats format_id
2016-03-26 23:43:25 +06:00
48dce58ca9
[udemy] Use custom sorting
2016-03-26 23:42:46 +06:00
efcba804f6
[udemy] Extract formats from view_html ( Closes #8979 )
2016-03-26 23:42:34 +06:00
6dee688e6d
[youtube:playlistsbase] Restrict playlist regex ( Closes #8986 )
2016-03-26 20:42:18 +06:00
eedb7ba536
[YoutubeDL] Sort imports
2016-03-26 19:40:33 +06:00
dcf77cf1a7
[YoutubeDL] Sanitize final URLs ( Closes #8991 )
2016-03-26 19:37:41 +06:00
17bcc626bf
[utils] Extract sanitize_url routine
2016-03-26 19:33:57 +06:00
b5a5bbf376
[mailru] Extend _VALID_URL ( Closes #8990 )
2016-03-26 19:15:32 +06:00
e68d3a010f
[twitter] Fix extraction ( closes #8966 )
...
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
2016-03-26 18:34:51 +08:00
d10fe8358c
[generic] Add a test case for brightcove embed
...
Closes #8862
2016-03-26 18:30:43 +08:00
d6c340cae5
[brightcove] Extract more formats ( #8862 )
2016-03-26 18:21:07 +08:00
5964b598ff
[brightcove] Support alternative BrightcoveExperience layout
...
The full URL lays in the `data` attribute of <object> (#8862 )
2016-03-26 17:47:32 +08:00
62cdb96f51
release 2016.03.26
2016-03-26 08:58:03 +01:00
6e6bc8dae5
Use urlencode_postdata across the codebase
2016-03-26 02:19:24 +06:00
15707c7e02
[compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
...
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode
Closes #8974
2016-03-26 01:46:57 +06:00
2156f16ca7
[thescene] Fix extraction and improve style ( Closes #8978 )
2016-03-25 20:14:34 +06:00
4db441de72
[once] Relax _VALID_URL ( Closes #8976 )
2016-03-25 19:51:28 +06:00
0be8314dc8
release 2016.03.25
2016-03-25 09:27:18 +01:00
d7f62b049a
[iqiyi] Update enc_key
2016-03-25 15:45:40 +08:00
3bb3356812
[douyutv] Extend _VALID_URL
2016-03-25 15:43:29 +08:00
98e68806fb
[mnet] Improve ( Closes #8958 )
2016-03-25 03:26:29 +06:00
e031768666
[mnet] Add new extractor
2016-03-25 02:32:06 +06:00
5eb7db4ee9
[udemy] Add support for new URL schema
2016-03-25 02:28:39 +06:00
f0e83681d9
[udemy] Extract formats from outputs
2016-03-25 02:27:13 +06:00
ff9d5d0938
[udemy] Improve course enrolling
2016-03-25 02:26:46 +06:00
d041a73674
[extractor/__init__] Add youtube:live and sort youtube extractors alphabetically
2016-03-25 01:39:25 +06:00
f07e276a04
[youtube:live] Add extractor ( Closes #8959 )
2016-03-25 01:18:14 +06:00
993271da0a
[nytimes] Tolerate missing metadata ( Closes #8952 )
2016-03-24 23:28:24 +06:00
369e7e3ff0
[iprima] Fix extraction ( Closes #8953 )
2016-03-24 22:54:26 +06:00
5767b4eeae
[mtv] Fix description extraction ( Closes #8962 )
2016-03-24 22:23:31 +06:00
622d19160b
[utils] Clarify Python versions affected by buggy struct module
2016-03-24 18:06:15 +08:00
32d88410eb
[tumblr] Add a test with Instagram embed
...
Closes #8817
2016-03-24 16:32:53 +08:00
5a51775a58
[generic] Extract Instagram embeds ( #8817 )
2016-03-24 16:32:27 +08:00
87696e78d7
[instagram] Unescape description ( #8817 )
2016-03-24 16:30:01 +08:00
c4096e8aea
[instagram] Extract embed videos ( #8817 )
2016-03-24 16:29:33 +08:00
fc27ea9464
[tumblr] Support Vine embeds ( #8817 )
2016-03-23 23:55:52 +08:00
088e1aac59
[generic] Support Vine embeds ( #8817 )
2016-03-23 23:55:08 +08:00
4333d56494
Merge pull request #8898 from dstftw/fragment-retries
...
Add --fragment-retries option (Fixes #8466 )
2016-03-23 20:12:32 +05:00
882c699296
[tunein] Fix stream data extraction ( Closes #8899 , closes #8924 )
2016-03-23 20:45:39 +06:00
efbed08dc2
[utils] Encode hostnames before passing to urllib
...
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError
Fixes #8890
2016-03-23 22:24:52 +08:00
7da2c87119
Add extractor for thescene.com ( closes #8929 )
2016-03-22 22:17:59 +01:00
c6ca11f1b3
[once] Prevent ads from embedding into m3u8 playlists ( Closes #8893 )
2016-03-22 23:48:05 +06:00
2beeb286e1
[laola1tv] Add support for livestreams ( Closes #8934 )
2016-03-22 22:32:59 +06:00
cc7397b04d
[ceskatelevize] Make m3u8 formats extraction non fatal ( Closes #8933 )
2016-03-22 21:12:29 +06:00
bc5d16b302
[animeondemand] Skip dash for now
2016-03-21 23:37:39 +06:00
85c637b737
[animeondemand] Extract teaser when no full episode available ( #8923 )
2016-03-21 23:35:50 +06:00
5c69f7a479
[animeondemand] Respect startvideo ( Closes #8923 )
2016-03-21 23:31:40 +06:00
ff5873b72d
[motherless] Detect friends only videos
2016-03-21 22:24:42 +06:00
065c4b27bf
[xhamster:embed] Extract vars ( Closes #8912 )
2016-03-21 22:07:34 +06:00
1600ed1ff9
[rutv] Improve flash version pattern ( Closes #8911 )
2016-03-21 21:46:49 +06:00
5886b38d73
Add support for https for all extractors as preventive and future-proof measure
2016-03-21 21:36:32 +06:00
0cef27ad25
Add missing r prefix for _VALID_URLs
2016-03-21 21:22:37 +06:00
12af4beb3e
[mailru] Add support for https ( Closes #8920 )
2016-03-21 21:17:29 +06:00
9016d76f71
[YoutubeDL] Improve _format_note
2016-03-20 22:01:45 +06:00
3c5d183c19
[animeondemand] Extract all formats ( Closes #8906 )
2016-03-20 21:51:22 +06:00
3e8bb9a972
[animeondemand] Detect geo restriction
2016-03-20 20:39:00 +06:00
daef04a4e7
[kwuo] Fix KuwoChartIE and KuwoSingerIE and accept new URL forms
2016-03-20 20:17:56 +08:00
2648918c81
[vlive] Fix creator extraction ( closes #8814 )
2016-03-20 18:15:53 +08:00
9e3c2f1d74
[openload] Misc improvements
...
* Add thumbnail
* Detect errors (#6469 )
* Match more (#6469 , #8489 )
2016-03-20 16:49:44 +08:00
2bfeee69b9
[openload] Add new extractor ( closes #8489 )
2016-03-20 15:54:58 +08:00
664bcd80b9
[tudou] Use InAdvancePagedList ( closes #8884 )
2016-03-20 15:45:31 +08:00
3c20208eff
[francetv] Improve formats extraction
2016-03-20 13:00:46 +06:00
db264e3cc3
[francetvinfo] Add support for france3-regions and strip title ( Closes #7673 )
2016-03-20 12:44:04 +06:00
96a9f22d98
[discovery] Relax _VALID_URL ( Closes #8903 )
2016-03-20 10:26:58 +06:00
40025ee2a3
[postprocessort/ffmpeg] Allow embedding webvtt into webm ( Closes #8874 )
2016-03-20 04:12:34 +06:00
298c04b464
[91porn] Use common messages' wording
2016-03-20 02:35:48 +06:00
d95114dd83
[91porn] Unquote final URL ( Closes #8881 )
2016-03-20 02:34:02 +06:00
fa023ccb2c
[biobiochiletv] Fix extraction, extract m3u8 formats and overall improve ( Closes #7314 )
2016-03-20 01:31:55 +06:00
e36f4aa72b
[biobiotv] Add extractor
2016-03-20 01:29:08 +06:00
f1ced6df51
[cda] Improve and simplify ( Closes #8805 )
2016-03-19 23:17:14 +06:00
8b0d7a66ef
[cda] Add new extractor for cda.pl
...
Fixes #8760
2016-03-19 22:42:40 +06:00
3aec71766d
[safari:api] Separate extractor ( Closes #8871 )
2016-03-19 22:30:48 +06:00
16a8b7986b
[downloader/fragment] Document fragment_retries
2016-03-19 20:54:21 +06:00
617e58d850
[downloader/{common,fragment}] Fix total retries reporting on python 2.6
2016-03-19 20:51:30 +06:00
e33baba0dd
[downloader/dash] Add fragment retry capability
...
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
2016-03-19 20:42:23 +06:00
721f26b821
[downloader/fragment] Add report_retry_fragment
2016-03-19 20:41:24 +06:00
52bb437e41
[options] Add --fragment-retries option
2016-03-19 20:40:36 +06:00
782b1b5bd1
[utils] lookup_unit_table: Match word boundary instead of end of string
2016-03-19 11:44:49 +01:00
0d769bcb78
[extractor/generic] Fix missing byte literal prefix
2016-03-19 05:43:43 +06:00
4cd70099ea
[hbo] Add new extractor
2016-03-18 21:18:18 +01:00
09fc33198a
utils: lookup_unit_table: Use a stricter regex
...
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
2016-03-18 19:23:06 +01:00
d5aacf9a90
Added format_id to the filers on -f.
2016-03-18 23:59:24 +06:00
19e2617a6f
[commonprotocols] Add generic support for rtmp URLs ( Closes #8488 )
2016-03-18 23:42:15 +06:00
edd9b71c2c
[extractor/generic] Add a test for m3u playlist served without proper Content-Type
2016-03-18 22:49:11 +06:00
5940862d5a
[extractor/generic] Detect m3u playlists served without proper Content-Type
2016-03-18 22:45:28 +06:00
de6c51e88e
[extractor/generic] Fix direct link semantics
2016-03-18 22:43:07 +06:00
303dcdb995
[extractor/generic] Simplify upload_date extraction
2016-03-18 22:41:16 +06:00
20938f768b
[extractor/generic] Add another test for generic m3u8
2016-03-18 21:54:33 +06:00
955737b2d4
[extractor/generic] Force Content-Type to lowecase
2016-03-18 21:50:44 +06:00
263eff9537
[extractor/generic] Properly extract format id from Content-Type
...
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
2016-03-18 21:50:10 +06:00
cae21032ab
[theplatform] Improve geo restriction detection
2016-03-18 21:08:25 +06:00
6187091532
[once] check http formats availability
2016-03-18 11:51:34 +01:00
0d33166ec5
release 2016.03.18
2016-03-18 11:43:48 +01:00
87c03c6bd2
[theplatform] remove unnecessary import
2016-03-18 09:43:28 +01:00
4c92fd2e83
[theplatform] always force theplatform to return a smil for _extract_theplatform_smil
2016-03-18 09:22:10 +01:00
e3d17b3c07
[noz] Fix extraction on python 2.6 by means of using compat_xpath
2016-03-18 02:54:27 +06:00
810c10baa1
[utils] Use compat_xpath
2016-03-18 02:52:23 +06:00
57f7e3c62d
[compat] Add compat_xpath
2016-03-18 02:51:38 +06:00
0d0e282912
[animeondemand] Fix typo and improve
2016-03-18 00:13:50 +06:00
85e8f26b82
[animeondemand] Improve extraction
2016-03-18 00:02:34 +06:00
b57fecfddd
[animeondemand] Add test
2016-03-17 23:50:10 +06:00
8c97e7efb6
[animeondemand] Expand episode title regex ( Closes #8875 )
2016-03-17 23:43:14 +06:00
cc162f6a0a
[crunchyroll] Fix custom _download_webpage ( Closes #8883 )
2016-03-17 22:55:04 +06:00
cf45ed786e
[wistia] extract more metadata
2016-03-17 17:48:17 +01:00
574b2a7393
[nbc:nbcnews] improve extraction( fixes #6922 )
...
- extract more metadata and formats
- relax regex
2016-03-17 16:11:29 +01:00
9f02ff537c
[theplatform] extract brightcove once formats
2016-03-17 16:11:29 +01:00
0436ec0e7a
[once] Add new format extractor
2016-03-17 16:11:29 +01:00
11f12195af
[youtube] Added itag 91
...
Seen in https://www.youtube.com/watch?v=jMN4cxyhJjk
2016-03-17 19:25:37 +08:00
a646a8cf98
[sbs] improve extraction( fixes #3811 )
...
- extract error messages
- force the platform smil url(previously the manifest param
in the query is not respected which make theplatform return non working
mp4 files for some videos)
2016-03-17 02:07:06 +01:00
63f41d3821
[bravotv] Add new extractor( #4657 )
2016-03-16 21:26:25 +01:00
c5229f3926
[utils] PEP 8
2016-03-16 21:50:04 +06:00
96f4f796fb
[brightcover] Remove unused import
2016-03-16 21:47:51 +06:00
70cab344c4
[udemy] Improve course id v4 regex
2016-03-16 21:46:09 +06:00
a7ba57dc17
[udemy] Update course id regex to cover v4 layout ( Closes #8753 , closes #8868 , closes #8870 )
2016-03-16 21:45:01 +06:00
83548824c2
Merge pull request #8092 from bpfoley/twitter-thumbnail
...
[utils] Add extract_attributes for extracting html tag attributes
2016-03-16 13:16:27 +01:00
354dbbd880
[brightcove:new] extract protocol-less embed URLs( closes #2914 )
2016-03-16 11:46:53 +01:00
23edc49509
[tv3] Add new extractor( closes #8059 )
2016-03-16 10:47:39 +01:00
48254c3f2c
[brightcove] some improvements and fixes
...
- use FFmpeg downloader to download m3u8 formats extracted
from BrightcoveNew(some of the m3u8 media playlists use AES-128)
- update comment and update_url_query to handle url query
2016-03-16 09:21:07 +01:00
2cab48704c
[thestar] Add new extractor( closes #5955 )
2016-03-15 23:10:31 +01:00
64d4f31d78
[brightcove:new] update embed_in_page embeds regex to match non numeric ref id
2016-03-15 22:50:43 +01:00
remitamine