d8d540cf0d
[nrk] Rework extractor ( Closes #9470 )
2016-05-13 02:07:12 +06:00
0df79d552a
[twitch:bookmarks] Remove extractor
...
Bookmarks no longer available
2016-05-13 00:14:30 +06:00
0db3a66162
[twitch] Skip dead tests
2016-05-12 23:57:52 +06:00
a3fa6024d6
[bloomberg] Fix test_Bloomberg
...
In this test case, sometimes HLS is the best format while sometimes HDS
is. To prevent occasional test failures, force HDS to be the best
format. In the past, testing against HDS formats causes the same error
as #9214 , which is fixed as #9377 landed.
2016-05-12 20:08:42 +08:00
7e8ddca1bb
[vevo] Delay the georestriction check to prevent false alerts
...
Fixes #9408
2016-05-12 19:56:58 +08:00
4540515cb3
[iqiyi] Fix 1080P extraction ( closes #9446 )
2016-05-12 18:48:27 +08:00
edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack
2016-05-10 14:51:38 +08:00
dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py
2016-05-10 14:51:38 +08:00
3951e7eb93
[ceskatelevize] Simplify, restore bonus video test and skip georestricted test ( Closes #9431 )
2016-05-09 20:37:20 +06:00
f1f6f5aa5e
[ceskatelevize] Add support for live streams
...
Live streams has no playlist title, use title of the stream containing
TV channel name. Internal m3u8 handler doesn't seem to handle well
continuous streams. Add test for live stream. Remove no longer
reachable test.
2016-05-09 18:58:15 +06:00
c52f4efaee
[mva] Improve _VALID_URLs
2016-05-08 20:10:20 +06:00
f23a92a0ce
[mva] Add extractor ( Closes #6667 )
2016-05-08 20:02:54 +06:00
3b01a9fbb6
[litv] Add new extractor
...
LiTV is a streaming platform providing free and paid legal contents in
Taiwan.
2016-05-08 14:34:38 +08:00
93fdb14177
don't use selection by attribute
2016-05-08 10:33:17 +09:00
370d4eb8ad
use stricter file selector
...
in case of empty in case of empty ./track/video/file entries
2016-05-08 10:02:48 +09:00
3452c3a27c
update tests
2016-05-08 10:02:19 +09:00
9c072d38c6
[arte] Improve language preference ( Closes #9401 , closes #9162 )
2016-05-08 06:52:42 +06:00
81f35fee2f
fix extractors.py import order
2016-05-08 08:57:16 +09:00
0fdbe3146c
use dict.get in case upload_date does not exist
2016-05-08 08:56:22 +09:00
a0904c5d80
[telegraaf] Fix extractor ( closes #9318 )
2016-05-08 00:56:31 +08:00
cb1fa58813
[flickr] Extract uploader URL ( Closes #9426 )
2016-05-07 20:15:40 +06:00
3fd6332c05
[flickr] extract license field( closes #9425 )
2016-05-07 15:13:14 +01:00
401d147893
Merge pull request #9400 from inondle/master
...
[liveleak] Adds support for thumbnails and updates tests
2016-05-06 19:23:31 +00:00
e2ee97dcd5
[liveleak] Adds support for thumbnails, updates tests
2016-05-06 12:05:37 -07:00
f745403b5b
[vevo] Revert videoplayer.vevo.com to api.vevo.com
2016-05-06 23:37:17 +06:00
3e80e6f40d
[vevo] Allow request to api.vevo.com to fail ( Closes #9417 )
...
I don't know whether this it's tempopary or api has just gone
2016-05-06 23:35:58 +06:00
25cb7a0eeb
[youtube] Allow empty attribute values in description regex
2016-05-06 22:11:18 +06:00
04e88ca2ca
[vk] improve extraction( fixes #7976 )
2016-05-06 15:02:40 +01:00
8d93c21466
add multi_video test case
2016-05-06 12:08:43 +09:00
1dbfd78754
fix multi_video part naming, add upload_date field
2016-05-06 12:07:29 +09:00
22e35adefd
use url instead of single formats entry
2016-05-06 10:41:30 +09:00
6f59aa934b
[periscope:user] Add new extractor for user pages
...
Closes #9388
2016-05-06 02:14:39 +08:00
833b644fff
use xpath_text
2016-05-06 01:24:02 +09:00
915620fd68
[redtube] PEP 8
2016-05-05 21:34:06 +06:00
ac12e888f9
[redtube] Extract all formats, duration, upload date and view count ( Closes #9397 )
2016-05-05 21:02:54 +06:00
7d08f6073d
[kuwo:category] Update test
2016-05-05 20:20:26 +08:00
758a059241
[dailymail] Add new extractor( closes #2667 )
2016-05-05 13:13:22 +01:00
4f8c56eb4e
[fczenit] Fix extraction and update test
...
Closes #9359
2016-05-05 17:55:37 +08:00
57cf9b7f06
[afreecatv] Add new extractor for afreecatv.com VODs
2016-05-05 03:59:23 +09:00
9da526aae7
[yandexmusic:playlist] Update test
2016-05-04 23:18:48 +06:00
75b81df3af
[udemy] Modernize
2016-05-04 23:14:12 +06:00
aabdc83d6e
[udemy] Fix course enroll ( Closes #9393 )
2016-05-04 23:03:44 +06:00
2a48e6f01a
[yandexmusic:playlist] Respect track order for long (>150) playlists
2016-05-04 22:45:01 +06:00
203a3c0e6a
[yandexmusic:playlist] Make title optional
2016-05-04 22:35:28 +06:00
d36724cca4
[yandexmusic:playlist] Remove unused imports
2016-05-04 22:34:37 +06:00
15fc0658f7
[yandexmusic:playlist] Modernize
2016-05-04 22:33:29 +06:00
e960c3c223
[yandexmusic:playlist] Improve extraction ( Closes #6801 )
2016-05-04 22:25:39 +06:00
bc7e77a04b
[vevo] Use raise_geo_restricted
2016-05-03 23:18:36 +06:00
964f49336f
[aol] Improve _VALID_URL ( Closes #9381 )
2016-05-03 21:24:51 +06:00
57d8e32a3e
[xfileshare] Add support for streamin.to
2016-05-03 16:58:11 +06:00
4174552391
[xfileshare] Refactor _VALID_URL and remove ded sites
2016-05-03 15:35:32 +06:00
80bc4106af
[xfileshare] Add support for thevideobee.to ( Closes #9374 )
2016-05-03 15:09:23 +06:00
7759be38da
[xiami] Detect georestriction and skip tests
2016-05-03 16:19:43 +08:00
a0a309b973
[kuwo:category] Fix description and update test
2016-05-03 16:06:28 +08:00
8a92e51c60
[extractor/common] Relax wording for creator metafield
2016-05-02 21:31:35 +06:00
df5f4e8888
[vevo] Remove superfluous code
2016-05-02 18:47:35 +06:00
5c9ced9504
[vevo] Improve genre extraction
2016-05-02 18:19:00 +06:00
686cc89634
[discovery] Fix typo
2016-05-02 07:07:35 +06:00
9508738f9a
[vevo] Extract featured artist
2016-05-02 03:36:40 +06:00
78a3ff33ab
[vevo:playlist] Add fallback for playlist id
2016-05-02 03:29:48 +06:00
881dbc86c4
[vevo] Extract track related metafields and add artists to title ( Closes #1684 )
2016-05-02 03:28:58 +06:00
8e7d004888
[vevo] Add test for video only available via webpage
2016-05-02 03:06:48 +06:00
9618c44824
[vevo] Extract video versions from webpage as a last resort ( Closes #8426 , closes #9366 )
2016-05-02 02:58:20 +06:00
516ea41a7d
[vevo] Fix _call_api
2016-05-02 02:54:50 +06:00
e2bd301ce7
[vevo:playlist] Fix genre playlists
2016-05-02 01:00:42 +06:00
0c9d288ba0
[vevo:playlist] Remove debug params
2016-05-02 00:50:31 +06:00
e0da32df6e
[vevo:playlist] Add extractor ( Closes #9334 , closes #9364 )
2016-05-02 00:48:26 +06:00
68bb2fef95
[tagesschau] Restrict playlist entry regex
2016-05-01 07:15:23 +06:00
854cc54bc1
[tagesschau] Expand video id
2016-05-01 07:01:55 +06:00
651ad35ce0
[tagesschau] Relax _VALID_URL
2016-05-01 06:57:19 +06:00
6a0f9a24d0
[tagesschau] Separate player extractor
2016-05-01 06:45:44 +06:00
9cf79e8f4b
[ccc] improve extraction
2016-05-01 01:45:17 +01:00
2844b09336
[tagesschau] Fix article media ids
2016-05-01 04:42:05 +06:00
1a2b377cc2
[tagesschau] Fix audio support
2016-05-01 04:38:46 +06:00
4c1b2e5c0e
[tagesschau] Add support for playlists
2016-05-01 04:18:56 +06:00
9e1b96ae40
[rtlnl] Match formats only by height
2016-05-01 03:20:36 +06:00
fc35cd9e0c
[tagesschau] Relax _VALID_URL
2016-05-01 02:56:32 +06:00
339fe7228a
[tagesschau] Update _FORMATS map
2016-05-01 02:56:32 +06:00
ea7e7fecbd
[discovery] remove unused imports
2016-04-30 21:55:28 +01:00
d00b93d58c
[discovery] extract more info using BrightcoveNewIE
2016-04-30 21:49:32 +01:00
93f7a31bf3
[discovery] extract subtitle
2016-04-30 20:51:32 +01:00
33a1ec950c
[discovery] extract http formats
2016-04-30 20:51:32 +01:00
4e0c0c1508
[xiami] Improve extraction ( Closes #9079 )
...
* Switch to JSON source
* Add abstract IE for playlists
* Extract more track related metadata
2016-04-30 21:50:23 +06:00
89c0dc9a5f
[xiami] Add xiami extractor
2016-04-30 21:48:40 +06:00
f628d800fb
[ted] add support for youtube embeds and update tests
2016-04-30 16:34:57 +01:00
11fa3d7f99
[ted] extract all http formats
2016-04-30 15:44:30 +01:00
d41ee7b774
[vlive] Pass Referer as bytestring ( Closes #9352 )
2016-04-30 19:22:42 +06:00
e0e9bbb0e9
[pbs] extract srt and vtt subtitles
2016-04-30 14:02:17 +01:00
7691184a31
[pbs] remove duplicate format
2016-04-30 12:57:30 +01:00
35cd2f4c25
[pbs] extract only the formats that we know that they will be available as http format
...
https://projects.pbs.org/confluence/display/coveapi/COVE+Video+Specifications
2016-04-30 11:32:13 +01:00
350d7963db
[pbs] fix the least bitrate http url construction
2016-04-30 11:12:11 +01:00
cbc032c8b7
[pbs] extract all http formats
2016-04-30 01:24:36 +01:00
69c4cde4ba
[wsj] improve extraction
2016-04-29 21:37:05 +01:00
ca278a182b
[rtlnl] Replace test
2016-04-30 02:07:29 +06:00
373e1230e4
[rtlnl] Clarify tests
2016-04-30 01:50:26 +06:00
cd63d091ce
[rtlnl] Fix tests
2016-04-30 01:48:14 +06:00
0571ffda7d
[rtlnl] Improve extraction ( Closes #9329 )
...
* Make hls extraction non fatal and revert ext
* Extract progressive formats' metadata from corresponding hls formats
2016-04-30 01:43:39 +06:00
5556047465
[rtlnl] Update 720p PG_URL_TEMPLATE
...
- Fixed the format_id for the 720p progressive videostream and added the video's resolution.
- The adaptive videostreams have the m3u8-extension, so I removed the confusing mp4-extension in order to make a better distinction between the these and the progressive videostreams.
2016-04-30 01:43:13 +06:00
65a3bfb379
[dfb] extract m3u8 formats
2016-04-29 19:21:17 +01:00
cef3f3011f
[funimation] Detect blocking and support CloudFlare cookies
2016-04-30 00:17:09 +08:00
e9c6cdf4a1
[common] Fix format_id construction for HLS
2016-04-29 22:50:16 +08:00
00a17a9e12
[crunchyroll] Sort formats
2016-04-29 19:44:10 +06:00
8312b1a3d1
[crunchyroll] Add even more relaxed fmt fallback
2016-04-29 19:43:53 +06:00
6ff4469528
[crunchyroll] Relax fmt regex
2016-04-29 19:39:27 +06:00
68835d687a
Merge branch 'Kagami-vlive-hls'
2016-04-29 19:30:51 +08:00
9d186afac8
[vlive] Coding style and PEP8
2016-04-29 19:29:50 +08:00
151d98130b
Merge branch 'vlive-hls' of https://github.com/Kagami/youtube-dl into Kagami-vlive-hls
2016-04-29 19:26:39 +08:00
b24d6336a7
[vlive] Add support for live videos
2016-04-29 14:22:50 +03:00
065216d94f
[crunchyroll] reduce requests for formats extraction
2016-04-29 11:46:42 +01:00
67167920db
[viewlift] replace SnagFilms extractors
...
- add support for other sites that use the same logic
- improve format extraction and sorting
2016-04-29 11:24:10 +01:00
14638e2915
[sexykarma] Rename to WatchIndianPornIE and fix extraction
2016-04-29 18:17:08 +08:00
1910077ed7
Revert "[sexykarma] Remove the extractor"
...
This reverts commit 31ff3c074e
2016-04-29 17:59:23 +08:00
5819edef03
[ooyala] Skip an invalid test
...
Ooyala is used by lots of extractors and its correctness can be verified
by these websites.
2016-04-29 14:27:15 +08:00
f5535ed0e3
[orf] Skip the expired test
2016-04-29 14:24:07 +08:00
31ff3c074e
[sexykarma] Remove the extractor
...
Its domain name is on sale.
Closes #9317
2016-04-29 13:36:52 +08:00
72670c39de
[arte:+7] Fix typo in _VALID_URL
2016-04-29 04:46:23 +06:00
683d892bf9
[viewster] Remove unused import
2016-04-29 01:30:53 +06:00
497971cd4a
[yandexmusic] Clarify blockage even more
2016-04-29 01:28:07 +06:00
e757fb3d05
[crunchyroll] improve extraction
...
- extract more metadata(series, episode, episode_number)
- reduce duplicate requests for extracting formats
- remove duplicate formats
2016-04-28 18:42:20 +01:00
0ba9e3ca22
[viewster] extract formats for videos with multiple audios/subtitles
2016-04-28 17:45:09 +01:00
4b53762914
[yandexmusic] Clarify blockage
2016-04-28 21:45:33 +06:00
eebe6b382e
[yandexmusic] Improve error handling
2016-04-28 21:37:34 +06:00
0cbcbdd89d
[nuvid] Fix extraction
...
Closes #7620
2016-04-28 17:51:20 +08:00
7f776fa4b5
[yandexmusic] Skip tests as Travis CI blocked
2016-04-28 17:08:41 +08:00
a5941305b6
[mwave] Coding style
2016-04-28 16:03:08 +08:00
f8dddaf456
Merge branch 'mwave-meetgreet' of https://github.com/pmrowla/youtube-dl into pmrowla-mwave-meetgreet
2016-04-28 15:56:32 +08:00
618c71dc64
[cloudy] New domain name for the test_cloudy_1
...
I'm sure whether videoraj.ch still works or not, so keep it.
2016-04-28 15:46:00 +08:00
52af8f222b
[cwtv] Relax _VALID_URL ( Closes #9327 )
2016-04-28 04:01:21 +06:00
3cc8649c9d
[20min] Detect embedded YouTube videos
...
Fixes #9331
2016-04-28 02:58:11 +08:00
dcf094d626
[theplatform] Fix for Python 3.2
...
test_AENetworks{,_1} fails as in Python < 3.3, binascii.a2b_* functions
accepts only bytes-like objects
2016-04-27 18:35:33 +08:00
5b5d7cc11e
[mwave] Add Mwave Meet & Greet extractor
2016-04-27 15:57:17 +09:00
2ac2cbc0a3
[malemotion] Remove the extractor
...
Announcement from their homepage:
```
MaleMotion is closed
After another system crash, I'm forced to close the site
This week all content will be erased
Don't forget to cancel your subscription if any !
```
Closes #9311 .
2016-04-27 13:55:32 +08:00
a7e03861e8
[scivee] Skip the test
...
Not accessible from either Travis CI or my machine.
Closes #9315
2016-04-27 13:52:04 +08:00
175c2e9ec3
[youtube:search_url] Reimplement in terms of youtube:playlistbase
2016-04-26 22:29:29 +06:00
f1f879098a
[viewster] extract more metadata for http formats
2016-04-26 13:40:40 +01:00
c9fd530670
[ok] Extract start time
2016-04-25 22:15:15 +06:00
749b0046a8
[ok] Allow embeds without title ( Closes #9303 )
2016-04-25 22:05:47 +06:00
e3de3d6f2f
[normalboots] Fix extraction
...
Now it's using ScreenwaveMedia
2016-04-25 23:49:12 +08:00
ad58942d57
[muzu] Remove extractor
...
MUZU is shutting down in October 2015. [1]
[1] http://www.musicbusinessworldwide.com/youtube-rival-muzu-is-heading-into-liquidation/
2016-04-25 23:35:05 +08:00
4645432d7a
[eagleplatform] Checking direct HTTP links
...
Sometimes they fail with 404
2016-04-25 22:48:17 +08:00
6bdc2d5358
[mitele] Comment out unstable MD5
...
Also Akamai f4f fragments
2016-04-25 22:27:25 +08:00
2beff95da5
[nrk] Comment out unstable MD5 checksums
...
Both are Akamai f4f fragments.
2016-04-25 22:26:19 +08:00
abc1723edd
[unistra] Sort formats
...
Originally URLs are passed to set() and not sorted, so the result is not
deterministic, causing occasional FAILs on Travis CI.
2016-04-25 22:24:40 +08:00
d6712378e7
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv
2016-04-25 21:02:02 +08:00
fb72ec58ae
[extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge
2016-04-25 13:37:03 +01:00
c83a352227
[openload] Make thumbnail optional
2016-04-25 00:26:06 +06:00
e9063b5de9
[openload] Add test
2016-04-25 00:22:55 +06:00
594b0c4c69
[openload] Fix ext extraction
2016-04-25 00:03:29 +06:00
a1394b820d
[openload] Fix title extraction ( Closes #9298 )
2016-04-25 00:01:37 +06:00
aa9dc24f5a
[douyutv] Improve extraction and update tests
...
The JSON API sometimes return HTML pages with errors
2016-04-24 23:52:17 +08:00
51762e1a31
[xminus] Fix extraction ( closes #9228 )
2016-04-24 23:21:45 +08:00
a82398bd72
[kwuo:song] Fix extraction and update the test
2016-04-24 22:20:45 +08:00
c14dc00df3
[viewster] improve http formats extraction
2016-04-24 14:34:28 +01:00
03dd60ca41
[kuwo:category] Fix the test
...
Sometimes there are 24 songs and sometimes 30 lol
2016-04-24 21:16:06 +08:00
0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc
2016-04-24 20:46:06 +08:00
a956cb6306
[onionstudios] Fix description extraction
...
\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537 )
2016-04-24 20:41:17 +08:00
a8062eabcd
[mwave] Skip checking unstable MD5
...
On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081 ) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc
2016-04-24 20:05:24 +08:00
2a7dee8cc5
[yahoo] Improve error detection and update tests
2016-04-24 18:12:16 +08:00
d9ed362116
[yahoo] Extract all <iframe>s
...
Fixes test_yahoo_6
(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html )
2016-04-24 17:46:25 +08:00
4f54958097
[yahoo] Update some tests
...
One has new fields as ThePlatformIE changed, and others have changed
files.
2016-04-24 17:29:01 +08:00
2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
...
Closes #9271
2016-04-24 17:01:18 +08:00
949b6497cc
[generic] Unescape the video URL
...
Fixes #9279
2016-04-24 16:25:37 +08:00
fda9a1ca9e
[viewster] simplify qualities_basename regex
2016-04-24 03:06:46 +01:00
864d5e7231
[viewster] extract all http formats
2016-04-24 02:32:56 +01:00
5448b781f6
[dplay] Sign unsigned final download hls URLs
2016-04-23 17:28:45 +06:00
e239413fbc
[dplay] Extract subtitles ( Closes #9284 )
2016-04-23 16:50:31 +06:00
fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests
2016-04-23 16:36:17 +06:00
397ec446f3
[dplay] Try secure api for no tld ( Closes #9282 )
2016-04-23 15:59:30 +06:00
14f7a2b8af
[WDRMaus] switch current show to new WDR extractor ( fixes #8562 )
...
It seems that the "current show" already uses the new WDR video-player,
while all the others videos still use the old player.
I just added the current show URL to the normal WDR-extractor, which
works fine. This commit needs my changes from PR #8842 that fix the
support for WDR.
2016-04-23 11:53:22 +02:00
c0837a12c8
[WDR] complete overhaul after relaunch of the site
...
The WDR relaunched their site on 2016-02-23 which not only changed the
URL-schema completely but also the layout of their pages.
Apparently the whole "mediathek" now runs on the wdr-domain, so no
separate URL for funkhauseuropa anymore.
There seems to be no explicit handling of video-sizes on the page or in
the URLs anymore. There seems to be only one size for HTML5, but still
several sizes for flash. The extractor adds all to the list of formats.
There is no metadata for the HTML5-stream, so that the best flash-stream
will always be considered as the "best" format. At least in my tests
this seemed to be true anyway.
2016-04-23 11:42:18 +02:00
29a7e8f6f8
[nhl] Add new extractor( closes #8419 )( closes #8798 )
2016-04-22 20:18:27 +01:00
eb01e97e10
[youku] Skip streams with channel_type=tail
...
Fixes #9275
These video segments look like ads and they don't appear in the web
player.
2016-04-23 02:54:09 +08:00
cb7d4d0efd
[nbc] add support for today.com( closes #2909 )
2016-04-22 18:08:20 +01:00
c80037918b
[iqiyi] Improve error detection ( #9276 )
2016-04-23 00:06:49 +08:00
237a41108a
[eagleplatform] extract all http formats
2016-04-22 14:32:38 +01:00
e962ae15d3
[newstube] extract http formats( closes #9253 )
2016-04-22 11:26:43 +01:00
7c36ea7d54
[rtbf] improve extraction( fixes #9267 )
2016-04-21 22:52:49 +01:00
9260cf1d97
[tubitv] fix extraction( closes #8741 )
2016-04-21 20:30:19 +01:00
bdbb8530c7
[vimeo] Pass Referer for check-password request
2016-04-22 00:02:39 +06:00
09a9fadb84
[dump] Remove extractor
2016-04-21 23:31:34 +06:00
88296ac326
[planetaplay] Remove remainings of extractor
2016-04-21 22:57:38 +06:00
6577112890
[planetaplay] Remove extractor ( Closes #9256 )
2016-04-21 22:33:54 +06:00
1988647dda
[tvigle] Skip hls completely ( #9259 )
2016-04-21 22:15:20 +06:00
a292cba256
[mgtv] Fix _VALID_URL and add localized name
2016-04-22 00:07:43 +08:00
982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking
2016-04-22 00:07:43 +08:00
748e730099
[dispeak] Several fixes
2016-04-22 00:07:43 +08:00
1da19488f9
[mgtv] Add new extractor ( closes #9212 )
2016-04-21 23:29:51 +08:00
442c4d361f
[dispeak/gdcvault] Add the test case from #5784
2016-04-21 19:47:10 +08:00
ec59d657e7
[dispeak] Add new extractor
...
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
2016-04-21 19:36:33 +08:00
99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
...
Fixes #9248
2016-04-21 18:07:03 +08:00
4dccea8ad0
[streetvoice] Fix extraction
...
The old API results in URLs with HTTP 403 from time to time.
Hopefully fixes #9219 .
2016-04-21 13:07:53 +08:00
2c0d9c6217
[extractor/common] Allow empty post data
2016-04-21 13:06:06 +08:00
12a5134596
[tvigle] Fix extraction ( Closes #9259 )
2016-04-20 23:52:41 +06:00
16e633a5d7
[quickvid] Remove extractor ( Closes #9258 )
2016-04-20 23:29:02 +06:00
494ab6db73
[youtube] Capture and output login error message
2016-04-20 22:14:32 +06:00
107701fcfc
[people] Remove bogus comment
2016-04-20 03:40:02 +06:00
f77970765a
[people] Add extractor
2016-04-20 03:37:23 +06:00
241a318f27
[vimeo] Improve _VALID_URL ( Closes #9229 )
2016-04-18 21:40:28 +06:00
4fdf082375
[theonion] Remove extractor ( Closes #9220 )
...
It now uses generic onionstudios embed
2016-04-17 23:12:23 +06:00
1b6182d8f7
[youtube:playlist] Fetch all the videos in a mix ( fixes #3837 )
...
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
2016-04-17 17:07:57 +02:00
7bab22a402
[vice] remove unused import and variable
2016-04-17 14:06:19 +01:00
0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
...
In r'pl=\d+&play=\d+' pages, several metadata items are missing
Closes #9222 .
2016-04-17 17:24:33 +08:00
b1cf58f48f
[musicplayon] Fix extraction ( closes #9222 )
2016-04-17 15:08:51 +08:00
bbb3f730bb
[onionstudios] extract m3u8 formats
2016-04-16 20:53:13 +01:00
21525bb8ca
[kuwo:category] Update the test
...
Now the webpage says there are 24 songs.
2016-04-17 02:38:05 +08:00
d8f103159f
[nerdist] Remove extractor
...
It now uses brightcove
2016-04-17 00:16:31 +06:00
663ee5f0a9
[vice] extract youtube embed
2016-04-16 17:49:39 +01:00
b6b950bf58
[cbs] Remove unused import
2016-04-16 22:47:10 +06:00
11e60fcad8
[extractor/generic] Improve instagram embeds ( Closes #9213 )
2016-04-16 22:39:20 +06:00
c23533a100
[instagram] Add support for iframe embeds
2016-04-16 22:31:05 +06:00
0dafea02e6
[instagram] Add support for embed URLs
2016-04-16 22:23:08 +06:00
5d6360c3b7
[mooshare] Remove extractor
2016-04-16 21:31:50 +06:00
5e5c30c3fd
[mdr] Fix extraction and update tests
...
It's strange that the date is changed. Anyway, new data matches what the
webpage says.
2016-04-16 21:57:28 +08:00
9154c87fc4
[huffpost] Fix a typo
2016-04-16 21:41:22 +08:00
ef0e4e7bc0
[generic] Fix test_Generic_2
...
Now a HEAD request returns 400 Bad Request
2016-04-16 19:44:45 +08:00
67d46a3f90
[ustream] Fix /embed/ URLs and add a test
2016-04-16 19:39:25 +08:00
bec47a0748
[tudou] Improve error detection ( closes #9175 )
2016-04-16 19:11:25 +08:00
36b7d9dbfa
[twitter] Don't check /cards/ URLs
...
Fixes #9181
In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
This is the real video and can be handled by TwitterCardIE
In all current test_Twitter* tests, /videos/tweet/ approach works fine.
2016-04-16 18:57:50 +08:00
8c65e4a527
[bbc] Fix a test
2016-04-16 18:00:19 +08:00
6ad2ef8b7c
[audiomack] Update the test
...
The original test raises 404
2016-04-16 17:54:39 +08:00
00b426d66d
[varzesh3] Add md5 to the test
2016-04-16 17:41:56 +08:00
0de968b584
[newgrounds] Support videos ( closes #9138 )
2016-04-16 17:41:56 +08:00
0841d5013c
[cbs] do not catch Exceptions raised by by _extract_theplatform_smil
2016-04-16 10:25:59 +01:00
a71fca8577
[theplatform] remove _sort_formats from _extract_theplatform_smil
2016-04-16 10:23:56 +01:00
ee94e7e66d
[varzesh3] Fix metadata extraction ( closes #9197 )
2016-04-16 17:13:22 +08:00
759e37c9e6
[gazeta] Relax _VALID_URL and update tests
...
Closes #9196
2016-04-16 16:48:47 +08:00
ae65567102
[eagleplatform] Fix error handling
2016-04-16 16:47:16 +08:00
c394b4f4cb
[puls4] Fix error detection ( #9194 )
2016-04-16 16:22:44 +08:00
260c7036ba
[sportbox] Fix SportBoxEmbedIE
...
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753 )
2016-04-16 16:13:14 +08:00
f74197a074
[cbs] extract rtmp formats
2016-04-15 22:38:37 +01:00
f3a58d46bf
[youtube:user] check if the url didn't match only the other youtube extractors
2016-04-15 19:06:13 +01:00
b6612c9b11
[karaoketv] Fix extraction
2016-04-15 21:26:54 +06:00
7e176effb2
[iqiyi] Also suuport pps.tv URLs
...
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.
[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
2016-04-15 22:39:18 +08:00
4a252cc2d2
[karaoketv] Update and mark as not _WORKING
2016-04-15 21:49:17 +08:00
f0ec61b525
[huffpost] Fix extraction
2016-04-15 20:55:56 +08:00
66d40ae3a5
Merge pull request #9041 from kasper93/master
...
[generic] Add support for LiveLeak embeds
2016-04-15 17:23:55 +08:00
e6da9240d4
[mixcloud:stream] Add new extractor
...
Closes #7633
2016-04-15 17:14:17 +08:00
dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
...
Fixes #7521
2016-04-15 15:48:22 +08:00
c773082692
Merge branch 'Phaeilo-mixcloud'
2016-04-15 14:33:04 +08:00
9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist
2016-04-15 14:32:02 +08:00
56f1750049
[tdslifeway] Use the new Brightcove API
...
Thanks for @remitamine's suggestion.
2016-04-15 04:28:54 +08:00
f2159c9815
[wayofthemaster] Remove extractor
...
Now it's using YouTube embeds.
2016-04-15 04:02:23 +08:00
b0cf2e7c1b
[ubu] Remove extractor
...
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
(For example http://ubu.com/film/hammons_king.html )
2016-04-15 03:48:23 +08:00
74b47d00c3
[xboxclips] Use http:// URL
...
xboxclips has misconfigured certificates
2016-04-15 03:30:38 +08:00
8cb57bab8e
[ministrygrid] Fix extraction and modernize
2016-04-15 02:48:12 +08:00
e1bf277e19
[tdslifeway] Add TDSLifewayIE
...
Used by MinistryGridIE
2016-04-15 02:48:12 +08:00
9e28538726
[arte:creative] Improve _VALID_URL
2016-04-14 21:54:41 +06:00
404284132c
[arte:info] Add extractor ( Closes #9182 )
2016-04-14 21:52:05 +06:00
5565be9dd9
[aol] relex _VALID_URL regex
2016-04-14 08:47:55 +01:00
b3a9474ad1
Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud
2016-04-14 15:31:58 +08:00
86475d59b1
[metacritic] Add a new valid test case
2016-04-14 15:12:59 +08:00
73d93f948e
[lecture2go] Fix extraction
...
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:
$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
2016-04-14 15:08:01 +08:00
d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test
2016-04-14 14:11:28 +08:00
f141fefab7
[karrierevideos] Fix extraction
...
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
2016-04-14 14:06:05 +08:00
8334637f4a
Make tbr field 'int' rather than 'tuple'
...
Closes #9180 .
2016-04-13 14:29:34 +02:00
b8f67449ec
[generic] Add support for LiveLeak embeds
2016-04-13 01:54:19 +02:00
75af5d59ae
[netease] Skip all tests: completely georestricted
2016-04-13 04:52:07 +08:00
6d67169509
[mixcloud] improved extraction of user description
2016-04-12 21:18:13 +02:00
dcaf00fb3e
[mixcloud] support older urllib versions
2016-04-12 21:18:13 +02:00
f896e1ccef
[mixcloud] fixed some tests
2016-04-12 21:18:13 +02:00
c96eca426b
[mixcloud] Added support for user uploads, playlists, favorites and listens.
...
Fixes #3750 and #5272
2016-04-12 21:18:13 +02:00
466a614537
[youtube:playlist] Recognize popular uploads playlist as mix ( Closes #9170 )
2016-04-12 21:38:31 +06:00
ffa2cecf72
[ard] Change subtitles extension to ttml ( Closes #9169 )
...
ttml is now served instead of srt
2016-04-12 21:20:31 +06:00
a837416025
[jadorecettepub] Remove extractor: website gone
2016-04-12 18:30:53 +08:00
c9d448876f
[izlesene] Fix extraction
...
description may be absent
2016-04-12 18:29:28 +08:00
8865b8abfd
[howstuffworks] Skip a broken test case
2016-04-12 17:30:14 +08:00
c77a0c01cb
[groupon] Fix extraction
2016-04-12 17:26:09 +08:00
12355ac473
[goshgay] Fix extraction
...
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
2016-04-12 17:23:00 +08:00
49f523ca50
[mixcloud] Capture error message ( #9156 )
2016-04-11 20:45:58 +06:00
4a903b93a9
Revert "[openclassroom] Add new extractor( closes #9147 )"
...
This reverts commit 13267a2be3
2016-04-11 14:44:35 +01:00
13267a2be3
[openclassroom] Add new extractor( closes #9147 )
2016-04-11 14:24:08 +01:00
134c207e3f
[arte.tv:embed] Extended support ( #2620 )
2016-04-11 19:32:27 +08:00
0f56bd2178
Merge branch 'Phaeilo-presstv'
2016-04-11 16:17:05 +08:00
dfbc7f7f3f
[presstv] Improve and simplify
2016-04-11 16:14:07 +08:00
7d58ea7c5b
Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv
2016-04-11 15:48:10 +08:00
452908b257
[telebruxelles] Fix extraction ( Closes #9142 )
2016-04-11 00:06:05 +06:00
5899e988d5
[glide] Improve extraction and extract upload info
2016-04-10 23:56:23 +06:00
4a121d29bb
[glide] Fix extraction ( Closes #9141 )
2016-04-10 23:45:17 +06:00
7ebc36900d
[jwplatform:base] Improve subtitles extraction
2016-04-10 22:55:07 +06:00
d7eb052fa2
[screencastomatic] Add duration to test
2016-04-10 22:48:04 +06:00
a6d6722c8f
[jwplatform:base] Extract duration
2016-04-10 22:47:38 +06:00
66fa495868
[screencastomatic] Fix extraction ( Closes #9136 )
2016-04-10 22:37:14 +06:00
443285aabe
[ebaumsworlds] Update _VALID_URL ( Closes #9135 )
2016-04-10 22:15:11 +06:00
de728757ad
[presstv] Refactored extractor.
2016-04-10 16:36:44 +02:00
f44c276842
[extractor/extractors] Remove non-existant imports
2016-04-10 19:21:58 +06:00
a1fa60a934
[cliprs] Add extractor ( Closes #9099 )
2016-04-10 18:43:40 +06:00
49caf3307f
[extractor/common] Remove irrelevant comment
2016-04-10 17:10:27 +06:00
61dd350a04
[1tv] Fix extraction ( Closes #9103 )
2016-04-10 03:02:35 +06:00
95153a960d
[presstv] updated extractor and tests to work with current PressTV website
2016-04-09 16:14:05 +02:00
c991106706
[videodetective] Adapt to InternetVideoArchiveIE
2016-04-09 21:47:35 +08:00
dae2a058de
[rottentomatoes] Adapt to InternetVideoArchiveIE
2016-04-09 21:47:12 +08:00
c05025fdd7
[internetvideoarchive] Fix extraction and support json URLs
2016-04-09 21:46:51 +08:00
bfe96d7bea
[presstv] Added extractor PressTV.
...
Fixes #7060
2016-04-09 14:55:54 +02:00
ab481b48e5
[funnyordie] Relax M3U8 URL matching
...
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.
This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
2016-04-09 20:17:35 +08:00
92c7f3157a
[aol] Add coding cookie
2016-04-09 17:32:23 +06:00
bffb245a48
[aol] add support for videos with vidible IDs( closes #9124 )
2016-04-09 10:51:23 +01:00
e0986e31cf
lazy extractors: Output if it's enabled in the verbose log
2016-04-08 21:50:54 +02:00
779822d945
Add experimental support for lazy loading the info extractors
...
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
2016-04-08 21:50:07 +02:00
1b3d5e05a8
Move the extreactors import to youtube_dl/extractor/extractors.py
2016-04-08 21:47:51 +02:00
e52d7f85f2
Delay initialization of InfoExtractors until they are needed
2016-04-08 21:43:24 +02:00
568d2f78d6
[tnaflix] Fix metadata extraction
2016-04-09 00:27:24 +06:00
2f2fcf1a33
[tnaflix] Fix extraction ( Closes #9074 )
2016-04-08 23:34:59 +06:00
bacec0397f
[extractor/common] Relax _hidden_inputs
2016-04-08 23:33:45 +06:00
3c6c7e7d7e
[gdcvault] Fix extraction ( Closes #9107 , closes #9114 )
2016-04-08 23:16:02 +06:00
fb38aa8b53
[extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests ( Closes #9119 , closes #9120 )
2016-04-08 22:48:08 +06:00
18da24634c
[democracynow] Improve extraction
2016-04-08 22:27:27 +06:00
a134426d61
[democracynow] Fix tests
2016-04-08 22:21:14 +06:00
a64c0c9b06
[democracynow] Make description optional ( Closes #9115 )
2016-04-08 22:15:36 +06:00
56019444cb
[novamov] Improve _VALID_URL template ( Closes #9116 )
2016-04-08 21:26:42 +06:00
a1ff3cd5f9
[acast] fix channel extraction( closes #9117 )
2016-04-08 15:15:34 +01:00
9a32e80477
[acast] fix extraction( #9117 )
2016-04-08 14:51:00 +01:00
ed6fb8b804
[vrt] Add support for direct hls playlists and YouTube ( Closes #9108 )
2016-04-07 23:22:43 +06:00
3afef2e3fc
[beeg] Improve extraction
2016-04-07 22:40:35 +06:00
e90d175436
[yandexmusic] Extract music album metafields ( Closes #7354 )
2016-04-07 02:56:13 +06:00
7a93ab5f3f
[extractor/common] Introduce music album metafields
2016-04-07 02:53:53 +06:00
8790249c68
[iqiyi] Improve error detection for VIP-only videos
...
Closes #9071
2016-04-06 16:12:16 +08:00
65150b41bb
[deezer] Fix extraction ( Closes #9086 )
2016-04-05 22:27:33 +06:00
e42f413716
[rte] Improve thumbnail extraction ( Closes #9085 )
2016-04-05 22:23:20 +06:00
40a056d85d
[extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically
2016-04-05 21:54:09 +06:00
e7d77efb9d
[auroravid] Add extractor ( Closes #9070 )
2016-04-05 21:52:07 +06:00
995cf05c96
[novamov] Make title fatal
2016-04-05 21:40:43 +06:00
8c7d6e8e22
[zdf] Extract subtitles ( closes #9081 )
2016-04-04 20:44:06 +02:00
6d4fc66bfc
[youtube] Add support for zwearz ( Closes #9062 )
2016-04-04 02:26:20 +06:00
23576edbfc
[brightcove:legacy] skip None value for uploader_id
2016-04-02 21:31:21 +01:00
4d4cd35f48
[brightcove:legacy] extract uploader_id as a string
2016-04-02 20:55:44 +01:00
3aac9b2fb1
[nowness] update tests
2016-04-02 18:57:15 +01:00
e47d19e991
[brightcove:new] extract subtitles and strip video title
2016-04-02 18:57:15 +01:00
41f5492fbc
[brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp
2016-04-02 18:57:15 +01:00
2defa7d75a
[instagram:user] Fix extraction ( fixes #9059 )
...
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
2016-04-02 18:03:56 +02:00
bbc26c8a01
[bbc] Set vcodec to none for audio formats
2016-04-02 19:00:38 +06:00
b507cc925b
[extractor/common] Carry long line
2016-04-02 18:49:58 +06:00
db8ee7ec05
[extractor/common] Fix numeric identifiers conversion in DASH URL templates
2016-04-02 18:48:05 +06:00
08136dc138
[brightcove] fix format sorting
2016-04-02 10:57:57 +01:00
fe7ef95e91
[cbsinteractive] Add support for ZDNet videos
2016-04-01 23:53:32 +01:00
5f705baf5e
[cnet] extract more formats
2016-04-01 20:42:15 +01:00
df634be2ed
[common] prefer using mime type over ext for smil subtitle extraction
...
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
2016-04-01 19:47:49 +01:00
6d628fafca
[camwithher] Remove extra blank line
2016-04-01 20:45:21 +02:00
0f28777f58
[cbsnews] Remove unused import
2016-04-01 20:43:14 +02:00
329c1eae54
[aenetworks] Make pep8 happy
2016-04-01 20:42:19 +02:00
9aaaf8e8e8
[camwithher] Improve extraction ( Closes #8989 )
2016-04-01 23:47:27 +06:00
04819db58e
[camwithher] Add extractor
...
Corrected unnecessary test
Sane variable naming
RTMP all .flv & url_id for _download_webpage()
Corrected all outstanding issues, next up is a squash!
2016-04-01 23:44:25 +06:00
79ba9140dc
[theplatform] extract timestamp and uploader
2016-04-01 18:07:17 +01:00
75d572e9fb
[screencast] Improve title regexes ( Closes #9025 )
2016-04-01 23:01:55 +06:00
791d6aaecc
screencast.com: fallback on page title
...
When determining the title of the page, use the <title> tag of the page
2016-04-01 23:00:52 +06:00
81de73e5b4
[screencast] Add test
2016-04-01 23:00:45 +06:00
83cedc1cf2
screencast.com: support missing www
...
The "www." part of the URL is not mandatory
2016-04-01 22:58:16 +06:00
244cd04237
[pluralsight] Remove unnecessary login/password encode
2016-04-01 22:46:46 +06:00
fbdaced256
[lynda] Remove unnecessary login/password encode
2016-04-01 22:45:20 +06:00
a3373823e1
[udemy] Remove unnecessary login/password encode
...
This is now covered by compat_urllib_parse_urlencode
2016-04-01 22:42:09 +06:00
03caa463e7
[udemy:course] Skip non-video lectures
2016-04-01 22:38:56 +06:00
Sergey M․