artem/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2026-08-16 09:06:09 +03:00
Code Issues Packages Projects Releases Wiki Activity
19,173 Commits 1 Branch 139 Tags
3619f78d2c5916d880456992a1ef91a15ff11f3a
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
pukkandan 3619f78d2c [youtube] Misc cleanup (#577) 
Authored by: pukkandan, colethedj
 2021-07-31 03:01:49 +05:30
pukkandan 65c2fde23f [youtube] Add thirdParty to agegate clients (#577) 
* This allows more videos like `tf2U5Vyj0oU` to become embeddable
    See https://github.com/yt-dlp/yt-dlp/pull/575#issuecomment-888837000
* Also added tests for all types of age-gate

Closes #581
 2021-07-31 02:20:21 +05:30
pukkandan 000c15a4ca [youtube] simplify and de-duplicate client definitions (#577) 2021-07-31 02:14:15 +05:30
pukkandan 7d1eb38af1 Add format types j, l, q for outtmpl 
Closes #345
 2021-07-29 08:47:25 +05:30
pukkandan 901130bbcf Expand and escape environment variables correctly in outtmpl 
Fixes: https://www.reddit.com/r/youtubedl/comments/otfmq3/ytdlp_same_parameters_different_results
 2021-07-29 08:38:18 +05:30
pukkandan 2a9c6dcd22 [youtube] Fix format sorting when using alternate clients 2021-07-26 03:50:13 +05:30
pukkandan b4c055bac2 [youtube] Add player_client=all 2021-07-26 03:38:18 +05:30
pukkandan ea05b3020d Remove asr appearing twice in -F 2021-07-26 03:38:15 +05:30
pukkandan 9536bc072d [bilibili] Improve _VALID_URL 2021-07-26 03:38:10 +05:30
pukkandan 1fe3c4c27e [version] update 
:ci skip all
 2021-07-24 20:02:12 +05:30
pukkandan f703a88055 Release 2021.07.24 2021-07-24 07:03:14 +05:30
pukkandan a353beba83 [youtube:tab] Extract video duration early 
Based on: https://github.com/ytdl-org/youtube-dl/pull/29487 by glenn-slayden
 2021-07-24 06:59:20 +05:30
pukkandan 052e135029 [youtube] Simplify _get_text early 2021-07-24 06:59:20 +05:30
pukkandanandGitHub 060ac76257 [test] Use pytest instead of nosetests (#482) 
`nosetests` is no longer being maintained : https://github.com/nose-devs/nose/issues/1099
and will stop working in py 3.10 as can be seen in #480
 2021-07-23 20:18:15 +05:30
pukkandan 063c409dfb [cookies] Handle errors when importing keyring 
Workaround for #551
 2021-07-23 19:58:27 +05:30
pukkandan f45e6c1126 [downloader] Pass same status object to all progress_hooks 2021-07-23 09:46:55 +05:30
pukkandan 3944e7af92 [youtube] Fix subtitles only being extracted from the first client 
Closes #547
 2021-07-23 09:46:55 +05:30
pukkandan ad34b2951e Try all clients even if age-gated 
Reverts: https://github.com/yt-dlp/yt-dlp/pull/536/commits/892e31ce7c5f66418fee26a24eda30e5fe79d901

If some API calls have any issue, saving the state will cause unnecessary errors
 2021-07-23 09:46:54 +05:30
pukkandan c8fa48fd94 [youtube] Disable get_video_info age-gate workaround 
This now seems to be completely dead
Closes: #553
 2021-07-23 09:46:52 +05:30
pukkandan 3ba7740dd8 [downloader] Pass info_dict to progress_hooks 2021-07-22 04:30:11 +05:30
pukkandan 29b208f6f9 [cookies] bugfix 
Fixes: https://github.com/yt-dlp/yt-dlp/pull/488#discussion_r674352059
 2021-07-22 03:00:21 +05:30
pukkandan e4d666d27b [version] update 
:ci skip all
 2021-07-22 02:37:51 +05:30
pukkandan 245524e6a3 Release 2021.07.21 
and fix some typos
Closes #538
 2021-07-22 02:33:28 +05:30
pukkandan 9c0d7f4951 [youtube] Make --extractor-retries work for more errors 
Closes #507
 2021-07-22 02:32:20 +05:30
pukkandan e37d0efbd9 Fix bug where original_url was not propagated when _type=url 2021-07-22 02:32:19 +05:30
pukkandan 7ea6541124 [youtube] Improve extraction of livestream metadata 
Modified from and closes #441
Authored by: pukkandan, krichbanana
 2021-07-21 20:50:59 +05:30
pukkandan ae30b84072 Add field live_status 2021-07-21 20:50:58 +05:30
pukkandan cc9d1493c6 bugfix for 50fed816dd 2021-07-21 20:50:49 +05:30
pukkandan b35496d825 Add only_once param for write_debug 2021-07-21 18:06:34 +05:30
pukkandan 352d63fdb5 [utils] Improve traverse_obj 2021-07-21 11:30:06 +05:30
pukkandanandGitHub 11f9be0912 [youtube] Extract data from multiple clients (#536) 
* `player_client` accepts multiple clients
* default `player_client` = `android,web`
* music clients can be specifically requested
* Add IOS `player_client`
* Hide live dash since they can't be downloaded

Closes #501

Authored-by: pukkandan, colethedj
 2021-07-21 09:22:34 +05:30
pukkandan c84aeac6b5 Add only_once param for report_warning 
Related: https://github.com/yt-dlp/yt-dlp/pull/488#discussion_r667527297
 2021-07-21 01:39:58 +05:30
pukkandan 50fed816dd Errors in playlist extraction should obey --ignore-errors 
Related: https://github.com/yt-dlp/yt-dlp/issues/535#issuecomment-883277272, https://github.com/yt-dlp/yt-dlp/issues/518#issuecomment-881794754
 2021-07-21 01:04:53 +05:30
pukkandan d61fc64618 [youtube:tab] Fix channels tab 2021-07-20 23:22:34 +05:30
pukkandan 6586bca9b9 [utils] Fix LazyList for Falsey values 2021-07-20 23:22:26 +05:30
pukkandan da503b7a52 [youtube] Make parse_time_text and _extract_chapters non-fatal 
Related: #532, 7c365c2109
 2021-07-20 07:22:26 +05:30
pukkandan 7c365c2109 [youtube] Sanity check chapters (and refactor related code) 
Closes #520
 2021-07-20 05:39:02 +05:30
pukkandan 3f698246b2 Rename NOTE in -F to MORE INFO 
since it's often confused to be the same as `format_note`
 2021-07-20 05:30:28 +05:30
pukkandan cca80fe611 [youtube] Extract even more thumbnails and reduce testing 
* Also fix bug where `_test_url` was being ignored

Ref: https://stackoverflow.com/a/20542029
Related: #340
 2021-07-20 03:46:06 +05:30
pukkandan c634ad2a3c [compat] Remove unnecessary code 2021-07-20 03:46:05 +05:30
pukkandan 8f3343809e [utils] Improve traverse_obj 
* Allow skipping a level: `traverse_obj([{k:v1}, {k:v2}], (None, k))` => `[v1, v2]`
* Make keys variadic: `traverse_obj(obj, k1: str, k2: str)` => `traverse_obj(obj, (k1,), (k2,))`
* Fetch from multiple keys: `traverse_obj([{k1:[1], k2:[2], k3:[3]}], (0, (k1, k2), 0))` => `[1, 2]`

TODO: Add tests
 2021-07-20 02:42:11 +05:30
pukkandan 0ba692acc8 [youtube] Extract more thumbnails 
* The thumbnail URLs are hard-coded and their actual existence is tested lazily
* Added option `--no-check-formats` to not test them

Closes #340, Related: #402, #337, https://github.com/ytdl-org/youtube-dl/issues/29049
 2021-07-20 02:42:11 +05:30
pukkandan d9488f69c1 [crunchyroll:playlist] Force http 
Closes #495
 2021-07-20 02:42:11 +05:30
pukkandan dce8743677 [docs] fix default of multistreams 2021-07-19 23:47:57 +05:30
pukkandan 5520aa2dc9 Add option --exec-before-download 
Closes #530
 2021-07-19 23:47:45 +05:30
pukkandan 3b297919e0 Revert "Merge webm formats into mkv if thumbnails are to be embedded (#173)" 
This reverts commit 4d971a16b8 by @damianoamatruda
Closes #500

This was wrongly checking for `write_thumbnail`
 2021-07-15 23:34:52 +05:30
pukkandan f0ff9979c6 [vlive] Extract thumbnail directly in addition to the one from Naver 
Closes #477
 2021-07-12 06:07:23 +05:30
pukkandan 501dd1ad55 [metadatafromfield] Do not detect numbers as field names 
Related: https://github.com/yt-dlp/yt-dlp/issues/486#issuecomment-877820394
 2021-07-12 05:20:12 +05:30
pukkandan 75722b037d [webtt] Fix timestamps 
Closes #474
 2021-07-12 05:20:12 +05:30
pukkandan 00034c146a [embedthumbnail] Fix _get_thumbnail_resolution 2021-07-11 04:46:53 +05:30
pukkandan 325ebc1703 Improve traverse_obj 2021-07-11 04:46:53 +05:30
pukkandan 7dde84f3c9 [FFmpegMetadata] Add language of each stream 
and some refactoring
 2021-07-11 04:46:52 +05:30
pukkandan 6606817a86 [utils] Add variadic 2021-07-11 04:46:51 +05:30
pukkandan 60bdb7bd9e [youtube] Fix sorting of 3gp format 2021-07-08 22:33:33 +05:30
pukkandan 4bb6b02f93 Improve extractor_args parsing 2021-07-08 21:22:35 +05:30
pukkandan b5ac45b197 Fix selectors all, mergeall and add tests 
Bug from: 981052c9c6
 2021-07-07 21:10:43 +05:30
pukkandan 38a40c9e16 [version] update 
:ci skip all
 2021-07-07 05:43:58 +05:30
pukkandan a8bf9b4dc1 Release 2021.07.07 2021-07-07 05:35:20 +05:30
pukkandan 51f8a31d65 Update to ytdl-commit-a803582 
[peertube] only call description endpoint if necessary
https://github.com/ytdl-org/youtube-dl/commit/a8035827177d6b59aca03bd717acb6a9bdd75ada
 2021-07-07 05:17:11 +05:30
pukkandanandGitHub 3acf6d3856 [Funimation] Rewrite extractor (See desc) (#444) 
* Support direct `/player/` URL
* Treat the different versions of an episode as different formats of a single video. So `experience_id` can no longer be used as the video `id` and the `episode_id` is used instead. This means that all existing archives will break
* Extractor options `language` and `version` to pre-select them
* Compat option `seperate-video-versions` to fall back to old behavior (including using the old video IDs)

Closes #428
 2021-07-07 02:51:29 +05:30
pukkandan 46890374f7 [extractor] Minor improvements (See desc) 
1. Allow removal of login hint - extractors can set their own login hint as part of `msg`
2. Cleanup `_merge_subtitles` signature
 2021-07-07 02:27:53 +05:30
pukkandan 60755938b3 [extractor] Prevent unnecessary download of hls manifests 
and refactor `hls_split_discontinuity` code
 2021-07-07 02:24:58 +05:30
pukkandan 723d44b92b [fragment] Handle errors in threads correctly 2021-07-07 01:55:54 +05:30
pukkandan bc97cdae67 [cleanup] Fix linter and some typos 
Related: https://github.com/ytdl-org/youtube-dl/pull/29398
 2021-07-04 03:04:25 +05:30
pukkandan 169dbde946 Fixes for --list options (See desc) 
1. Fix `--list-formats-old`
2. Allow listing with `--quiet`
3. Allow various listings to work together
4. Allow `--print` to work with listing
 2021-07-03 01:16:19 +05:30
pukkandan 981052c9c6 Some minor fixes and refactoring (see desc) 
* [utils] Fix issues with reversal
* check_formats should catch `DownloadError`, not `ExtractorError`
* Simplify format selectors with `LazyList` and `yield from`
 2021-07-02 08:17:37 +05:30
pukkandan b1e60d1806 [facebook] Extract description and fix title 
Partially fixes: #453
 2021-07-02 08:17:37 +05:30
pukkandan 6b6c16ca6c [downloader/ffmpeg] Fix --ppa when using simultaneous download 2021-07-02 08:17:30 +05:30
pukkandan 49c258e18d [youtube] Fix subtitle names for age-gated videos 
Related: https://github.com/iv-org/invidious/pull/2205#issuecomment-868680486
 2021-06-25 23:10:31 +05:30
pukkandan d3f62c1967 Fix --throttled-rate when using --load-info-json 2021-06-25 22:57:17 +05:30
pukkandan 5d3a0e794b Add --extractor-args to pass extractor-specific arguments 2021-06-25 20:10:28 +05:30
pukkandan 15a4fd53d3 [thumbnailsconvertor] Treat jpeg as jpg 2021-06-25 05:36:35 +05:30
pukkandan 6033d9808d Fix --flat-playlist when entry has no ie_key 2021-06-24 22:23:34 +05:30
pukkandan bd4d1ea398 [cleanup] Minor refactoring of fragment 2021-06-24 22:23:33 +05:30
pukkandan 8e897ed283 [fragment] Return status of download correctly 2021-06-24 22:04:23 +05:30
pukkandan 2b18a8c590 [plutotv] Improve _VALID_URL 
Closes #431
 2021-06-23 07:49:09 +05:30
pukkandan dac8b87b0c [version] update :ci skip all 2021-06-23 07:37:07 +05:30
pukkandan 6aecd87106 Release 2021.06.23 2021-06-23 07:34:55 +05:30
pukkandan ed807c1837 Update to ytdl-commit-379f52a 
[liveleak] Remove extractor
https://github.com/ytdl-org/youtube-dl/commit/379f52a4954013767219d25099cce9e0f9401961
 2021-06-23 07:34:55 +05:30
pukkandan 9fc0de5796 [hotstar] Use server time for authentication instead of local time 
Closes #396
 2021-06-23 06:04:42 +05:30
pukkandan 8a77e5e6bc [cleanup] Revert unnecessary changes in 51d9739f80 2021-06-23 05:34:40 +05:30
pukkandan 51d9739f80 Add option --throttled-rate below which video data is re-extracted 
Currently only for HTTP downloads

Closes #430, workaround for https://github.com/ytdl-org/youtube-dl/issues/29326
 2021-06-23 05:29:58 +05:30
pukkandanandGitHub 4c7853de14 [fragment] Merge during download for -N, and refactor hls/dash (#364) 2021-06-22 00:29:50 +05:30
pukkandan e6779b9400 [twitcasting] Websocket support (#399) 
Closes #392
Authored by: nao20010128nao
 2021-06-21 22:56:45 +05:30
pukkandan e36d50c5dd [websockets] Add WebSocketFragmentFD (#399) 
Necessary for #392

Co-authored by: nao20010128nao, pukkandan
 2021-06-21 22:56:36 +05:30
pukkandan ff0f78e1fe [aria2c] Lower --min-split-size for HTTP downloads 
This makes downloading smaller files much faster
 2021-06-20 19:28:54 +05:30
pukkandan 7e067091e8 [options] Rename --add-metadata to --embed-metadata 
and clarify that it embeds chapter markers
 2021-06-20 04:59:35 +05:30
pukkandan f89b3e2d7a Skip fixup of existing files and add --fixup force to force it 2021-06-20 04:59:34 +05:30
pukkandan fd7cfb6444 [cleanup] Refactor fixup 2021-06-20 04:26:11 +05:30
pukkandan 4e6767b5f2 [youtube] Temporary fix for age-gate 
Related:
https://stackoverflow.com/a/67629882
https://github.com/yt-dlp/yt-dlp/issues/319
https://github.com/ytdl-org/youtube-dl/issues/29333
https://github.com/ytdl-org/youtube-dl/issues/29086
 2021-06-18 20:32:52 +05:30
pukkandan 9fea350f0d Fix id sanitization in filenames 
Closes #415
 2021-06-17 02:32:24 +05:30
pukkandan e858a9d6d3 [EmbedThumbnail] Add compat-option embed-thumbnail-atomicparsley 
to force use of atomicparsley for embedding thumbnails in mp4

Related: #411
 2021-06-16 22:33:32 +05:30
pukkandan 7e87e27c52 [postprocessor] Fix _restrict_to when a codec is not set 2021-06-14 14:09:22 +05:30
pukkandan d0fb4bd16f [pornhub] Extract cast 
Closes #406, https://github.com/ytdl-org/youtube-dl/pull/27384
 2021-06-13 21:38:08 +05:30
pukkandan 4d85fbbdbb Fix bug in 8326b00aab 2021-06-13 14:36:13 +05:30
pukkandan 551f93885e Ignore images formats from merge 2021-06-13 04:16:42 +05:30
pukkandan 8326b00aab Allow images formats 
Necessary for #343.

* They are identified by `vcodec=acodec='none'`
* These formats show as the worst in `-F`
* Any postprocessor that expects audio/video will be skipped
* `b*` and all related selectors will skip such formats
* This commit also does not add any selector for downloading such formats. They have to be explicitly requested by the `format_id`. Implementation of a selector is left for when #389 is resolved
 2021-06-13 03:45:53 +05:30
pukkandan b0249bcaf0 Expand --check-formats to thumbnails 
Closes #402
 2021-06-13 03:45:53 +05:30
pukkandan 21cd8fae49 Use NamedTemporaryFile for --check-formats 2021-06-13 03:45:53 +05:30
pukkandan 45db527fa6 [youtube] Login is not needed for :ytrec 2021-06-13 03:45:53 +05:30