Commit Graph
100 Commits
Author SHA1 Message Date
pukkandan 998a3cae0c [cleanup] Misc fixes 2022-06-22 03:47:41 +05:30
pukkandan 471d0367c7 [youtube:clips] Support downloading clips
Closes #2543
2022-06-22 02:50:55 +05:30
pukkandan 3975b4d2e8 Allow extractors to specify section_start/end for clips 2022-06-22 02:44:28 +05:30
pukkandan 230d5c8239 [jsinterp] Some optimizations and refactoring
Motivated by: https://github.com/ytdl-org/youtube-dl/issues/30641#issuecomment-1041904912

Authored by: dirkf, pukkandan
2022-06-21 23:23:48 +05:30
pukkandan e4afcfde08 [build] Add Linux standalone builds 2022-06-21 17:02:57 +05:30
pukkandan 8372be7469 [update] Self-restart after update 2022-06-21 17:02:57 +05:30
pukkandan 57e0f077a6 [update] Expose more functionality to API 2022-06-21 17:02:56 +05:30
pukkandan f0500bd1e4 [test] Fix FakeYDL signatures
Authored by: coletdjnz
2022-06-21 13:03:29 +05:30
pukkandan 95032f302c [f4m] Bugfix 2022-06-21 13:03:29 +05:30
pukkandan 8102a5991b [extractor/mediaset] Improve _VALID_URL 2022-06-21 13:03:28 +05:30
pukkandan dfb855b42d [extractor/BiliIntl] Fix subtitle extraction
Closes #3123

Authored by: HobbyistDev
2022-06-20 14:08:32 +05:30
pukkandan 5df1444255 [utils] ExtractorError: Fix exc_info 2022-06-20 12:35:02 +05:30
pukkandan 612f2be5d3 Bugfix for 7b2c3f47c6 2022-06-20 12:03:35 +05:30
pukkandan 6d1b34896e Update to ytdl-commit-8a158a9
[NHK] Use new API URL
https://github.com/ytdl-org/youtube-dl/commit/6508688e88c83bb811653083db9351702cd39a6a

Closes #2337, Closes #4063
2022-06-20 11:44:57 +05:30
pukkandan 7b2c3f47c6 [cleanup] Misc 2022-06-20 11:44:55 +05:30
pukkandan 8aa0e7cd96 [docs] Improvements 2022-06-20 10:48:29 +05:30
pukkandan 8072ef2bbd [extractor/BiliIntl] Fix metadata extraction
Closes #4116
2022-06-20 03:05:46 +05:30
pukkandan f254d6ccd9 [extractor/dropbox] Extract the correct mountComponent 2022-06-19 06:46:46 +05:30
pukkandan 44a6fcff39 Improve error handling of bad config files
Related: #824
2022-06-18 09:19:39 +05:30
pukkandan bf1824b391 [cleanup] Deprecate YoutubeDL.parse_outtmpl 2022-06-18 08:36:39 +05:30
pukkandan a70635b8a1 [cleanup, utils] Don't use kwargs for format_field 2022-06-18 08:13:22 +05:30
pukkandan 7e9a612585 Add option --lazy-playlist to process entries as they are received 2022-06-17 14:20:40 +05:30
pukkandan 0df111a371 [youtube] Extract comment_count from webpage
Closes #4091
2022-06-17 12:00:55 +05:30
pukkandan a39a7ba8d6 [extractor/tiktok] Extract SIGI_STATE
Based on #3624, https://github.com/ytdl-org/youtube-dl/pull/30479

Closes #3551

Authored by dirkf, sulyi, pukkandan
2022-06-17 11:24:09 +05:30
pukkandan 7e88d7d78f Add slicing notation to --playlist-items
* Adds support for negative indices and step
* Add `-I` as alias for `--playlist-index`
* Deprecates `--playlist-start`, `--playlist-end`, `--playlist-reverse`, `--no-playlist-reverse`

Closes #2951, Closes #2853
2022-06-17 10:36:52 +05:30
pukkandan f0c9fb9682 [utils] Popen: Refactor to use contextmanager
Fixes https://github.com/yt-dlp/yt-dlp/issues/3531#issuecomment-1156223597
2022-06-16 06:23:50 +05:30
pukkandan 560738f34d [extractor] Import _ALL_CLASSES lazily
This significantly speeds up `import yt_dlp` in the absence of `lazy_extractors`
2022-06-16 06:23:50 +05:30
pukkandan 99d10bf607 [cleanup, extractor] Rename extractors.py to _extractors.py
This should be considered part of the next commit,
but is separated so that `git` can detect the renaming better
2022-06-16 06:23:49 +05:30
pukkandan 2cb1982043 [utils] locked_file: Fix for PyPy on Windows 2022-06-13 19:21:31 +05:30
pukkandan fccf90e7f3 Fix bug in 56ba69e4c9 2022-06-13 19:16:06 +05:30
pukkandan d32f30ac48 Add --no-update
Closes #4060
2022-06-13 19:15:54 +05:30
pukkandan e3aae45a6f [extractor/zdf] Fix bug in 62b2b736e7
Closes #4061
2022-06-13 19:13:59 +05:30
pukkandan f3c0c77304 [extractor] Handle json_ld with multiple @types
Closes: #4022
2022-06-13 19:12:34 +05:30
pukkandan 79e591b59b [extractor/rumble] Detect JS embed
Closes #4064
2022-06-13 19:08:01 +05:30
pukkandan 21a73e9f39 [extractor/generic] Revert e6ae51c123
85553414ae made it unnecessary
2022-06-13 18:40:33 +05:30
pukkandan 55baa67c7c [extractor/jwplatform] Look for data-video-jw-id
Closes #3821
2022-06-12 03:26:00 +05:30
pukkandan 64fa820ccf [cleanup] Misc fixes (see desc)
* [tvver] Fix bug in 6837633a4a - Closes #4054
* [rumble] Fix tests - Closes #3976
* [make] Remove `cat` abuse - Closes #3989
* [make] Revert #3684 - Closes #3814
* [utils] Improve `get_elements_by_class` - Closes #3993
* [utils] Inherit `Namespace` from `types.SimpleNamespace`
* [utils] Use `re.fullmatch` for matching filters
* [jsinterp] Handle quotes in `_separate`
* [make_readme] Allow overshooting last line

Authored by: pukkandan, kwconder, MrRawes, Lesmiscore
2022-06-12 00:08:16 +05:30
pukkandan 56ba69e4c9 [cleanup] Misc fixes
Closes #4027
2022-06-11 05:00:12 +05:30
pukkandan 233ad894d3 [update] Use .git folder to distinguish source/unknown
This is not perfect, but is good enough for how we use this information

Closes #3994
2022-06-08 00:17:42 +05:30
pukkandan 5ec1b6b716 Add option --download-sections to download video partially
Closes #52, Closes #3932
2022-06-07 02:41:55 +05:30
pukkandan e0ab98541c [ExtractAudio] Allow conditional conversion
Closes #1715
2022-06-06 21:51:28 +05:30
pukkandan 35faefee5d [ExtractAudio, cleanup] Refactor 2022-06-06 21:49:57 +05:30
pukkandan b7c47b7438 [extractor] Add _search_json
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
2022-06-06 19:46:45 +05:30
pukkandan 00bbc5f177 [ThumbnailsConvertor] Allow conditional conversion
Closes #3970
2022-06-05 20:51:19 +05:30
pukkandan 1890fc6389 [cleanup] Misc fixes
Cherry-picks from: #3498, #3947
Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
2022-06-03 21:45:35 +05:30
pukkandan c4910024f3 [extractor] Fix bug in 617f658b7e
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only

Closes #3954
2022-06-03 17:25:20 +05:30
pukkandan 09d02ea429 [extractor] Fix bug in f95b9dee45
Closes #3951
2022-06-03 06:16:01 +05:30
pukkandan 28786529dc [extractor/dropout] Login is not mandatory
Workaround for #3931
2022-06-01 02:03:25 +05:30
pukkandan 6b0b0a289a [extractor/youtube:tab] Detect videoRenderer in _post_thread_continuation_entries 2022-06-01 02:03:24 +05:30
pukkandan f95b9dee45 [extractor] Add dev option --load-pages 2022-06-01 02:03:22 +05:30
pukkandan 617f658b7e [extractor, cleanup] Refactor _download_... methods 2022-06-01 01:57:16 +05:30
pukkandan 8a7f6d7a15 Do not print progress to stderr with -q
It is arguable how this "should" behave, but since progress is always
written to stdout in older yt-dl/p, we should keep it as-is

Bug in cf4f42cb97
Closes #3844
2022-06-01 01:57:14 +05:30
pukkandan 0fe51254cb [extractor/youtube] Bring back _extract_chapters_from_description
Closes #3886
2022-05-29 01:00:41 +05:30
pukkandan 52023f1291 [extractor/youtube] Make signature extraction non-fatal
and reduce verbosity of it's warning

Closes #3882
2022-05-29 00:00:24 +05:30
pukkandan 0bf9dc1e35 Fix bug in 8a82af3511 2022-05-27 21:29:30 +05:30
pukkandan 829bbd1d05 [youtube] Add warning for PostLiveDvr
Closes #3746, Related #1564
2022-05-27 05:07:00 +05:30
pukkandan 8a82af3511 [cleanup] Misc fixes and cleanup
Closes #3780, Closes #3853, Closes #3850
2022-05-27 04:43:43 +05:30
pukkandan 8246f8402b [spotify:show] Fix extractor
Closes #3768
2022-05-27 04:33:03 +05:30
pukkandan 6b9e832db7 --config-location - to provide options interactively 2022-05-27 04:32:54 +05:30
pukkandan d9473db78a [ModifyChapters] Fix repeated removal of small segments
Closes #3846
2022-05-23 16:12:33 +05:30
pukkandan 11233f2afd [downloader, cleanup] Refactor report_progress
Closes #3790
2022-05-22 21:54:06 +05:30
pukkandan 3a85e9cee9 [ffmpeg] Check version lazily
Closes #3830
2022-05-22 19:56:22 +05:30
pukkandan c4a62b99f6 Fix bug in 23326151c4 2022-05-22 17:27:04 +05:30
pukkandan b5899f4f19 [build, cleanup] Refactor
Closes #3835, #3837
2022-05-22 17:07:18 +05:30
pukkandan c487cf0010 [cleanup] Misc 2022-05-21 16:01:53 +05:30
pukkandan 415f8d51a8 Ensure pre-processor errors do not block video download
Closes #2875
2022-05-21 02:30:16 +05:30
pukkandan ca6d59d2c1 Fix --simulate --max-downloads
Bug in c3e6ffba53
Closes #3815
2022-05-20 23:13:31 +05:30
pukkandan 1a8cc83735 Bugfix for 3a408f9d19 2022-05-20 21:25:07 +05:30
pukkandan 2762dbb17e [compat] Add functools.cached_property 2022-05-20 21:06:37 +05:30
pukkandan 666c36d58d Bugfix for 23326151c4 2022-05-20 21:03:19 +05:30
pukkandan e79969b242 Return an error code if update fails
Closes #3802
2022-05-20 06:01:37 +05:30
pukkandan 53973b4d2c [utils] Fix bug in 0b9c08b47b
* Cache of `supports_terminal_sequences` must be reset after enabling VT mode
* and move `windows_enable_vt_mode` to utils to avoid cyclic imports
2022-05-20 06:01:09 +05:30
pukkandan b801cd7179 [tiktok] Detect embeds
Closes #3799
2022-05-20 06:01:08 +05:30
pukkandan 0b9c08b47b [utils] Improve performance using functools.cache
Closes #3786
2022-05-19 20:23:53 +05:30
pukkandan 2f97cc615b [utils] ISO3166Utils: Add EU and AP
Fixes https://github.com/yt-dlp/yt-dlp/pull/3302#discussion_r875528517
2022-05-19 20:05:26 +05:30
pukkandan 2dd5a2e3a1 [doc, cleanup] Re-indent "Usage and Options" section 2022-05-19 20:05:17 +05:30
pukkandan 23326151c4 Add option --retry-sleep (#3059)
Closes #2852
2022-05-19 20:00:31 +05:30
pukkandan 9e49146352 Add option --alias 2022-05-19 19:45:21 +05:30
pukkandan b14d523558 Release 2022.05.18 2022-05-18 09:04:38 +05:30
pukkandan 21633673c3 [cleanup] Minor fixes 2022-05-18 09:04:30 +05:30
pukkandan 80e8493ee7 [utils] is_html: Handle double BOM
Closes #2885
2022-05-18 07:03:50 +05:30
pukkandan aedaa455d9 [vimeo] Fix extractors
Closes #3037, Closes #2858, Closes #2880, Closes #3712
May also fix #3602, #3360
2022-05-18 05:16:08 +05:30
pukkandan d6bf1161db [generic] Refactor _extract_rss
Closes #3738
2022-05-18 04:17:59 +05:30
pukkandan 7896214c42 Bugfix for 591bb9d355
Closes #3769
2022-05-17 22:33:15 +05:30
pukkandan 5792c950bf [compat] Implement compat.imghdr
Python 3.11 deprecates `imghdr` module
2022-05-17 19:46:01 +05:30
pukkandan 7a96d0b39c [build] More test-runners
* GHA does not cache python 3.6 for Windows, so use 3.8 instead
* Add tests for 3.11, PyPy3.8/3.9
* CPython 3.10 is now stable
* Do not pin Ubuntu to 18.04
2022-05-17 19:40:54 +05:30
pukkandan 591bb9d355 Fix color in -q -F
and convert `ydl._out_files`/`ydl._allow_colors` to `Namespace`

Closes #3761
2022-05-17 18:41:46 +05:30
pukkandan 0fa7d2c8e4 Bugfix for 2414649192 2022-05-17 00:55:37 +05:30
pukkandan b2a2d91310 [adobepass] Allow cookies for authenticating MSO
Possible workaround for #1034
2022-05-17 00:07:46 +05:30
pukkandan 490110c543 --max-downloads should obey --break-per-input 2022-05-17 00:07:44 +05:30
pukkandan 2414649192 [cleanup] Misc cleanup 2022-05-17 00:07:43 +05:30
pukkandan 5d5c0f7e99 [Hotstar] Bugfix for a1ddaa899c
Closes #3595
2022-05-17 00:07:41 +05:30
pukkandan e037c405ad [rokfin] Implement login (#2992)
Authored by: P-reducible, pukkandan
2022-05-15 22:17:04 +05:30
pukkandan 82d020804d [extractor] Use classmethod/property where possible
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
2022-05-13 00:23:26 +05:30
pukkandan 2e4585da92 [cookies] Throttle progress-bar
Closes #3710
2022-05-12 10:54:49 +05:30
pukkandan 8dcce6a89c [extractor] Document netrc machines
Closes #3169
2022-05-11 22:10:15 +05:30
pukkandan 494f52308b [FixupM3u8] Obey --hls-prefer-mpegts
Closes #3697
2022-05-11 11:03:36 +05:30
pukkandan 3d38b2d6d0 Fix --date today
Closes #3704
2022-05-11 07:25:56 +05:30
pukkandan 3a408f9d19 Show name of downloader in verbose log
Closes #3703
2022-05-11 07:20:54 +05:30
pukkandan d76fa1f3d4 [cookies] Allow cookiefile to be a text stream
Closes #3674
2022-05-11 05:52:55 +05:30