[poipiku] Add password used in post metadata#9303
Open
Elfiawesome wants to merge 8089 commits intomikf:masterfrom
Open
[poipiku] Add password used in post metadata#9303Elfiawesome wants to merge 8089 commits intomikf:masterfrom
Elfiawesome wants to merge 8089 commits intomikf:masterfrom
Conversation
* provide toplevel 'date' * preserve 'submission' data
can also be set via 'GDL_CONFIG_TYPE' environment variable 9fd732a
Added functionality to extract by hashtag and save to directory named after the hashtag.
export user lookup logic into 'user_by_screen_name' method
* Update fikfap.py to allow for extracting a single post from the main page
Current post extractor only works on links to posts
on user pages but not on direct links to posts
* include 'singlepost' logic into existing 'post' extractor
---------
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
make stop condition more lenient
use '[^/?#]+' for names
don't strip URL parameters
fixes regression introduced in 56168fb
use 'concat' demuxer to combine frames for mkvmerge danbooru/danbooru#6103 danbooru/danbooru#6241
fixes regression introduced in d9917ec
detect and solve JS challenges
for 'following' & 'followers' extractors when `metadata-user` is enabled
always 'break' out of the loop regardless of exception
and improve caching location & behavior
- multiple tags (tag1 tag2 tag3) - NOT operator (tag1 tag2 -tag3) - OR operator (~tag1 ~tag2) https://danbooru.donmai.us/wiki_pages/help:blacklists
* order (like before)
* type ('g' for gifs, 'i' for images, nothing for both)
* page (custom starting page)
for 'favorite' & 'novel:bookmark' extractors
requires authenticated cookies
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
14 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
When a post is password-protected and a password is provided via the
passwordconfig option, we store the actual password string used in thepassword_usedmetadata field.This is useful for archival purposes, when downloading many password-protected posts with different passwords, the metadata records which password unlocked each post.