Topic: RE621 [v.1.5.72] Feature-packed toolkit and mass downloader for e621

Posted under e621 Tools and Applications

dubsthefox said:
Hi ^^
I have a suggestion:
A tool to select multiple images at once, add a tag and hit apply. This would speed up tagging a lot.

Howdy.

Isn't that exactly what a tag script does? You should have access to that, as a Privileged user.
I'm hesitant to give that kind of tagging power to normal users, as it might be prone to abuse. There is a reason why tag scripts are locked off to trusted users only.

Patch 1.5.20

Changes
- Added hover text to the tag subscription button in the sidebar
- Fixed the post counter returning wrong results if the limit is explicitly specified in the URL
- Fixed the issue with the search bar being cleared if using the back and forward buttons in the browser
- Added an option to stop removing the query parameter on the post page
- Prevented the mass downloader modules from treating pseudo-artist tags (like cdnp and sound_warning) like artist tags
- Made the sidebar on the post page collapsible
- Added an option to customize the mass downloader's archive name

bitwolfy said:

Patch 1.5.20

Changes
- Added hover text to the tag subscription button in the sidebar
- Fixed the post counter returning wrong results if the limit is explicitly specified in the URL
- Fixed the issue with the search bar being cleared if using the back and forward buttons in the browser
- Added an option to stop removing the query parameter on the post page
- Prevented the mass downloader modules from treating pseudo-artist tags (like cdnp and sound_warning) like artist tags
- Made the sidebar on the post page collapsible
- Added an option to customize the mass downloader's archive name

the search bar is still being cleared for me

alecma said:
the search bar is still being cleared for me

I see. The solution I added was slightly janky, and may not always work.
It's an problem I made myself, unfortunately.

Here's what you should do.
Go to the script settings (wrench icon in the top right corner) -> General Tab -> Post Page, and unselect "Trim Query Parameter".
That should fix the problem for good.

bitwolfy said:
I see. The solution I added was slightly janky, and may not always work.
It's an problem I made myself, unfortunately.

Here's what you should do.
Go to the script settings (wrench icon in the top right corner) -> General Tab -> Post Page, and unselect "Trim Query Parameter".
That should fix the problem for good.

it looks like it did thank you

Having a most curious problem right now. This morning when I was making my usual rounds I noticed that I had zero notifications come in overnight. What's unusual is that the notification history was entirely wiped. Not only that but e6's announcement at the top of the page keeps coming back when I open a new tab.

Now, of course, as I write this up a red blip appears and fresh posts come in. Going through my settings, it doesn't look like anything was changed.

Something that did happen yesterday. My internet speed normally 100d/10u saw its download speed absolutely crash to 1 or 2 mbps. This happened to me in the past and my pi-hole had something to do with it, so I disconnected that and reset my router, problem solved itself.

Any idea if the two happen to be related?

mdf said:
Having a most curious problem right now. This morning when I was making my usual rounds I noticed that I had zero notifications come in overnight. What's unusual is that the notification history was entirely wiped. Not only that but e6's announcement at the top of the page keeps coming back when I open a new tab.

Now, of course, as I write this up a red blip appears and fresh posts come in. Going through my settings, it doesn't look like anything was changed.

Something that did happen yesterday. My internet speed normally 100d/10u saw its download speed absolutely crash to 1 or 2 mbps. This happened to me in the past and my pi-hole had something to do with it, so I disconnected that and reset my router, problem solved itself.

Any idea if the two happen to be related?

LocalStorage must have been wiped. Not entirely certain why. Did you delete browsing data, by any chance?

LocalStorage is something that both e621 and this script both use for storing less important data.
For RE621, it's mainly various caches – like the tag counts, DNP tags, and notifications information.

bitwolfy said:
LocalStorage must have been wiped. Not entirely certain why. Did you delete browsing data, by any chance?

LocalStorage is something that both e621 and this script both use for storing less important data.
For RE621, it's mainly various caches – like the tag counts, DNP tags, and notifications information.

No, at least not to my knowledge. I haven't touched any OS or browser settings recently and any automatic cleanup that does happen has never caused this to happen before.

Checking my notifications again, it looks like it's cleared again even though I got a few earlier today.

Oh well, I'm not going to cause too much of a fit here, I'll be likely reformatting my system sometime this month due to issues exceeding e6 anyways.

Is there a way to go to a random page out of the results for a search?

Like if you search something and it has 100 pages, a way so you could go to a random page between Pages 1-100

Would be also be cool if it would work while order:favcount (and things like that) is in the search :]

Updated

Patch 1.5.21

Changes
- Inverted the "Hide info bar" thumbnail settings, for the sake of consistency
- Added "epilepsy_warning" to the list of tags ignored by the downloader modules
- Fixed an issue caused by the first line of the blacklist being blank
- Fixed the faulty URL validation on the Pixiv upload preview fix
- Restored the missing query parameters on the favorites page
- Attempted to fix an issue causing the script to fail to load sometimes

bitwolfy said:
- Attempted to fix an issue causing the script to fail to load sometimes

It seems to have worked, I thought it was failing because I was trying to load too many tabs at once, but now the script loads every time!

hey its me again so lets talk about the mass downloader is it possible to make it mass download tags? and is it possible to make it name the images with the tags it has?

krabitz said:
It seems to have worked, I thought it was failing because I was trying to load too many tabs at once, but now the script loads every time!

I had the same problem happen regularly on my Mac, but never on my Windows PC.
Seems to be caused by one of the libraries the scripts uses throwing an error if it loaded before the HTML existed.

Let's hope this fix works in the long term.

alecma said:
hey its me again so lets talk about the mass downloader is it possible to make it mass download tags? and is it possible to make it name the images with the tags it has?

Well, you can change the name of the image by going to the script settings -> "Downloads" tab -> "Mass Downloader", and editing the field titled "Image file name".
But it does not currently support general category tags. Mainly because that tends to make the file name absurdly long, and while the name does get trimmed down to match the restrictions, that makes the name somewhat unpredictable.

If by "mass download tags" you mean using the same process that makes the "Tags" button work on the individual post page, but applying it to the mass downloader...
It's certainly possible, I'm just not entirely sure how practical it is. What are you trying to accomplish here?

bitwolfy said:
I had the same problem happen regularly on my Mac, but never on my Windows PC.
Seems to be caused by one of the libraries the scripts uses throwing an error if it loaded before the HTML existed.

Let's hope this fix works in the long term.

Well, you can change the name of the image by going to the script settings -> "Downloads" tab -> "Mass Downloader", and editing the field titled "Image file name".
But it does not currently support general category tags. Mainly because that tends to make the file name absurdly long, and while the name does get trimmed down to match the restrictions, that makes the name somewhat unpredictable.

If by "mass download tags" you mean using the same process that makes the "Tags" button work on the individual post page, but applying it to the mass downloader...
It's certainly possible, I'm just not entirely sure how practical it is. What are you trying to accomplish here?

even if it was long its a bit better so you can search by tag what to post on discord and stuff and well i have a hard drive and a big list of artists

alecma said:
even if it was long its a bit better so you can search by tag what to post on discord and stuff and well i have a hard drive and a big list of artists

I'll add that option in the next patch, but I'm telling you right now: this may cause problems.

The maximum filepath length on Windows is 255 characters. By that I mean the full path: for example, E:\Libraries\bitWolfy\Pictures\Yiff\1742059-blitzdrachin-cloudflare-e621-dikembe_mutombo-esix is 93 characters.
The script is currently limiting the file names to 128 characters (not including the extension). So, with general category tags enabled, the filepath would look like this:
E:\Libraries\bitWolfy\Pictures\Yiff\1742059-blitzdrachin-cloudflare-e621-dikembe_mutombo-esix-ambiguous_gender-anthro-bodily_fluids-computer-cum-cum_on_wall-cum_sta.png (168 characters).

And, as you can see, it's not terribly helpful either, as the tags are in the alphabetical order.

Patch 1.5.22

Thanks to Earlopain for their contributions to the project.

Changes
- Made the notifications window posts follow the double-click setting for other thumbnails. Again.
- Added a %tags% variable to downloader modules – it stands for general-category tags
- Changed the DownloadCustomizer default template to include the species tags
- [Earlopain] Removed TitleFixer – it was addressing a site bug that has since been fixed
- [Earlopain] Ensured that only active implications were counted when building the DNP cache
- [Earlopain] Tweaks to the build process

Amazing work so far. Would it be possible to check the artist field on upload to see if the artist tag implies avoid_posting or conditional_dnp?

Patch 1.5.23

Changes
- Fixed a bug causing the "Copy ID" button to disappear when revealing hidden comments
- Added an option to always display custom flags as expanded, instead of revealing them on hover
- Fixed a spacing issue with custom flags on non-standard thumbnails
- Added an option to hide the <3 buttons next to tags in the sidebar
- Added e621.local to the sites list in order to let the script run on dev versions of e621

bitwolfy said:
Sorry, that just seems like a very specialized feature.
It's not impossible, I'm just not sure how useful it would be.

Understandable. I would just use it as a faster way to explore the results of one of my crazy 40-tag bookmarks, haha :]

If not a random page feature, would a 'Jump to Page...' option be possible, like where the ellipses is between page numbers at the bottom?

Or maybe an option to adjust how wide the range of page numbers are available to click down there? Even if the option is an absurd list of tiny numbers to fit 100 page links, that's still some fast and specific leaping!

human-shaped said:
Understandable. I would just use it as a faster way to explore the results of one of my crazy 40-tag bookmarks, haha :]

If not a random page feature, would a 'Jump to Page...' option be possible, like where the ellipses is between page numbers at the bottom?

Or maybe an option to adjust how wide the range of page numbers are available to click down there? Even if the option is an absurd list of tiny numbers to fit 100 page links, that's still some fast and specific leaping!

Oh yeah, that's definitely something I can do.
Added it to the TODO list.

Was downloading some stuff today and noticed that not everything I had checked was being downloaded. After a bit of inspection, I think I've discovered that the downloader isn't saving anything larger than 5MB. I've looked through the settings and there isn't anything that would suggest I've inadvertently placed a limit somewhere. Is there something I may have missed, something by e6?

mdf said:
Was downloading some stuff today and noticed that not everything I had checked was being downloaded. After a bit of inspection, I think I've discovered that the downloader isn't saving anything larger than 5MB. I've looked through the settings and there isn't anything that would suggest I've inadvertently placed a limit somewhere. Is there something I may have missed, something by e6?

No, it shouldn't do that. I've tested it, and it has downloaded 60MB files for me just now.
Are there any errors in the console?

There is a hard limit of 800MB total per downloaded archive, but the script should just split it into multiple downloads then.
Try clearing the browser cache. The script downloads files into memory before putting an archive together, so that might be affecting it.

bitwolfy said:
Try clearing the browser cache. The script downloads files into memory before putting an archive together, so that might be affecting it.

Cleared, this net one additional image, 2160x3840 at 5.56MB. The new cutoff has moved somewhere in between there and 5.72MB. I can also confirm that it does split archives into separate downloads but I'm set to automatically view those for extraction. When trying to download a larger set of images, two folders were generated and downloaded, but the second downloaded with nothing inside while the first was incomplete.

The seventeen images selected do not appear among the downloads even though they are marked for and checked green for download.

Tag subscriptions are not shared between browsers. Added several tag subscriptions in Firefox, but when I logged in using Chrome, none were visible. v1.5.23 via Tampermonkey on both browsers.

gh3456 said:
Tag subscriptions are not shared between browsers. Added several tag subscriptions in Firefox, but when I logged in using Chrome, none were visible. v1.5.23 via Tampermonkey on both browsers.

Yes? Userscript settings are just not shared between different browsers (or different devices, for that matter) in general.
There is not much I can do about it.

gh3456 said:
Tag subscriptions are not shared between browsers. Added several tag subscriptions in Firefox, but when I logged in using Chrome, none were visible. v1.5.23 via Tampermonkey on both browsers.

Fastest way to get around that to my knowledge is to export your settings, then send it to yourself via email or cloud. Which might not be convenient if you want to do this often.

closetpossum said:
Having trouble getting this to work, what am I suppose to
install to get it on Tapermonkey or somethin?

Yes, you install it through Tampermonkey as well.
The installation link is in the first post, under "Releases". Or here.

bitwolfy said:
Yes, you install it through Tampermonkey as well.
The installation link is in the first post, under "Releases". Or here.

WOW this really is such a QoL improvement, Bit!
Honestly, do you work in the programming field as well?
Cause this is just wonderful work.

closetpossum said:
WOW this really is such a QoL improvement, Bit!
Honestly, do you work in the programming field as well?
Cause this is just wonderful work.

No, it's just a hobby lol.
But thank you.

hey its there a way to pass everything to another pc like favorited tags,pools and forums?

alecma said:
hey its there a way to pass everything to another pc like favorited tags,pools and forums?

Kind of. See krabitz' response above.

krabitz said:
Fastest way to get around that to my knowledge is to export your settings, then send it to yourself via email or cloud. Which might not be convenient if you want to do this often.

It won't transfer the notifications history, but it does include the stuff you are subscribed to.

Hey Bit, I had a feature idea, not sure if it's a thing yet with your programming, but I've been using it for a week now as I add over 400+ tabs of images to my Sets/gallery.
Sometimes I make mistakes and add the wrong pictures to the wrong sets.
Anyway you can program a button option or something to REMOVE FROM SET without going to the Set -> post menu nor going to the set and finding the image to remove.

A way to Unset the image while you're still on it and skip all the stuff I said above

Patch 1.5.24

Some functionality was ported to e621 itself and is thus no longer needed.

closetpossum said:
Hey Bit, I had a feature idea, not sure if it's a thing yet with your programming, but I've been using it for a week now as I add over 400+ tabs of images to my Sets/gallery.
Sometimes I make mistakes and add the wrong pictures to the wrong sets.
Anyway you can program a button option or something to REMOVE FROM SET without going to the Set -> post menu nor going to the set and finding the image to remove.

A way to Unset the image while you're still on it and skip all the stuff I said above

Yeah, sure, that should be possible.
I'll probably add it in the next patch.

Patch 1.5.25

Hotfix, actual patch coming later this week.

Changes
- Fixed a critical bug in the blacklist handling that caused some posts to not be filtered out correctly

A small feature that would be appreciated is an option to never have a post page blacklisted, since presumably if you're on the post page you want to see the one image being displayed. Thank you for your work as always!

Is there a way to keep all my tags I faved after updates? Two updates I had to reapply my favorite tags twice.
As the list gets longer, I spend more time reapplying my favorite tags than adding more images to my galleries.

No way for favorite tags/polls/forum posts, to carry over after update?

closetpossum said:
Is there a way to keep all my tags I faved after updates? Two updates I had to reapply my favorite tags twice.
As the list gets longer, I spend more time reapplying my favorite tags than adding more images to my galleries.

No way for favorite tags/polls/forum posts, to carry over after update?

... favorite tags?
The subscriptions should remain intact after updates, if that's what you mean.
In fact, I've just updated to the latest version of the script on my other device, and it the tags I'm subscribed to are still there.

What's your browser and script manager?
Also, are you browsing e621 in incognito mode?

krabitz said:
A small feature that would be appreciated is an option to never have a post page blacklisted, since presumably if you're on the post page you want to see the one image being displayed. Thank you for your work as always!

Funny, most people want the exact opposite: to not see the posts they have blacklisted at all.
Having an option to not blacklist posts on their individual pages should be possible.

bitwolfy said:
... favorite tags?
The subscriptions should remain intact after updates, if that's what you mean.
In fact, I've just updated to the latest version of the script on my other device, and it the tags I'm subscribed to are still there.

What's your browser and script manager?
Also, are you browsing e621 in incognito mode?

I don't use incognito, I let the world see my kinks, besides it's my laptop, I'm gonna look at what I want.
Jokes aside.
Honestly, the two updates, then and now, I've been uninstalling the (what I'd assume is the old code) and reinstalling the new code.
I feel like if I install the new code into Tapermonkey it'll just get rid of my Subscription anyway if it's overriding the past coding.

cause I copy/paste the code.

closetpossum said:
I don't use incognito, I let the world see my kinks, besides it's my laptop, I'm gonna look at what I want.
Jokes aside.
Honestly, the two updates, then and now, I've been uninstalling the (what I'd assume is the old code) and reinstalling the new code.
I feel like if I install the new code into Tapermonkey it'll just get rid of my Subscription anyway if it's overriding the past coding.

cause I copy/paste the code.

... why are you doing that?
Click on Tampermonkey's icon -> Utilities -> Check for userscript updates.
Or go to TM's dashboard and click on the number in the "Last Updated" column.

If you install the script correctly, it should update automatically.
1. Go to the script settings (wrench icon in the top right corner) -> Utilities tab -> Import / Export -> Export to file. That will give you a file with all your settings.
2. Uninstall RE621 completely by clicking the trashbin icon in Tampermonkey's dashboard
3. Install the script again by clicking on this link and clicking "Install" when the Tampermonkey window opens.
4. Open e621 again, go to the Import / Export section like before, and import your settings from file.

bitwolfy said:
... why are you doing that?
Click on Tampermonkey's icon -> Utilities -> Check for userscript updates.
Or go to TM's dashboard and click on the number in the "Last Updated" column.

If you install the script correctly, it should update automatically.
1. Go to the script settings (wrench icon in the top right corner) -> Utilities tab -> Import / Export -> Export to file. That will give you a file with all your settings.
2. Uninstall RE621 completely by clicking the trashbin icon in Tampermonkey's dashboard
3. Install the script again by clicking on this link and clicking "Install" when the Tampermonkey window opens.
4. Open e621 again, go to the Import / Export section like before, and import your settings from file.

how was I supposed to know any of that?
I got a D- in HS Cumputer Science class
post #1186035

closetpossum said:
how was I supposed to know any of that?
I got a D- in HS Cumputer Science class

Sorry ¯\_(ツ)_/¯
Let me know if any of the stuff I suggested either works or does not work for you.

bitwolfy said:
Sorry ¯\_(ツ)_/¯
Let me know if any of the stuff I suggested either works or does not work for you.

we'll see in the next update, till then I'll keep it in mind.

Patch 1.5.26

Changes
- Added a button to the set navbar to remove the post from said set
- Fixed the blacklist sometimes turning back on without user input
- Fixed an error that occured when approving posts from the search page
- Fixed the "Pending" ribbon on the post not updating when a post is approved from the search page

Would it be possible to show the tag suggestions in the edit box as well? It's already really useful but it could be even more

shadyguy said:
Would it be possible to show the tag suggestions in the edit box as well? It's already really useful but it could be even more

I vote that up ^^

shadyguy said:
Would it be possible to show the tag suggestions in the edit box as well? It's already really useful but it could be even more

Yes, probably.
I don't remember why I didn't implement that when I added the suggestions originally. I'll take a look.

frans7 said:
Thanks so much for the "Remove from set" 'x' button that was added!

No problem =3

This script is such a massive timesave and help, lol. It's pretty much already perfect in my opinion, but I'd like to ask; Any plans to add more of the "Add to (specified) set" hotkeys? Also a button/key to go to a random post in a set would be nice but maybe that's a bit niche.

Thanks again either way though, this script is already amazing ^^

frans7 said:
This script is such a massive timesave and help, lol. It's pretty much already perfect in my opinion, but I'd like to ask; Any plans to add more of the "Add to (specified) set" hotkeys? Also a button/key to go to a random post in a set would be nice but maybe that's a bit niche.

Thanks again either way though, this script is already amazing ^^

You need more set-specific hotkeys? Sheesh.
It's pretty easy to add more of those. I just don't want to clutter the hotkey settings page much, that's all.
I might put them in a collapsible section. How many do you need?

As for the "random post in a set" button – the existing random post hotkey takes your current search into account.
So, if you search set:<setname>, and press "R" (by default), it'll take you to a random post in the set.

bitwolfy said:
You need more set-specific hotkeys? Sheesh.
It's pretty easy to add more of those. I just don't want to clutter the hotkey settings page much, that's all.
I might put them in a collapsible section. How many do you need?

As for the "random post in a set" button – the existing random post hotkey takes your current search into account.
So, if you search set:<setname>, and press "R" (by default), it'll take you to a random post in the set.

Ah, okay. I missed that random post key then, thanks. As for the add to set hotkeys, I think it'd be nice to have 10 or so since k use 1-9 on the keyboard for it. But maybe that's too much, lol. A more modest ask would be 2-3 more.

I'm probably the exception and most people don't need more than 3, but who knows lol. Anyway, thanks again!

oi, when saving/favoriting tags when I get too many images in my tag's notification will the oldest picture in my notification be bumped off or something?
Is there a limit as to how many images can be in the notification's TAG section before oldest images get bumped off
or is my mind just playing tricks on me?
The more that gets added to the top, the more I feel the pics I haven't seen yet at the very bottom may be disappearing.
Which I hope not.

closetpossum said:
oi, when saving/favoriting tags when I get too many images in my tag's notification will the oldest picture in my notification be bumped off or something?
Is there a limit as to how many images can be in the notification's TAG section before oldest images get bumped off
or is my mind just playing tricks on me?
The more that gets added to the top, the more I feel the pics I haven't seen yet at the very bottom may be disappearing.
Which I hope not.

Yes, the notifications cache is has an upper limit.
It's mainly a technical limitation – the amount of storage I can use is not unlimited. You are capped at 500 posts being kept at any time.

I considered creating an option of adding subscription updates to a user-defined set, but I did not get around to it just yet.

bitwolfy said:
Yes, the notifications cache is has an upper limit.
It's mainly a technical limitation – the amount of storage I can use is not unlimited. You are capped at 500 posts being kept at any time.

I considered creating an option of adding subscription updates to a user-defined set, but I did not get around to it just yet.

damn, that's OCD triggering, now I'll constantly be thinking
of all the posts I haven't viewed yet being swept away.
big RIP

Script appears to cause layout issues when editing a post, as the description gets locked to an incorrect width, and a second set of editor buttons (write, preview, bold, etc.) gets created with incorrect layout and styling.

lafcadio said:
Script appears to cause layout issues when editing a post, as the description gets locked to an incorrect width, and a second set of editor buttons (write, preview, bold, etc.) gets created with incorrect layout and styling.

The editing buttons were ported to e621.
A patch that removes it from the script is incoming.

Patch 1.5.27

Changes
- Disable the FormattingHelper for now: it has been ported to e621
- Add two more "Add to Set" hotkeys

Possible Additions?

1) Unblacklist a Tag without going to Account > Settings

2) Add to Multiple Sets, not just one, at the same time.

closetpossum said:
Possible Additions?

1) Unblacklist a Tag without going to Account > Settings

2) Add to Multiple Sets, not just one, at the same time.

1. If it's one tag, and not a several on one line, you can click on an "X" next to it in the sidebar to unblacklist it.

2. That seems like a rather niche feature. What are you trying to accomplish?
You can assign the same hotkey to put the post into several sets at the same time.

lafcadio said:
Translation notes seem to briefly appear on posts, then disappear in under a second.

Are the notes enabled? It should say "Notes: ON" in the post toolbar.
https://i.imgur.com/CTdzzyO.png

I guess I must've accidentally hit the hotkey for that one at some point. Hotkey unbound, issue solved. ¯\_(ツ)_/¯

You can assign the same hotkey to put the post into several sets at the same time.

how do I make a hotkey?

Edit: nvm

bitwolfy said:

Patch 1.5.27

Changes
- Disable the FormattingHelper for now: it has been ported to e621
- Add two more "Add to Set" hotkeys

Thanks again! :D

Why did the Quote/Section/Tag/Link buttons not get added to the upstream formatting helper? They were very useful (the Wiki button, as well)

shadyguy said:
Why did the Quote/Section/Tag/Link buttons not get added to the upstream formatting helper? They were very useful (the Wiki button, as well)

The "Quote" button is in, it's the one on the far right.
For some of the buttons that did not make it in, it's because there were no obvious icons to use for them. The ones that were used in RE621 were kind of ambiguous, and I wanted to avoid that.
Some of the others required a prompt input, and I didn't want to overcomplicate the system.

I am currently working on adding a module to RE621 that lets you edit or add buttons to that toolbar.
Well, technically, it's already done, I'm just not happy with the implementation. Hopefully, I'll get it finished by Monday.