Topic: RE621 [v.1.5.72] Feature-packed toolkit and mass downloader for e621

Posted under e621 Tools and Applications

im getting a bunch of errors, its random the amount but this time a lot came in

re621 v.1.5.68-240301:1940-11 for Tampermonkey v.5.0.1
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36

PoolTracker/update
{"error":"unknown error"}

TagTracker/update
{"error":"503 "}

PoolTracker/update
{"error":"unknown error"}

PoolTracker/update
{"error":"503 "}

ForumTracker/update
{"error":"429 "}

CommentTracker/update
{"error":"429 "}

TagTracker/update
{"error":"429 "}

alecma said:
im getting a bunch of errors, its random the amount but this time a lot came in

re621 v.1.5.68-240301:1940-11 for Tampermonkey v.5.0.1
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36

PoolTracker/update
{"error":"unknown error"}

TagTracker/update
{"error":"503 "}

PoolTracker/update
{"error":"unknown error"}

PoolTracker/update
{"error":"503 "}

ForumTracker/update
{"error":"429 "}

CommentTracker/update
{"error":"429 "}

TagTracker/update
{"error":"429 "}

Those are ratelimiting errors, the unknown ones are probably network errors

Got an error while trying to update the Source field on post #4641866. The update went through, but this popped up on the page refresh instead of loading the page like normal.

re621 v.1.5.68-240301:1940-11 for Tampermonkey v.5.1.0 Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:124.0) Gecko/20100101 Firefox/124.0 Miscellaneous/init window["__f__lua62hxn.t2o"]/</<[23]</PostData.fromDOM@moz-extension://81892a8f-7a0b-4f78-a476-8deef3d0ee5e/userscripts/re621-e621-Reimagined.user.js?id=85d6d206-9ab7-4d3b-8d1c-659e3a4e1c59:97:71315 getViewingPost@moz-extension://81892a8f-7a0b-4f78-a476-8deef3d0ee5e/userscripts/re621-e621-Reimagined.user.js?id=85d6d206-9ab7-4d3b-8d1c-659e3a4e1c59:97:67532 addRemoveFromSetButton@moz-extension://81892a8f-7a0b-4f78-a476-8deef3d0ee5e/userscripts/re621-e621-Reimagined.user.js?id=85d6d206-9ab7-4d3b-8d1c-659e3a4e1c59:97:225636 create@moz-extension://81892a8f-7a0b-4f78-a476-8deef3d0ee5e/userscripts/re621-e621-Reimagined.user.js?id=85d6d206-9ab7-4d3b-8d1c-659e3a4e1c59:97:219970 register@moz-extension://81892a8f-7a0b-4f78-a476-8deef3d0ee5e/userscripts/re621-e621-Reimagined.user.js?id=85d6d206-9ab7-4d3b-8d1c-659e3a4e1c59:97:1577

I've seen this issue mentioned before so this is more asking if there's a workaround or update about it that I missed than a report.

When I do a search, uncheck one of my blacklisted tags, then go to the next page, the whole blacklist is disabled instead of just the one item. IIRC the vanilla behavior is to forget anything was unchecked at all and enable the whole thing. The ideal would be to remember the state between page changes, but the vanilla behavior is better...

Mdf

Member

donovan_dmc said:
Those are ratelimiting errors

I'm also getting a tag tracker error, except "422", same thing I hope?

m3g4p0n1 said:
Not sure if it's been requested before, but is it possible, or feasible, to add the ability to bundle watched tags on their own groups/folders? Like how watched pools are handled.

Yea I second this one, I got a lot of tag collections and grouping them together or having them as a list would be really helpful.

So Firefox mobile expanded its add-on support recently, which means you can have RE621 on your phone.
Unfortunately, you have to disable mobile mode support, otherwise it breaks header and some other stuff (and even then it's kind of broken ).
So if not outright fix, there at least should be a toggle for all the modifications that the script does to pages.

I decided to try this out to do the long-overdue thing of downloading all my favorites (over 6k). Not too knowledgeable about this kind of thing but got it working...

About 9 hours and 26 "batches" downloaded later, my crappy internet and computer couldn't take it anymore, and hung so I had to hard shutdown. Anyone got any suggestions of how I can pick up where I left off or am I SOL? There doesn't seem to be any way to tell what favorites I've already downloaded.

So is it hours of OCD-fueled counting, comparing and checking ahead as I try to finally realize my goal of having my favorites archived offline?

Just in case someone in the future is reading this thread and is curious what happened in my case, the answer was kinda "Yes" in the end but not as complicated.

RE621 downloads everything from most recently added and works backwards. Once I figured that out, I was able to find the page and eventually the exact image the downloading process stopped on by looking through the last "batch" folder I got, finding a picture of an artist I knew well and locating it in my favorites pages. Turns out the process stopped about 10 pages shy of the end. I decided to download the last few hundred the "old fashioned way" for some good ol' masochistic fun. And it was also a fun way to rediscover some art from a few years back that I didn't even remember.

Needless to say I'm gonna be keeping up with downloading my favorites, pretty much as I make them or as close to it as is convenient. I'll probably be a bit more selective with it, too.

re621 v.1.5.68-240301:1940-11 for Tampermonkey v.5.1.1
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36

TagTracker/update
{"error":"520 "}
got an error code for you

re621 v.1.5.68-240301:1940-11 for Tampermonkey v.5.1.6194
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36 OPR/109.0.0.0

TagTracker/update
{"error":"422 "}

Wish I could give more info

Edit: 2 hours later it suddenly started working after 24 hours of it not.

Updated

New issue I've noticed lately:
Using the download button to save files around 29-32MB or larger will download the file (I see the network activity) but never actually save it to the downloads folder, the wheel just keeps spinning in circles.
Examples of posts this happened trying to download:
post #4737421 (95.3MB)
post #4288207 (32.1MB)
post #3262208 (32.1MB)
post #3231366 (32MB)
post #3407899 (31.7MB)
post #4079679 (30.6MB)
post #2676806 (30.5MB)
post #4748715 (29.6MB)
No issues downloading these though:
post #2516722 (30.5MB)
post #4035139 (29.5MB)
post #3845639 (28.1MB)

OS: Windows 10 64bit 22h2
Browser: Brave 1.67.123 (Chromium: 126.0.6478.126 (Official Build) (64-bit))
Tampermonkey 5.2.0
Another machine with the same OS and Browser but Tampermonkey 5.2.1 also had the same behavior

Did not notice the issue with Firefox 127.0.2 64 bit on the same Windows installation with Tampermonkey 5.1.1
Did not notice the issue with the same version of Brave on Win 11 with Tampermonkey 5.0.1, but DID after updating Tampermonkey to the latest version 5.2.1
Did not notice the issue with Brave on Kubuntu with Tampermonkey 5.1.1 but DID after updating Tampermonkey to latest version 5.2.1

I feel like I didn't have this issue before, or at least did not notice it until updating to Re621 1.5.69, but after downgrading to 1.5.68 and still experiencing the same problem, it seems to be something to do with Tampermonkey. Did not have the issue when using the latest Violentmonkey (2.19.0) for the script instead of Tampermonkey (5.2.0) (W10, Brave 1.67.123).

Because of E6's new rule change and recent purge I wanted to back up my favorites, but astonishingly I have well over 6000 favorited images.
I've tried using the download feature about 3 times now and for some reason it always gets stuck on the 18th file. It just keeps saying "compressing... 100%" and it stays that way until I give up and refresh.
Since the script shows deleted posts and no consistency when it comes to how many files are in a single part, I'm left guessing where the plugin left off.

Hey, apologies if someone already asked this- Earlopain and BitWolfy aren’t e6 staff anymore, will this affect RE621 development?

unknown_scientist said:
Because of E6's new rule change and recent purge I wanted to back up my favorites, but astonishingly I have well over 6000 favorited images.
I've tried using the download feature about 3 times now and for some reason it always gets stuck on the 18th file. It just keeps saying "compressing... 100%" and it stays that way until I give up and refresh.
Since the script shows deleted posts and no consistency when it comes to how many files are in a single part, I'm left guessing where the plugin left off.

Hey, not sure if you've figured this out already, but take a look at my posts on the bottom of the previous page on this thread (13). I have around the same amount of favorites and had the same thing happen back when I tried to do this. I have a feeling it's just unstable after a certain amount, unless you have really good internet etc.

Basically just look in the last "part" folder you got, find a few images by artists you're familiar with and then kinda guess around at what page they may be on based on how many you think you got in the entire download. As soon as you find one of them, you can figure out where it stopped at. A decent P.I.T.A. but worth it in the end... and thanks to the "recent events" I'm just downloading everything as soon as I favorite it pretty much.

unknown_scientist said:
Because of E6's new rule change and recent purge I wanted to back up my favorites, but astonishingly I have well over 6000 favorited images.
I've tried using the download feature about 3 times now and for some reason it always gets stuck on the 18th file. It just keeps saying "compressing... 100%" and it stays that way until I give up and refresh.
Since the script shows deleted posts and no consistency when it comes to how many files are in a single part, I'm left guessing where the plugin left off.

bossmt-2 said:
Hey, not sure if you've figured this out already, but take a look at my posts on the bottom of the previous page on this thread (13). I have around the same amount of favorites and had the same thing happen back when I tried to do this. I have a feeling it's just unstable after a certain amount, unless you have really good internet etc.

Basically just look in the last "part" folder you got, find a few images by artists you're familiar with and then kinda guess around at what page they may be on based on how many you think you got in the entire download. As soon as you find one of them, you can figure out where it stopped at. A decent P.I.T.A. but worth it in the end... and thanks to the "recent events" I'm just downloading everything as soon as I favorite it pretty much.

Are you guys using Tampermonkey 5.2.0 or above on Chrome for the RE621 script? If so, try disabling Tampermonkey, install Violentmonkey, install RE621 again on Violentmonkey, and then try downloading the favorites the way you had before. I was able to get through one batch before I stopped it, just to make sure it was working for me.
I mention this specifically because I had issues with larger singular posts timing out while downloading (in an earlier post just above these), so maybe Tampermonkey 5.2.0+ has to do with it.

jerdude002 said:
Are you guys using Tampermonkey 5.2.0 or above on Chrome for the RE621 script? If so, try disabling Tampermonkey, install Violentmonkey, install RE621 again on Violentmonkey, and then try downloading the favorites the way you had before. I was able to get through one batch before I stopped it, just to make sure it was working for me.
I mention this specifically because I had issues with larger singular posts timing out while downloading (in an earlier post just above these), so maybe Tampermonkey 5.2.0+ has to do with it.

Not sure what version of Tampermonkey I was using, but it would've been whatever was the most recent a month or so ago, since I downloaded it for the first time specifically for this. My case was on Firefox, though. The reason I'm vague is because I did this on a backup computer I don't use very often that isn't convenient for me to grab right now and check.

Still, that's helpful to know in case I ever want to try this again. Thanks!

dimoretpinel said:
Hey, apologies if someone already asked this- Earlopain and BitWolfy aren’t e6 staff anymore, will this affect RE621 development?

[Yes I know this is a reply to a banned user, but for clarity to anyone reading]

Earlopain was entirely unaffiliated with re621 and had no involvement in it.

Wolfy still works on it in his freetime, but doesn't have much freetime these days. Myself and others have chipped in with it where we can too though.

ShadyGuy

Privileged

Looks like the smart-alias box (the one that opens under each tag input textarea in the upload page) no longer appears for the artist, characters, "Body Types and Species" or "Contentious Content" textareas, it now only works for the "Other Tags" or when editing a post

shadyguy said:
Looks like the smart-alias box (the one that opens under each tag input textarea in the upload page) no longer appears for the artist, characters, "Body Types and Species" or "Contentious Content" textareas, it now only works for the "Other Tags" or when editing a post

Oh, that might have been my fault.
Those fields had been renamed in a recent patch.

Anyone else getting "status breakpoint" on a "this page is having a problem" page when trying to edit tags? Not constantly, but occasionally it'll just show that page. I don't see anything in the console when it happens; it seems to cause some form of refresh, clearing the console and network log. It seems to be an issue with RE621, since it only happens when the extension is loaded.
Tampermonkey 5.1.1.

Would it be possible to add the subscriptions page to the header? I feel like only having it as a box on the side is kinda inconvenient.

Hey, I checked the github release changelog but didnt see anything, so sorry if this has been covered. But did you remove the 'x' button near the set nav list that removes it from that set? I disabled my CSS and everything to make sure it wasnt user error but it's gone it seems. I really liked using that.

I swear, how do I install the script on TamperMonkey?
I've done it like 4 times now, but forget HOW I did it, each time I need to do it again.
Figured it out again: Open Extension -> Dashboard -> Utilities -> Import

corpse-thing said:
I swear, how do I install the script on TamperMonkey?
I've done it like 4 times now, but forget HOW I did it, each time I need to do it again.
Figured it out again: Open Extension -> Dashboard -> Utilities -> Import

That seems like a pretty roundabout way of doing it.
I believe that bitWolfy's recommended way of installing the script is just to go to https://re621.app/ and click on the button labeled "Latest <version>".
Tampermonkey should take care of everything from there.

UPDATE: I went ahead and implemented it as a setting, my pull request can be seen here

Question: I've been wanting to adjust the behavior of the "focus search" hotkey to more closely match vanilla e621. Currently, the re621 hotkey puts the cursor at the very beginning of any text that is currently in the search bar, unlike vanilla e621 that puts the cursor at the end of the current query. However, since re621 is all about customization, I'm debating whether or not to add a setting that allows a user to toggle between the two behaviors. As such, I'd like some feedback on the options.

1. Add setting to allow switching between focusing the cursor to the beginning or the end of the text in the search bar

2. Just modify the behavior of the hotkey so that it always focuses the cursor to the end of the search bar

3. Leave it as-is, with the hotkey focusing the cursor to the beginning of the search bar

Updated

Hi, sorry to bother but is there a way to make hover zoom images be scaled to screen/display size?

Suggestion for mass download own favorites. Just generate *.txt with only links where you can paste it to download manager. No problems to continue in case of sudden interruption. Not needed to wait endless “compression”

yetanotheraiuser said:
Suggestion for mass download own favorites. Just generate *.txt with only links where you can paste it to download manager. No problems to continue in case of sudden interruption. Not needed to wait endless “compression”

Sounds like a good idea, I just have a few questions I want to clarify:

1. Should the links go to posts themselves (e621.net/posts/<id>) or to the files on the CDN (static1.e621.net/data/<data>)?
2. Should this only be available for the favorites downloader, or could it also be used for the mass downloader and pool downloader? Should they all have the same unified setting in the Downloads settings tab, or should each individual module have their own separate setting?
3. What download manager are you wanting to use? I just wanna know so that changes can actually be tested in a real environment.

Updated

Could the "voting buttons" and "favorite button" that appear on thumbnails in the post pages also appear in the thumbnails of pools?

anonjohn20 said:
Could the "voting buttons" and "favorite button" that appear on thumbnails in the post pages also appear in the thumbnails of pools?

Possibly, but not readily. The BetterSearch module that adds voting and favorite buttons on thumbnails can only work properly on the post search and favorites pages due to the other stuff it handles (infinite scroll, pagination, etc). The buttons are technically rendered, but the BetterSearch module handles them actually showing up when you hover over a thumbnail.

Apparently pool pages don't use the re621 Post object that's used where those buttons do show up. I'll take a look into it further.

Updated

atomicblaze21 said:
Possibly, but not readily. The BetterSearch module that adds voting and favorite buttons on thumbnails can only work properly on the post search and favorites pages due to the other stuff it handles (infinite scroll, pagination, etc). The buttons are technically rendered, but the BetterSearch module handles them actually showing up when you hover over a thumbnail.

Apparently pool pages don't use the re621 Post object that's used where those buttons do show up. I'll take a look into it further.

I didn't know making quality scripts was so complicated. At least I can say that this one is really well done.

I noticed re621 not working but I also see tampermonkey wanting users to activate developer mode for it, so maybe that's why? Must have been a recent change (for chrome users at least). Is tampermonkey (or google) overreaching/being sneaky in any way with that? Or is it fine; just turn on dev mode for re6 to work like normal? Thanks for any help

human-shaped said:
I noticed re621 not working but I also see tampermonkey wanting users to activate developer mode for it, so maybe that's why? Must have been a recent change (for chrome users at least). Is tampermonkey (or google) overreaching/being sneaky in any way with that? Or is it fine; just turn on dev mode for re6 to work like normal? Thanks for any help

Same issue for me. Also tried enabling dev mode, still not working. Using Brave browser.
EDIT: reinstalling re621 seemed to fix my issue!!

pewdiecrustlesspie said:
Same issue for me. Also tried enabling dev mode, still not working. Using Brave browser.
EDIT: reinstalling re621 seemed to fix my issue!!

I tried reinstalling while still using Chrome and still not enabling dev mode, but it still doesn't work. Maybe it really does need dev mode now? I wonder why. Does anyone know anything about this recent change?

Thanks again for any help

Damn this changed my e6 experiences entirely! thank you so much for creating this!

Apologies if was asked already, but can this download images/media taking into account my blacklist? Much easier to use it than specify tags to exclude each time.

Updated

human-shaped said:
I noticed re621 not working but I also see tampermonkey wanting users to activate developer mode for it, so maybe that's why? Must have been a recent change (for chrome users at least). Is tampermonkey (or google) overreaching/being sneaky in any way with that? Or is it fine; just turn on dev mode for re6 to work like normal? Thanks for any help

pewdiecrustlesspie said:
Same issue for me. Also tried enabling dev mode, still not working. Using Brave browser.
EDIT: reinstalling re621 seemed to fix my issue!!

I did have to turn on dev mode (on both Brave and Chrome), and for some reason it took about 15 minutes before the script finally started to work.

Not sure if this is the right place to make requests, but I'll make it here: Is there anyway to apply blacklists into the subscribed tags notifications page?

It's cool when I get a notification about a new post with my favorite tag in it

Not so cool when that same post also has my most hated tag in it, which is already blacklisted but ends up showing in the notifications anyway :P

Hover zoom doesn't seem to work anymore for thumbnails under "Posts" in wiki pages

gattonero2001 said:
Hover zoom doesn't seem to work anymore for thumbnails under "Posts" in wiki pages

Also the popular page.

faucet said:
Also the popular page.

Or the profile pages, or in pools, or on a post itself when it has a parent/child post.. I also noticed that the info bar underneath each post has the favorite count in white instead of yellow, and the parent/child/flagged/pending status appears only as a border rather than having the overlay in the corner.

gattonero2001 said:
Hover zoom doesn't seem to work anymore for thumbnails under "Posts" in wiki pages

faucet said:
Also the popular page.

jerdude002 said:
Or the profile pages, or in pools, or on a post itself when it has a parent/child post.. I also noticed that the info bar underneath each post has the favorite count in white instead of yellow, and the parent/child/flagged/pending status appears only as a border rather than having the overlay in the corner.

It appears that this is a result of a recent pull request for the base e621 site that overhauls the thumbnail CSS styles. re621 has a LOT of functionality that's dependent upon the CSS class(es) of an element, and this recent update broke a lot of them. I already fixed one issue that was manifesting as a result (relationship/status ribbons not rendering on profile page or pools), but the problems appear to be far more widespread. I'll take a look tomorrow at all the different places where the old class names were referenced and see if I can replace them with the new versions.

EDIT: I got it working, here's the pull request.

Updated