Topic: e621 Downloader made in Rust that can download sets, pools, bulk posts, and single posts!

Posted under e621 Tools and Applications

mcsib said:
Thanks for understanding the situation. There are a ton of bugs that have popped up recently, new feature requests I need to look through, and those "wonderful" dependency security bugs (have to love them) that have popped up. I can't give time estimates for when I can work on the project, but I will be able to soonish.

As for the question, I have considered making a toggle for the post limiting in the downloader. The only reason I haven't is due to scrapes. I don't know how good the servers on e621 are, but I'm reluctant to make that functionality easier as not to anger the e621 staff into emailing me about it (I mean that as a light joke). It more or less depends, if an admin or staff worker gives me a thumbs up that I'm good to implement that toggle, I can add it. I just remember way back then when other downloaders did the same thing with other sites, and then immediately DDOSed the servers with hundreds of users downloading 20k+ images. That's something I'd rather not do. The main worry, in this case, wouldn't be a DDOS situation (most modern servers have gotten better about it) but more so throttling.

I obviously can't answer for the staff but in the API FAQ there's no mention that I've seen about a max number of downloads, only that the request rate should be limited to 1/sec or less. If you decide to implement the toggle, maybe adding a throttle to it that goes slower than it currently does and letting the user know that the trade-off on large scrapes is a slower speed would be a good compromise?

drakkenfyre said:
I obviously can't answer for the staff but in the API FAQ there's no mention that I've seen about a max number of downloads, only that the request rate should be limited to 1/sec or less. If you decide to implement the toggle, maybe adding a throttle to it that goes slower than it currently does and letting the user know that the trade-off on large scrapes is a slower speed would be a good compromise?

oh sorry did not read it so it can download individuals tabs

Thanks for the tool, and sorry for asking! ... but what exactly is the command, to download all my favorited pictures? Thanks in advance.

I'm not tech savvy so I thought someone was making a system to put E621 images in the game Rust XD All I could think of is someone raiding a base only to be blasted by Knots XD

Anyway keep up the good work, seems like a real handy tool!

Something changed recently and broke... I think the ability to parse some tags? I haven't narrowed down exactly what's busted yet.

magnuseffect said:
Something changed recently and broke... I think the ability to parse some tags? I haven't narrowed down exactly what's busted yet.

It looks like it could just be unpopulated tags breaking it, but it came off as unusual that so many broke at the same time.

Edit: It was 2 recently-DNP artists and another tag I input wrong.

Updated

Thank you for this forum post, McSib!

Your awesome script saved me a lot of time and trouble.

hey there, first of all this seems so awesome and thanks for sharing it... I don't actually understand how to use it though... I'm not savvy in programing. I tried following your instructions and downloaded everything you said. I get lost right after downloading Git. I'm not sure how to do anything in the bullet on the second step of the windows install guide. I'm not sure if it is worth your time to explain this to novices or better yet my a tutorial video. I'd really love to be able to use a program like this, though.

edit: I gave up and uninstalled everything. When I went to uninstall the rust program and my vpn was completely fried. I had to uninstall and reinstall it to get it working again. I've run several antivirus programs since and nothing came up, but it was very unsettling.

Updated

Sorry,but who can tell me how to edit the directory? I want to edit the directory to "E:/work", but I find if I write that in the config the downloader will not work.
How to edit the config?I mean how to write if my directory is "E:/work"?I should write "E:/work" or“E:work” or “work” or what?

Hello everyone.

So i basically using e621_downloader and it is a neat tool.
However I cant figure it out how to downlad images with specific character on it.
When i put string like

[general]
character: character_name

And all othger tags are empty, save tags.txt file and lauch the program, it asks me for safe mode, and then crashes without any download. What I'am doing wrong? Did i need to fill other tags as well, like [pools] etc?

  • 1
  • 2