Topic: API question - automatically find pools?

Posted under General

Anyone know how I might be able to go about automatically finding (and/or outputting urls to) pools from artist tags? Only way to see is by going to each image page and seeing if it's part of a pool, and for artists with hundreds or thousands of images that's just not feasible by hand. And with pools not having their own tags aside from what's put in the pools name you can't just search there, either.

kendrakirai said:
Anyone know how I might be able to go about automatically finding pools from artist tags? Only way to see is by going to each image page and seeing if it's part of a pool, and for artists with hundreds or thousands of images that's just not feasible by hand. And with pools not having their own tags aside from what's put in the pools name you can't just search there, either.

inpool:true

kendrakirai said:
Okay, but how can you get which pool they're in? That's useful, but only half of my problem.

Well, you go into the most recent post, see the pool name, and append -pool:poolname to the search and repeat. I doubt the artist will have more than 39 pools

Or you can wait between 4 weeks to 100 years for the dev to make pool tags

oh this is about the api

kendrakirai said:
Anyone know how I might be able to go about automatically finding (and/or outputting urls to) pools from artist tags? Only way to see is by going to each image page and seeing if it's part of a pool, and for artists with hundreds or thousands of images that's just not feasible by hand. And with pools not having their own tags aside from what's put in the pools name you can't just search there, either.

Assuming you know anything about programming, use the db exports, and cross reference posts with pools

https://e621.net/db_export/

Note that the post list in pools in in the pg array format ("{1,2,3}")

You can also use my script I've made here: topic #44841
It allows searching pools by tags

You can use https://e621-pools.furry.cool/json?search[tags]= as an api

donovan_dmc said:
Assuming you know anything about programming, use the db exports, and cross reference posts with pools

https://e621.net/db_export/

Note that the post list in pools in in the pg array format ("{1,2,3}")

Sure, but that's going to be out of date and be far slower unless there's more than around 10 pages of results with a good parser.

Unless you index, which in your followup I assume you do.

scth said:
Sure, but that's going to be out of date and be far slower unless there's more than around 10 pages of results with a good parser.

Out of date by 24 hours at most, and pools don't really change that often (there are a grand total of 129 pool changes in the last ~24 hours, and 180 the day before)

Hmmmmm. Well this all does seem very useful, but it also very quickly went over my head. Perhaps I should clarify I'm hoping to figure out how to get gallery-dl to do all this for me.

Like, my hope was that I give it a (for example) artist tag, it goes through the tag, detects if an image is in a pool, then, at minimum outputs the pool(s) to a text file (which I can then process to remove duplicate entries and run through separately).
Or goes and downloads the whole pool on its own. mikf over at the github suggested I ask here if there was a recommended way or an API endpoint that supports it.

kendrakirai said:
Hmmmmm. Well this all does seem very useful, but it also very quickly went over my head. Perhaps I should clarify I'm hoping to figure out how to get gallery-dl to do all this for me.

Like, my hope was that I give it a (for example) artist tag, it goes through the tag, detects if an image is in a pool, then, at minimum outputs the pool(s) to a text file (which I can then process to remove duplicate entries and run through separately).
Or goes and downloads the whole pool on its own. mikf over at the github suggested I ask here if there was a recommended way or an API endpoint that supports it.

Probably not getting gallery-dl to do it directly, but the tool Donovan made and mentioned (https://e621-pools.furry.cool/json?search[tags]=) would at least give you a direct JSON result, which is basically what you wanted (it's just a file listing all the pools matching the given tags).

scth said:
Probably not getting gallery-dl to do it directly, but the tool Donovan made and mentioned (https://e621-pools.furry.cool/json?search[tags]=) would at least give you a direct JSON result, which is basically what you wanted (it's just a file listing all the pools matching the given tags).

Okay, that's a good 'un, I might be able to do something with this...somehow....