Topic: Direct upload whitelist requests

Posted under General

Uploading by URL is now possible again, but it's limited to whitelisted domains only. Therefore we need to start filling out said whitelist. If you have a site to suggest, please post it here, along with the domain that all images from that site reside on (for example d.facdn.net or *.deviantart.net).

Updated by MyNameIsOver20charac

Coming to mind right off are:

  • Tumblr: *.media.tumblr.com
  • Twitter: pbs.twimg.com
  • InkBunny: va.ib.metapix.net/files
  • Imgur: i.imgur.com

Updated by anonymous

TonyLemur said:
(for example d.facdn.net or *.deviantart.net).

Deviantart and Furaffinity is where I predominantly find what I think is suited for e621.

Updated by anonymous

leomole

Former Staff

SoFurry: www.sofurryfiles.com/std/content?page=*
Weasyl: cdn.weasyl.com/~*/submissions/*
Pixiv: i*.pixiv.net/img-original/img/* and i*.pixiv.net/c/1200x1200/img-master/img/*
Gelbooru: simg4.gelbooru.com//images/* and simg4.gelbooru.com//samples/* and gelbooru.com//samples/*
Sankaku Channel: cs.sankakucomplex.com/data/*
U-18Chan: u18chan.com/uploads/data/13325/*
8chan: media.8ch.net/*/src/*
4chan: i.4cdn.org/*

Updated by anonymous

Pixiv: i*.pixiv.net/img-original/img/* and i*.pixiv.net/c/1200x1200/img-master/img/*

I've never managed a direct upload from Pixiv, and I regularly see posts from other people saying the same. It doesn't seem very useful to whitelist it.

Updated by anonymous

leomole

Former Staff

Circeus said:
I've never managed a direct upload from Pixiv, and I regularly see posts from other people saying the same. It doesn't seem very useful to whitelist it.

Imgur seems to handle direct Pixiv uploads just fine. Maybe it's something that can be worked out?

Updated by anonymous

leomole said:
Imgur seems to handle direct Pixiv uploads just fine. Maybe it's something that can be worked out?

Of course, when I say "direct upload" I actually mean "sticking the image url in the file upload", so there may be a difference, but I wouldn't know the technical details.

Updated by anonymous

leomole said:
Weasyl: cdn.weasyl.com/~*/submissions/*
Pixiv: i*.pixiv.net/img-original/img/* and i*.pixiv.net/c/1200x1200/img-master/img/*
Gelbooru: simg4.gelbooru.com//images/* and simg4.gelbooru.com//samples/* and gelbooru.com//samples/*
Sankaku Channel: cs.sankakucomplex.com/data/*
U-18Chan: u18chan.com/uploads/data/13325/*
8chan: media.8ch.net/*/src/*
4chan: i.4cdn.org/*

I would think that the chans would be the source for a good number of the earlier problems, but then again, they probably also have stronger security for how popular they are.

Updated by anonymous

Furrin_Gok said:
I would think that the chans would be the source for a good number of the earlier problems, but then again, they probably also have stronger security for how popular they are.

I doubt it. Hacking another server to get an IP address from here (even on a machine with Windows 95-tier security) is going to be more complicated than just setting up your own .com and tracing it.

Updated by anonymous

Patreon
Post images: *.amazonaws.com/patreon.posts/*
Downloads: www.patreon.com/file?h=*&i=*

Because there are some artists who use patreon to post WIP and better versions of stuff, instead of using it as paywall which it shouldn't be.
Also posting this because even though Amazon AWS seems to be on whitelist, I still got error when tried to post patreon post image. Image address started with https://s3-us-west-1.amazonaws.com/ if this helps.

Updated by anonymous

TonyLemur said:
Uploading by URL is now possible again, but it's limited to whitelisted domains only. Therefore we need to start filling out said whitelist. If you have a site to suggest, please post it here, along with the domain that all images from that site reside on (for example d.facdn.net or *.deviantart.net).

You do know this is bypassable right?

(Save pic to PC > Upload to e621)

Updated by anonymous

leomole

Former Staff

TonyLemur said:
Uploading by URL is now possible again, but it's limited to whitelisted domains only.

Bj007pro said:
You do know this is bypassable right?

Uh oh, we'd better fix the whitelist!

Bj007pro said:
(Save pic to PC > Upload to e621)

... Yeah, no shit.

Updated by anonymous

Bj007pro said:
You do know this is bypassable right?

Yep. It's not that we wanted to prevent uploading from certain sites. We wanted to avoid the site's IP address being exposed to some sites and thus making the site vulnerable to DDoS attacks (like it happened not too long ago)

Updated by anonymous

Xch3l said:
Yep. It's not that we wanted to prevent uploading from certain sites. We wanted to avoid the site's IP address being exposed to some sites and thus making the site vulnerable to DDoS attacks (like it happened not too long ago)

Besides, uploading from a site for me, worked by copying the pic link to the source field and hitting upload. (I know it worked back then before the "Upload From URL" field was there.)

Updated by anonymous

Any particular reason wikimedia (wikipedia) isn't whitelisted? (guessing because uploads from there are rare)

anyway,

upload.wikimedia.org

and related

Updated by anonymous

DirtyRatMatt said:
I really hope that the Trashdump site can be whitelited, it has some pretty good stuff on it. Same goes for the /co/llection and The Big ImageBoard really.

TBIB: http://tbib.org/index.php?page=post&s=list
/co/llection: http://the-collection.booru.org/index.php?page=post&s=list
Trashdump: http://trashdump.booru.org/index.php?page=post&s=list

/co/llection and Trashdump are both hosted on booru.org so they're already allowed (all their image URLs are img.booru.org. Added TBIB.

404dotexe said:
Don't know if people use it much, but it makes sense to add:
rule 34 https://rule34.xxx/
FurryBooru http://furry.booru.org/

Both are already whitelisted.

titanmelon said:
Any particular reason wikimedia (wikipedia) isn't whitelisted? (guessing because uploads from there are rare)

anyway,

upload.wikimedia.org

and related

Added.

Updated by anonymous

Is fchan whitelisted?
Because you can't even mention e621 on fchan. If you try, you get this:
Fatal error! Message could not be posted.
Posting not allowed.

I'm sure they wouldn't want people uploading things from fchan to e621.

Updated by anonymous

Someone failed to make a spoiler.

Ahem.

I can mention e621.net on fchan all I like...

...with a inserts here and there.

Updated by anonymous

Bj007pro said:
Someone failed to make a spoiler.

Ahem.

I can mention e621.net on fchan all I like...

...with a inserts here and there.

You might get banned for it, though, if they blacklisted the term.

Updated by anonymous

parasprite said:
I helped! :D

Good Job! xD

Furrin_Gok said:
You might get banned for it, though, if they blacklisted the term.

Why? What does fchan have against e621? No one has ever mentioned anything to me yet.

Updated by anonymous

Bj007pro said:
Good Job! xD

Why? What does fchan have against e621? No one has ever mentioned anything to me yet.

No idea, actually. If you find out, let me know.

Updated by anonymous

Flickr.com please!
I don't know all of their direct picture links but I can give you at least one.

Here's one, farm7.staticflickr.com - I really doubt that they would have multiple ones.

Updated by anonymous

Wow. Nothing much new recently, huh? Well, how about HicceArs?

www.hiccears.com

Updated by anonymous

How about plain old inkbunny.net? I was having trouble direct uploading when I noticed they changed the direct url for images

Updated by anonymous

Gfycat
https://*.gfycat.com/*

By default gives WebM format, MP4 for unsupported browsers. Also stores couple Gif versions, small and original/huge generated from video upload. Even though generally lower video quality and some stuff being converted from gifs, there have been cases where highest quality version was on gfycat only or artist was using the site for gif hosting.

Updated by anonymous

Mario69 said:
Gfycat
https://*.gfycat.com/*

By default gives WebM format, MP4 for unsupported browsers. Also stores couple Gif versions, small and original/huge generated from video upload. Even though generally lower video quality and some stuff being converted from gifs, there have been cases where highest quality version was on gfycat only or artist was using the site for gif hosting.

+1 to this one, it seems Gfycat is getting more popular lately.

Updated by anonymous

Apparently, Pixiv needs to be re-whitelisted. I just got a new url from them.

Pixiv: https://i.pximg.net/

Updated by anonymous

Whitelisting base tumblr url would be helpful since you can still view pictures from it

https://media.tumblr.com/

Updated by anonymous

Blind_Guardian said:
Whitelisting base tumblr url would be helpful since you can still view pictures from it

https://media.tumblr.com/

+1, discussion on this issue can be found here.

Updated by anonymous

JAKXXX3 said:
+1, discussion on this issue can be found here.

+2, for some tumblr posts, the _raw version is only accessible like this

Updated by anonymous

Twitter: pbs-0.twimg.com

Also could just be easier to whitelist *.twimg.com

Updated by anonymous

How about Discord, for artists who directly communicate and send files to commissioners using the program?

Discord: https://cdn.discordapp.com/attachments/*

Updated by anonymous

I'd rather not we allow messengers or other image boards. The chance for reposts increases dramatically with their social nature and people just saving and spreading the thumbnails instead of the original files.

There's also a 5mb limit on direct uploads, most commission files should be larger than that limit, unless they're avatars.

Updated by anonymous

How about https://hiccears.com/ (which is an art site currently in beta which allows all fetishes)? It's used by some artists on Inbunny (like Aogami ) to give people a place to view art that involves both underage and humans (IB doesn't allow humans in adult situations, for those who don't know). However, not all art there is solely humans, and there is indeed a lot of furry and animal humanoid/kemonomimi stuff on the site.

Hiccears: https://hiccears.com/upl0ads/imgs/*

Updated by anonymous

Tumblr appears to have changed up their direct image system and now it seems that the only way to receive raw images is to change the media prefix to data, which is not covered by either Tumblr listings on the whitelist.

forum #243968

Tumblr (data.tumblr.com): http://data.tumblr.com/*

Updated by anonymous

BooruHitomi said:
Tumblr appears to have changed up their direct image system and now it seems that the only way to receive raw images is to change the media prefix to data, which is not covered by either Tumblr listings on the whitelist.

forum #243968

Tumblr (data.tumblr.com): http://data.tumblr.com/*

Changed.

Azula_Arktandr said:
How about https://hiccears.com/ (which is an art site currently in beta which allows all fetishes)? It's used by some artists on Inbunny (like Aogami ) to give people a place to view art that involves both underage and humans (IB doesn't allow humans in adult situations, for those who don't know). However, not all art there is solely humans, and there is indeed a lot of furry and animal humanoid/kemonomimi stuff on the site.

Hiccears: https://hiccears.com/upl0ads/imgs/*

Added.

Updated by anonymous

I've seen some furry art get uploaded to ArtStation.

ArtStation: https://cdn*.artstation.com/p/assets/images/images/* (The asterisk in the prefix is either an a or a b, although there could be more.)

Updated by anonymous

It seems that newgrounds hasn't been whitelisted; just found out after attempting a recent upload. The site, while not purely furry, has quite a few bits of content of the furry variety, including art and various flashes/games. Would be convenient and useful to whitelist it imho.

Can't seem to find the url for flashes/games/etc... Seems they removed the ability to see the swf files from viewing the source of the page. Perhaps they changed this up and it can be found another way? Don't know what it is myself, if anyone could help out with that it'd be swell. At the very least we do have the image source url:

https://art.ngfiles.com/images/*

Updated by anonymous

Noticed that some Gelbooru images have a simg3.gelbooru.com URL now, rather than simg4.gelbooru.com. Maybe whitelist *.gelbooru.com/* in anticipation of future URL changes?

Also, sankaku complex could be added too. https://cs.sankakucomplex.com/data/*

Updated by anonymous

Grimlock13 said:
Is there a reason why furaffinity isn't whitelisted?

It should be, but you need to link to the image on d.facdn.net and not the submission page.

Updated by anonymous

KiraNoot said:
It should be, but you need to link to the image on d.facdn.net and not the submission page.

Thank You

Updated by anonymous

Penguinempire-Dennis said:
Noticed that some Gelbooru images have a simg3.gelbooru.com URL now, rather than simg4.gelbooru.com. Maybe whitelist *.gelbooru.com/* in anticipation of future URL changes?

Also, sankaku complex could be added too. https://cs.sankakucomplex.com/data/*

Gelbooru now seems to be using simg3.gelbooru.com for all images.

Updated by anonymous

I'm surprised that Blogger hasn't been whitelisted yet, considering it's been around for years.

Blogger (Blogspot): http://*.bp.blogspot.com/*

Updated by anonymous

DeviantArt recently changed their image host to https://wixmp-*.appspot.com/_api/download/file?downloadToken=*

Updated by anonymous

JAKXXX3 said:
DeviantArt recently changed their image host to https://wixmp-*.appspot.com/_api/download/file?downloadToken=*

That's not all they did: the images that we see on the deviation (submission) pages (without downloading) seems to be all resampled at https://images-wixmp-*.wixmp.com/intermediary/f/*/*.jpg. So it seems that the only way to truly access the originals are now directly via the Download buttons if they are available and the artist allows them. I've noticed this as there was this low resolution JPEG that has been made downloadable by the artist and image that is shown on the deviation page is actually a lower-quality resample despite being the same resolution as its original counterpart.

Considering that the new URLs are longer and contain a whole bunch of random characters, I believe that DA is now using a encryption method to make it harder for people to access images that are not meant to be accessible, especially images that have been either "deleted" (which they were not really deleted from their servers) or only removed from public viewing by the artists.

Update (1:56 AM EDT on November 4, 2018): OK, so more on this. The image that I was mentioning earlier was this: post #1697356. That was originally uploaded on DA in 2017. However, I just managed to upload post #1697396 directly from the old orig00.deviantart.net, and that one was originally uploaded to DA just hours ago. I've also viewed an image that was uploaded just a few minutes ago and it too is using the old URL scheme. So I think that DA might be migrating much of their old images to third-party WiX servers so they can make room for newer images and other media files on their native servers.

Update (November 5, 2018): No, scratch that. It looks like that only JPEGs are only being transferred to the third-party servers. PNGs appear to still be uploaded directly to DA servers. I've just viewed two more images on DA; a PNG image that was uploaded in 2016 and a JPEG that was just uploaded hours ago, both of which the artists have allowed downloads of. The 2016 PNG is on DA's servers and the recent JPEG is on the third-party servers. The two posts that I've mentioned yesterday was a JPEG and a PNG, respectively. So in essence, it looks like that JPEGs on DA are screwed while PNGs are safe, for now.

Updated by anonymous

Considering the rise of artists on Newgrounds, I think we should add that site to the whitelist.

Newgrounds artwork: https://art.ngfiles.com/images/* (https://art.ngfiles.com/* could work, too.)
Newgrounds Flash and videos: https://uploads.ungrounded.net/alternate/* (Likewise, https://uploads.ungrounded.net/* could also work.)

Updated by anonymous

BooruHitomi said:
Considering the rise of artists on Newgrounds, I think we should add that site to the whitelist.

Newgrounds artwork: https://art.ngfiles.com/images/* (https://art.ngfiles.com/* could work, too.)
Newgrounds Flash and videos: https://uploads.ungrounded.net/alternate/* (Likewise, https://uploads.ungrounded.net/* could also work.)

Bumping this request considering that Newgrounds is supposedly getting a second wave of new members after Tumblr's recent announcement.

Updated by anonymous

BooruHitomi said:
Bumping this request considering that Newgrounds is supposedly getting a second wave of new members after Tumblr's recent announcement.

Yeah, I quite a while ago (a year now! time flies) suggested this very thing when uploading some NG stuff!

DiceLovesBeingBlown said:
It seems that newgrounds hasn't been whitelisted; just found out after attempting a recent upload. The site, while not purely furry, has quite a few bits of content of the furry variety, including art and various flashes/games. Would be convenient and useful to whitelist it imho.

Can't seem to find the url for flashes/games/etc... Seems they removed the ability to see the swf files from viewing the source of the page. Perhaps they changed this up and it can be found another way? Don't know what it is myself, if anyone could help out with that it'd be swell. At the very least we do have the image source url:

https://art.ngfiles.com/images/*

Hope that gets added to the whitelist.

Also, while tumblr is ridding its NSFW content, SFW furry content is still gonna be there, so adding a whitelist to the new tumblr file url types would be helpful as well.

Updated by anonymous

I just wanted to echo my support for everyone requesting Newgrounds

Updated by anonymous

I want to make some new suggestions and re-suggest a couple that I've made before. I want to see some more green yeses on the howto:sites_and_sources page's table.

  • ArtStation: https://cdn*.artstation.com/p/assets/images/images/* Re-suggestion (forum #244081); alternately, we could go with https://*.artstation.com/*.
  • Blogger (Blogspot): http://*.bp.blogspot.com/* – Re-suggestion (forum #256457).
  • Wix Media Platform (new DeviantArt URL): https://*.wixmp.com/* – Although whitelisting this will most likely not let us directly access full-size downloads due to the new encrypted download tokens, it would still be useful for getting the new larger preview images (much larger than the old img00 and pre00 ones from deviantart.net) if the originals are not directly downloadable, especially PNGs.
  • OneDrive: https://*.files.1drv.com/* – Dropbox may not allow their images to be viewed directly anymore, but Microsoft's cloud storage platform still does. Alternately, this could be simplified to https://*.1drv.com/*

Updated by anonymous

I've seen a few artists move over to piczel.tv after the Tumblr purge. The URL format is:

https://piczel.tv/static/uploads/gallery_image/*/image/*/*

Updated by anonymous

cf.mastohost.com/*

The format for image URLs for sites in the Mastodon network, such as Pawoo, Baraag, etc.

Updated by anonymous

BTW, discord is now added to the whitelist:

cdn.discordapp.com/*

This will hopefully give us necessary IDs to confirm that the content we get is from first party servers better as well as allow the site to have higher quality copies of artwork thanks to many artists having their own servers nowdays.

howto:sites_and_sources_-_a_to_m#discord

Updated by anonymous

JAKXXX3 said:
I've seen a few artists move over to piczel.tv after the Tumblr purge. The URL format is:

https://piczel.tv/static/uploads/gallery_image/*/image/*/*

Retard said:

https://piczel.tv/static/uploads/

I think I listed this right
https://piczel.tv/static/uploads/plain_image/37536/image/22157/26178930-Magnetus.png
If I didn't

+1 request for Piczel.tv, the image size limits are much higher than most of the sites on the whitelist.

Updated by anonymous