Topic: Statistical/technical questions about the site

Posted under General

I have some statistical questions about the site:

Summing the file size of all posts together, how much disk space do the uploaded files occupy? Would it be possible to generate a logarithmic chart of "number of posts" over "filesize"?
I guess I could find that out by going through the API but if somebody has the numbers ready it would save me some effort.

How many posts, on average, are uploaded each day? Are you expecting to hit any limits anytime soon and are there any limits in place? I mean limits like "What happens when somebody uploads a really huge file?", "What happens when we hit a certain number of posts? (e.g. 2^31, even though that's huge)" or "What happens when the total disk space mentioned above exceeds some limit?". Is there a limit on how big an uploaded file can be? The biggest file so far (found with https://e621.net/post/index/1/order:filesize ) is this 100 MB monster: https://e621.net/post/show/950016 .

Have you ever had any problems with MD5 collisions? What if I found a legitimate file (i.e. not a duplicate and not garbage) which has the same MD5 as an existing file and I uploaded that. How would the conflict be resolved?

Updated by banhday

Lance_Armstrong said:
e621.net/static/more

Stats on bottom left.

e621.net/stats

Average file size 821 KB
Total file size 764 GB
Average posts per day 281

wow, getting on up near 1 TB, huh? well, in time anyway.

Updated by anonymous

Since a few days went by with nobody answering I just wanted to add that I still have unanswered questions.

Updated by anonymous

There is a limit to 100MB.

The rest of your questions have pretty much zero chance of happening, and if they did they would produce a recoverable error.

Updated by anonymous

That posts per day must be very skewed by the early history of the site. There's only been one day this year under 500 posts per day (March 21st) and two days (July 9th and 10th) there were over 1000 posts per day.

Updated by anonymous

Genjar

Former Staff

post #796405 was the first post of 2016, and we're currently up to post #995521.
199116 posts so far, divided by 256 days... 777 posts per day. 592 per day in 2015.

Updated by anonymous

Wow we're at less than 1TB?
I've always had the impression it must be at least 4TB.

Updated by anonymous

  • 1