Topic: Recent Downtime (14th - 19th January 2011)

Posted under General

Hey Everyone,

I'd like to apologise to everyone who was affected by the recent downtime we've had for the past 5 days; straightforward issues (running out of memory on the main server - a really quick and easy fix) were compounded by me being away at Further Confusion - and with me developing food poisoning on the final day of my convention trip. :(

I'd like to thank ALL of you for your patience while the site's been down. It's been a long weekend, and I know I wasn't the only one who was pissed e621 wasn't available when needing my fix ;)

I know I should have assigned a Responsible Person (tm) to look after things while I was gone, and unfortunately I didn't count on possible helpers having their time sucked up by their day job... so yeah, this is my fault. In future, I'm going to ensure that I have someone else available and familiar with the system to stop things like this from happening while I'm away.

Any questions or comments about the recent downtime? Post 'em below!

UPDATE 1 - 9am PST, 19th Jan 2011:
The site is up, albeit slowly, due to the settings currently in use for the Ruby on Rails server that handles the actual dynamic pages on the site (it's set to only use one CPU core, which is maxed out). I'm working on learning how to optimize the Ruby on Rails server (which, amusingly, is called unicorn) so it works properly - I expect to get this done today, but I wanted to make an announcement so everyone's aware of what's going on first.

UPDATE 2 - 11am PST, 19th Jan 2011:
The site should be running quickly again, as the previous CPU bottleneck has been rectified. If anyone spots any issues (I spotted one involving all images being blacklisted when searching as an anonymous user, but I've not seen it since), please let me know in this thread and I'll take a look!

UPDATE 3 - 11pm PST, 19th Jan 2011:
Previous issues relating to site speed (again) and visibility of images (some pages were being listed as all-blacklisted) along with lots of strangeness regarding permissions have been rectified, and the site seems to be running well. Again, any bugs or issues, post them below so I can take a look into them. <3

Updated by xanonx

We are all-loving, all-forgiving and grateful that the site is back up.

<3

Updated by anonymous

Image posting, and the "posts" section are working, but search seems to be down still. 1000 thanks for you Varka! Ill take half of e621 over none of e621 any day!

Updated by anonymous

Fawxy said:
Image posting, and the "posts" section are working, but search seems to be down still.

Can you confirm this is still a problem? I've done a bunch of searches and it seems to be working properly now.

Updated by anonymous

It seems strange, but as for now the whole bunch of images are "blacklisted" for me. Even if I have no entries in blacklist.

Updated by anonymous

And there is also a javascript error:

> Error: missing ) after argument list
> Source File: http://e621.net/javascripts/application-min.js?1295459090
> Line: 15

And because of this error all js-functionality of this site, including replies posting, is not working. Probably, that's why there is silence here right now :)

As for users who want to join in conversation - just paste this js-code to address line and press enter:
> javascript:document.getElementById("reply").style.display='block';alert(done);

And respond form will appear :)

Updated by anonymous

Could be worse. Corruption sucks more than a few broken configs :P

Updated by anonymous

Thanks Ritsuka.

For me no images are showing at all in the post section.

Updated by anonymous

Yeah, just echoing the previous posters, I get no images in the "Posts" section either. I know people are working on it, just wanted to say something, kthxbai.

Updated by anonymous

Thanks Ritsuka- it works. Even if that's a short term solution it's good. The site still seems to go through mucho problemos Varka. And is doing it very chaoticly- now no posts are showing up on the site! None. And it seems the site doesn't actually "know" anything is wrong since there is no failbooru sign. Just no posts.

Updated by anonymous

All posts are here. They all are just blacklisted. To 'whitelist' them just use this:

> javascript:x=document.getElementsByTagName("span");for(i=0;i<x.length;i++){if(x.className.indexOf("blacklisted")>0){x.className='thumb'}};alert(/done/);All thumbs on page will appear.Ar just wait 4 Varka to fix it :)

Updated by anonymous

Thanks, Ritsuka. :)

All posts are still being blacklisted, even when logged in, despite what it says in the OP.

Updated by anonymous

Ritsuka- this supposed to work how exactly? Bicouse beside a pop-up window showing up, saying /done/, but no- posts still aren't there :-/

Updated by anonymous

Arrakiz, no luck for you :)

It works for me in FF and that's why I've shared this code. But I'm not planning to extend it for support of all browsers and platforms, cause it's just a temporary hack, nothing more)

Just wait for Varka to sort everything out :)

Updated by anonymous

If at any time you need my help, I'd be glad to.... God knows I don't have much else going on

Updated by anonymous

It wasn't the worst 5 days. the site was still mostly there, it was just harder to find images. 'Comments' section still showed the stuff (there are currently 11540 pages of images with comments), and so did 'pools'. Only issue I had, had nothing to do with the site, it's the fact that I'm on dial-up, so tinkering around for the last few days was really slow going. ;-)

Updated by anonymous

I'm getting the occasional "Downbooru" page with the update saying it'll be fixed Monday. If I refresh though, the image appears.

Then again I'm on Chrome, so that could be it.

Updated by anonymous

The posts section shows no images, but appears to search fine. I guess we gotta make do. Also, what happened to cause this massive fail?

Updated by anonymous

Ritsuka- this supposed to work how exactly? Bicouse beside a pop-up window showing up, saying /done/, but no- posts still aren't there :-/

Click posts to arrive at the first page of posts. Copy the snippet of script, without the angle bracket and space in front of it. (the "> " part. Omit that).

Paste it into the address bar of your browser, overwriting the URL already contained there. You should get the confirmation box and the images should appear. Worked for me in Chrome.

Updated by anonymous

Hey guys -

I think I've solved the fucked up blacklisting problem, and the javascript seems to similarly be fixed.

Let me know if you see any further issues!

Updated by anonymous

Im not pissed at all, these things happen. Im just happy the sites back up and running. Sorry to hear you got food poisoning, that sucks.

Updated by anonymous

Wow, 8 hours of me being asleep and nothing's exploded? Really?

Updated by anonymous

Site's back up and running for me as well (no more blacklisted pages). Good to see it (and you, of course) are back!

Updated by anonymous

Do you guys, like, want some help? If you need another mod or something I could probably put in a few community hours a week.

Updated by anonymous

Yaoilover921 said:
I can fap to yiff again!

Yaoilover921 said:
fap

Yaoilover921 said:
yiff

ಠ_ಠ

Updated by anonymous

Char

Former Staff

xanonx said:
Do you guys, like, want some help? If you need another mod or something I could probably put in a few community hours a week.

I think we're good on mods at the moment, but I'll always listen to any recommendations from the current mod team for future mods. They know they can ask for help if they need it.

I do appreciate the offer though. :)

Updated by anonymous

Ey dewd. I needed my fix just like u and I got rlly pissed when it wasn't up. But I mean it was a mistake so don't beat urself up over it... Just don't ever let that happen ever again or Imma get mad at u ): Esp. On a weekend. Kthx dewd. (:

Updated by anonymous

Char said:
I think we're good on mods at the moment, but I'll always listen to any recommendations from the current mod team for future mods. They know they can ask for help if they need it.

I do appreciate the offer though. :)

lol, it's not like I really have the time to sit down and admin every day, but I wouldn't mind helping here and there. I've got some years as a linux admin, fluent in pretty much everything (java, python, c/c++, .net) the usual shit. I just hate seeing sites go down for extended periods of time, the inner site-admin in me cringes.

Updated by anonymous

ExplosiveBlaziken said:
ಠ_ಠ

Yeah that's right. You gotta problem with that?

Updated by anonymous

Char

Former Staff

xanonx said:
lol, it's not like I really have the time to sit down and admin every day, but I wouldn't mind helping here and there. I've got some years as a linux admin, fluent in pretty much everything (java, python, c/c++, .net) the usual shit. I just hate seeing sites go down for extended periods of time, the inner site-admin in me cringes.

Now your sysadmin experience and knowledge is something that we might be interested in. I recommend you send an e-mail to [email protected] and discuss things with him.

Updated by anonymous

Char said:
Now your sysadmin experience and knowledge is something that we might be interested in. I recommend you send an e-mail to [email protected] and discuss things with him.

Lulz I sent him an email and I think he sent me a Skype request but then again idk cause I was drunk-facking-wasted last night and the Skype name didn't really look like varka?
Oooo, now that I think about it, if it is him, I hope he hasn't been calling me for the last day cause I totally left my Skype account logged on one of my other laptops that's been on and sitting in a vacant location for the last month. Email is probably the best option unless I'm hammered and then Skype calls usually get interesting.

Updated by anonymous

If you are fluent in python I'm involved with another furry project that needs more coders, if your willing to split some time. PM me if you are interested. :)

Updated by anonymous

Char

Former Staff

BACK OFF AURALI I SAW HIM FIRST >:|

Updated by anonymous

:p Meh, I dunno, some people can afford to spend more time. hell I'm involved with quite a few projects.

Updated by anonymous

Lawl, I try to stay away from larger group Python projects. I have no clue what you are using it for, but I only use it as a self-help tool, kind of like masturbation! It does everything and all, but when you break it down, python has some very sharp limits that if you step over them they will fack you with months of runtime. Obvious interpretation is obvious. Anyways, I'd be curious to know what you are working on, maybe provide some tips/pointers, but I am very busy.

Updated by anonymous

  • 1