PDA

View Full Version : Server Issue

Shrimpy
10-22-2010, 11:12 AM
Something is wrong with the server. Trying to figure out exactly what's going on.
Shrimpy
10-22-2010, 11:20 AM
Looks like it was the ranking script that blew up. Everything should start coming back around in a second.

edit: Server reboot underway.
Shrimpy
10-22-2010, 11:34 AM
Annnnnd we're back.
Shrimpy
10-22-2010, 05:12 PM
Something else is going on now. Looking into it.
Shrimpy
10-22-2010, 05:22 PM
Fixing some tables, things should be back in action soon.
Shrimpy
10-22-2010, 06:04 PM
Back up now. Looks like part of the issue has been a lack of hard drive space. I'm clearing up space now.
Shrimpy
10-28-2010, 08:12 AM
Seems to have happened again. I know 100% what the issue is, so once this script finishes running, I'll be able to bring everything back up.

(For those wondering, the issue is like 120 GB worth of battle data)
Shrimpy
10-28-2010, 08:53 AM
Need to move around 5 million rows. Script is running and maintenance page is up. RPG will be back up ASAP.
Shrimpy
10-28-2010, 09:46 AM
And now we're deleting 5 million rows.

Hopefully won't be too much longer.
Shrimpy
10-28-2010, 10:16 AM
Apparently deletions don't go as fast as I'd hoped.

Still plugging along.
Shrimpy
10-28-2010, 11:28 AM
Slowest delete ever.

I've tried to kill it in hopes of doing this (the apparently) faster way, but it's not playing nicely.

Sorry about this everyone.
Shrimpy
10-28-2010, 11:47 AM
Delete finished. Tweaking a couple of things so I won't have to take the server down again later.
Shrimpy
10-28-2010, 12:07 PM
While we have a few minutes as I wait for some files to copy, here's an explanation about what's going on!

So the RPG works now by storing all your battle information server side in a table that should only have about 1,000 rows at a given time. It can have more, but it should always be around the 1,000 range partly because battles take up a lot of space, so every 10 minutes, we do a cleanup of the battles and pull stats on them.

The cleanup script kept dying and not actually doing the cleanup, so my little table that should've only had 1,000 rows actually had 5,000,000. This took up about 120GB of space on the server which promptly caused the hard drive to fill up and MySQL and the web browser to crash.

What I've been doing today is getting all that straightened out!
Shrimpy
10-28-2010, 12:34 PM
Annnnnnnnnnnnnd we're back!