Never

Major Server Migration Completed

17 posts in this topic

Hello!

As many of you probably saw, we had a big server migration recently. Here's the low down of what happened:

As I have disclosed in a couple of posts, the database server ran into an issue where it ran completely out of space. The biggest problem was that the database engine we were using kept all the data in a single file, and that file could never be shrunk even if you deleted older records. This caused that file to grow bigger and bigger and bigger over time, until it took up all of the considerable space on that server (1.5TB). When there was no more space left, the database server would crash and the website would go down.

Fortunately, I managed to work with DigitalOcean to secure a great virtual server which meets all the needs of the database and the website in a single server. This is a 12-core, 48GB RAM server with 1TB of SSD space. The next step was transferring all the data over. This took the longest time. All in all, the database totalled around 5 billion records, and after removing the inflated space from the database engine, clocked in at around 500GB.

It took 3 days to transfer and import all the records into the new server, which now runs the latest versions of PHP and MySQL for better performance, plus it lets me clean up old records that aren't used anymore in order to reduce disk space, meaning there will always be space available.

Not only that, but as the website and the database are now on the same server, there is no more issue with the firewall tables getting reset, a problem which, despite a LOT of research, I couldn't actually fix. This was one of the biggest causes of the downtime in the past, as the database server started refusing connections from the website server at random.

All in all, you can expect WoTLabs to be MUCH more stable from now on.

Thanks everyone for all the support!

Share this post


Link to post
Share on other sites

Thanks for keeping this place up, by far the #1 resource for tanks. I definitely see a difference with speed too.

 

Share this post


Link to post
Share on other sites
3 hours ago, Never said:

Hello!

As many of you probably saw, we had a big server migration recently. Here's the low down of what happened:

As I have disclosed in a couple of posts, the database server ran into an issue where it ran completely out of space. The biggest problem was that the database engine we were using kept all the data in a single file, and that file could never be shrunk even if you deleted older records. This caused that file to grow bigger and bigger and bigger over time, until it took up all of the considerable space on that server (1.5TB). When there was no more space left, the database server would crash and the website would go down.

Fortunately, I managed to work with DigitalOcean to secure a great virtual server which meets all the needs of the database and the website in a single server. This is a 12-core, 48GB RAM server with 1TB of SSD space. The next step was transferring all the data over. This took the longest time. All in all, the database totalled around 5 billion records, and after removing the inflated space from the database engine, clocked in at around 500GB.

It took 3 days to transfer and import all the records into the new server, which now runs the latest versions of PHP and MySQL for better performance, plus it lets me clean up old records that aren't used anymore in order to reduce disk space, meaning there will always be space available.

Not only that, but as the website and the database are now on the same server, there is no more issue with the firewall tables getting reset, a problem which, despite a LOT of research, I couldn't actually fix. This was one of the biggest causes of the downtime in the past, as the database server started refusing connections from the website server at random.

All in all, you can expect WoTLabs to be MUCH more stable from now on.

Thanks everyone for all the support!

Is the stats side of wotlabs going to stay as NA only? 

Share this post


Link to post
Share on other sites
1 hour ago, Va1heru said:

Is the stats side of wotlabs going to stay as NA only? 

So, his response was it was never supposed to be like that, and it should be working for other servers now

Share this post


Link to post
Share on other sites

Thank you Never, you certainly didn't have to keep the lights on around here but you do anyway.  We appreciate your work.

Obligatory ass kissing aside, why you no visit us anymore?

Share this post


Link to post
Share on other sites

Thanks for keeping the site running. This is practically the only WoT related page I visit frequently. 

Share this post


Link to post
Share on other sites
On 8/28/2018 at 10:25 PM, Archaic_One said:

Thank you Never, you certainly didn't have to keep the lights on around here but you do anyway.  We appreciate your work.

Obligatory ass kissing aside, why you no visit us anymore?

Mostly a combination of depression caused by losing my routine after graduating college and massive burnout from pretty much everything. There was a (very) long span of time where I was actively scared of opening the forums and seeing things were broken and I dreaded having to fix them. I felt so done with everything that my brain just shut everything out that had the slightest semblance of responsibility. Sorry :(

14 hours ago, Tman450 said:

I see you a lot browsing r/formula1 these days, who do you want to win the title? Grazie Regazzi or The Best Crowd?

My ragazzi is way overdue for a good grazi'ing.

Share this post


Link to post
Share on other sites
15 minutes ago, MagicalFlyingFox said:

hello fellow r/formula1-ers

 

Grazzie ragazzi Ferrari please dont shit the bed in Monza.

 

welcome back Never! :D 

BABBABABABABABA BUM!

Grazie Ragazzi

Grande Levoro

Grande Macchina

Forza Ferrari

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Recently Browsing   0 members

    No registered users viewing this page.