Jump to content
Never

Major Server Migration Completed

By Never, in News and Announcements

Recommended Posts

Never    7,518

Never
Posted

Hello!

As many of you probably saw, we had a big server migration recently. Here's the low down of what happened:

As I have disclosed in a couple of posts, the database server ran into an issue where it ran completely out of space. The biggest problem was that the database engine we were using kept all the data in a single file, and that file could never be shrunk even if you deleted older records. This caused that file to grow bigger and bigger and bigger over time, until it took up all of the considerable space on that server (1.5TB). When there was no more space left, the database server would crash and the website would go down.

Fortunately, I managed to work with DigitalOcean to secure a great virtual server which meets all the needs of the database and the website in a single server. This is a 12-core, 48GB RAM server with 1TB of SSD space. The next step was transferring all the data over. This took the longest time. All in all, the database totalled around 5 billion records, and after removing the inflated space from the database engine, clocked in at around 500GB.

It took 3 days to transfer and import all the records into the new server, which now runs the latest versions of PHP and MySQL for better performance, plus it lets me clean up old records that aren't used anymore in order to reduce disk space, meaning there will always be space available.

Not only that, but as the website and the database are now on the same server, there is no more issue with the firewall tables getting reset, a problem which, despite a LOT of research, I couldn't actually fix. This was one of the biggest causes of the downtime in the past, as the database server started refusing connections from the website server at random.

All in all, you can expect WoTLabs to be MUCH more stable from now on.

Thanks everyone for all the support!

Haswell, Archaic_One, Unavailebow and 39 others reacted to this

Share this post

Link to post
Share on other sites

Va1heru    1,725

Va1heru
Posted
3 hours ago, Never said:

Hello!

As many of you probably saw, we had a big server migration recently. Here's the low down of what happened:

As I have disclosed in a couple of posts, the database server ran into an issue where it ran completely out of space. The biggest problem was that the database engine we were using kept all the data in a single file, and that file could never be shrunk even if you deleted older records. This caused that file to grow bigger and bigger and bigger over time, until it took up all of the considerable space on that server (1.5TB). When there was no more space left, the database server would crash and the website would go down.

Fortunately, I managed to work with DigitalOcean to secure a great virtual server which meets all the needs of the database and the website in a single server. This is a 12-core, 48GB RAM server with 1TB of SSD space. The next step was transferring all the data over. This took the longest time. All in all, the database totalled around 5 billion records, and after removing the inflated space from the database engine, clocked in at around 500GB.

It took 3 days to transfer and import all the records into the new server, which now runs the latest versions of PHP and MySQL for better performance, plus it lets me clean up old records that aren't used anymore in order to reduce disk space, meaning there will always be space available.

Not only that, but as the website and the database are now on the same server, there is no more issue with the firewall tables getting reset, a problem which, despite a LOT of research, I couldn't actually fix. This was one of the biggest causes of the downtime in the past, as the database server started refusing connections from the website server at random.

All in all, you can expect WoTLabs to be MUCH more stable from now on.

Thanks everyone for all the support!

Is the stats side of wotlabs going to stay as NA only? 

Share this post

Link to post
Share on other sites

Never    7,518

Never
Posted
On 8/28/2018 at 10:25 PM, Archaic_One said:

Thank you Never, you certainly didn't have to keep the lights on around here but you do anyway.  We appreciate your work.

Obligatory ass kissing aside, why you no visit us anymore?

Mostly a combination of depression caused by losing my routine after graduating college and massive burnout from pretty much everything. There was a (very) long span of time where I was actively scared of opening the forums and seeing things were broken and I dreaded having to fix them. I felt so done with everything that my brain just shut everything out that had the slightest semblance of responsibility. Sorry :(

14 hours ago, Tman450 said:

I see you a lot browsing r/formula1 these days, who do you want to win the title? Grazie Regazzi or The Best Crowd?

My ragazzi is way overdue for a good grazi'ing.

MagicalFlyingFox, Tman450 and Archaic_One reacted to this

Share this post

Link to post
Share on other sites

Tman450    196

Tman450
Posted
15 minutes ago, MagicalFlyingFox said:

hello fellow r/formula1-ers

 

Grazzie ragazzi Ferrari please dont shit the bed in Monza.

 

welcome back Never! :D 

BABBABABABABABA BUM!

Grazie Ragazzi

Grande Levoro

Grande Macchina

Forza Ferrari

Share this post

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go To Topic Listing

  • Recently Browsing   0 members

    No registered users viewing this page.

×
×
  • Create New...