Major Server Migration Completed

[Never 7,658]

Hello!

As many of you probably saw, we had a big server migration recently. Here's the low down of what happened:

As I have disclosed in a couple of posts, the database server ran into an issue where it ran completely out of space. The biggest problem was that the database engine we were using kept all the data in a single file, and that file could never be shrunk even if you deleted older records. This caused that file to grow bigger and bigger and bigger over time, until it took up all of the considerable space on that server (1.5TB). When there was no more space left, the database server would crash and the website would go down.

Fortunately, I managed to work with DigitalOcean to secure a great virtual server which meets all the needs of the database and the website in a single server. This is a 12-core, 48GB RAM server with 1TB of SSD space. The next step was transferring all the data over. This took the longest time. All in all, the database totalled around 5 billion records, and after removing the inflated space from the database engine, clocked in at around 500GB.

It took 3 days to transfer and import all the records into the new server, which now runs the latest versions of PHP and MySQL for better performance, plus it lets me clean up old records that aren't used anymore in order to reduce disk space, meaning there will always be space available.

Not only that, but as the website and the database are now on the same server, there is no more issue with the firewall tables getting reset, a problem which, despite a LOT of research, I couldn't actually fix. This was one of the biggest causes of the downtime in the past, as the database server started refusing connections from the website server at random.

All in all, you can expect WoTLabs to be MUCH more stable from now on.

Thanks everyone for all the support!

[RealBattousai 248]

Thanks Never for keeping the site going, and congrats on the successful migration.

[Ham_ 430]

After successful migration, the wild Neverwish resumes it's hibernation for the foreseeable future.

[RC_Tank 467]

Thanks for keeping this place up, by far the #1 resource for tanks. I definitely see a difference with speed too.

 

[Va1heru 1,725]

3 hours ago, Never said:

Hello!

As many of you probably saw, we had a big server migration recently. Here's the low down of what happened:

As I have disclosed in a couple of posts, the database server ran into an issue where it ran completely out of space. The biggest problem was that the database engine we were using kept all the data in a single file, and that file could never be shrunk even if you deleted older records. This caused that file to grow bigger and bigger and bigger over time, until it took up all of the considerable space on that server (1.5TB). When there was no more space left, the database server would crash and the website would go down.

Fortunately, I managed to work with DigitalOcean to secure a great virtual server which meets all the needs of the database and the website in a single server. This is a 12-core, 48GB RAM server with 1TB of SSD space. The next step was transferring all the data over. This took the longest time. All in all, the database totalled around 5 billion records, and after removing the inflated space from the database engine, clocked in at around 500GB.

It took 3 days to transfer and import all the records into the new server, which now runs the latest versions of PHP and MySQL for better performance, plus it lets me clean up old records that aren't used anymore in order to reduce disk space, meaning there will always be space available.

Not only that, but as the website and the database are now on the same server, there is no more issue with the firewall tables getting reset, a problem which, despite a LOT of research, I couldn't actually fix. This was one of the biggest causes of the downtime in the past, as the database server started refusing connections from the website server at random.

All in all, you can expect WoTLabs to be MUCH more stable from now on.

Thanks everyone for all the support!

Is the stats side of wotlabs going to stay as NA only? 

[Assassin7 4,332]

1 hour ago, Va1heru said:

Is the stats side of wotlabs going to stay as NA only? 

So, his response was it was never supposed to be like that, and it should be working for other servers now

[StormCrowReaperManyHats 678]

Can confirm it is fix.

Can also confirm I got worse.

[nabucodonsor 461]

Thank you dear leader!!!!

[Medjed 2,613]

Ayyy Never buddy ol' pal. How's life going? Any nude stream soon pls?

[Archaic_One 1,852]

Thank you Never, you certainly didn't have to keep the lights on around here but you do anyway.  We appreciate your work.

Obligatory ass kissing aside, why you no visit us anymore?

[kunjuro 277]

Thanks for keeping the site running. This is practically the only WoT related page I visit frequently. 

[Tman450 210]

I see you a lot browsing r/formula1 these days, who do you want to win the title? Grazie Regazzi or The Best Crowd?

[Never 7,658]

On 8/28/2018 at 10:25 PM, Archaic_One said:

Thank you Never, you certainly didn't have to keep the lights on around here but you do anyway.  We appreciate your work.

Obligatory ass kissing aside, why you no visit us anymore?

Mostly a combination of depression caused by losing my routine after graduating college and massive burnout from pretty much everything. There was a (very) long span of time where I was actively scared of opening the forums and seeing things were broken and I dreaded having to fix them. I felt so done with everything that my brain just shut everything out that had the slightest semblance of responsibility. Sorry

14 hours ago, Tman450 said:

I see you a lot browsing r/formula1 these days, who do you want to win the title? Grazie Regazzi or The Best Crowd?

My ragazzi is way overdue for a good grazi'ing.

[MagicalFlyingFox 1,010]

hello fellow r/formula1-ers

 

Grazzie ragazzi Ferrari please dont shit the bed in Monza.

 

welcome back Never!  

[Tman450 210]

15 minutes ago, MagicalFlyingFox said:

hello fellow r/formula1-ers

 

Grazzie ragazzi Ferrari please dont shit the bed in Monza.

 

welcome back Never!  

BABBABABABABABA BUM!

Grazie Ragazzi

Grande Levoro

Grande Macchina

Forza Ferrari

[Never 7,658]

"YEEEEESSSSS! PEE TOO!"

Dafuq was that?

Anyway, I might stream something again, for old times' sake @Medjed, no promises on nudity, we gotta ease into it.

[Medjed 2,613]

Holy crap, just realised your last stream was 3 years ago?