Database Cleanup and Maintenance

By Rich Stone, 4 years ago
Hi all

As the TA user base and achievement store has grown over the last 7 years, our database has grown exponentially to store all of that data.

Because we also store historical data, every day we are writing hundreds of thousands of gamer, game and achievement histories. We also have a record of every PM ever sent!

Having such a large database slows down page views as there is a) more data to search through, and b) a smaller percentage of the database that can be stored in the servers' memory.

So to speed things up a bit, we've decided to do a little data pruning...

Firstly, we are removing all gamer history records older than a year that are not on a Monday. That means you still have a weekly record of your score since you joined the site (this is used for the charts on the My Stats page), which should be plenty, and a daily record for the past year.

Secondly, we are going to delete any Automatic site notifications older than a year from your PM Archive. These are generally boosting session notifications, or notifications that a friend feed or solution has been commented on.

These changes, combined with some other "behind-the-scenes" spring cleaning mean that we think we should be able to reduce the total database size by around 25% - which should get it back to the size it was about a year ago.

Additionally, we'll be beefing up a couple of servers and carrying out additional maintenance on Tuesday next week (1st July) and we will be putting the site into read only mode while those updates happen. Maintenance will begin at 8am BST (7am GMT) and is expected to last at least 8 hours. During the maintenance window the scanners will be switched off and you will not be able to do anything that writes to the database (forum posts, solutions, FF comments, etc).

Servers are being upgradedServers are being upgraded

During the maintenance, we'll keep you updated as to our expected finish time on our Twitter page and our Facebook group.

Thanks for your patience during this period of downtime, it should benefit everyone in the long run.

Rich Stone
Written by Rich Stone
Creator of TrueAchievements, TrueTrophies and TrueSteamAchievements. Writes site news and still finds time for the odd game here and there. Loves Racing games and Shooters, yet to be convinced that any RPG is worth the time investment!