Incident Report for 1.0.2 deployment downtime

What a demonstration on professionalism, freaking awesome!

http://yourwrecks.co.uk/wp-content/uploads/2012/03/1924-i-aint-even-mad-300x225.jpg

+1 love for GGG. The communication was great and these things happen. You are spoiling us with how fast your patches usually are when 45 minutes is considered a huge delay it means you are doing something very right.

These type of post after unplanned downtown is great. I work for a company where I use to do QA and now working as a Technical PM and completely understand what you guys went through (and even have to make tough calls when to revert). We deploy patches daily and sometimes run into issues we did not see/catch in our staging environment. While updating the DB with new package bodies or headers there's always close watch but we use flyway which gives us a snapshot and quick restore point.

Is GGG planning on seamless deployment (no outage) in the near future where new connections will go to the updated servers but still keeping alive old connections for an extended time?

"

cryptc wrote:

As a software developer myself I always find it fascinating to read incident reports like this with some details on what went wrong and why. I'm impressed how quickly the error was caught and corrected really.

Same feeling :)

Disgusting.

After receiving much more professional and high quality service from more reputable companies like Bioware and Blizzard, I have become accustomed to the typical 9 hour 'maintenance' patch during which website and game are down. These would happen weekly, regardless of when a new patch came out. Sometimes we would get a bonus professional nod by having much longer patch downtimes, or emergency patches other times of the week.

After the typically poor result of 1-2 minute downtime for patches, and some weak efforts taking up to 10 mins, GGG thinks they can impress me with 46 minutes???

Still I suppose it's understandable newer struggling indie companies should falter, except for GGGs worst offence of all, telling us what's happening/the cause of delays beyond bland general descriptors after the servers have been up for hours...

Better effort next time please.

Thanks for your work and the awesome patch. Best developers evar.

This is why GGG is the best company! :) Thank you!

dat effort doe!

You guys are truly amazing. To work your asses off during the holiday for the customer/fan is truly appreciated. You also decided to post a ridiculously detailed description of what exactly happened. You guys have gone above and beyond and I will continue to support you because of that. Great job! Enjoy the rest of your weekends fellas/ladies!

Wow I was expecting several hours of trouble, you guys fixed it in no time !

Awesome job, and I really appreciate your dedication on the game, it really is an exemple of game developing, you guys rocks so much ! Rockstar need to be extra careful with you around...

Thank you, and big love GGG !