Outage Report and Planned Downtime

By jon.terry on January 17, 2012 — No comments

for Saturday, January 21

Today, January 17, from 2:27PM to 2:53PM CST (GMT-6), the LeanKitKanban application was unavailable for a total of 26 minutes. Our production database server became unresponsive and had to be physically rebooted by the network engineers at our hosting provider, PEER1 Networks in Los Angeles. The support staff at PEER1 has indicated that they suspect an underlying hardware failure may be the cause, but little information is available to troubleshoot further.

Over the past few months, we’ve built out and tested a new production environment for LeanKitKanban at a PEER1 data center in Herndon, VA. This new environment includes additional capacity, load balancing and fault tolerance features. This was done as part of normal capacity planning as the number of customers using LeanKitKanban is rapidly growing.

Since we have a somewhat mysterious “hardware problem” at our existing production site, we have decided to expedite the move to our new production datacenter in Herndon, VA. Though we normally like to give at least 7 days notice of any downtime, we will make an exception in this case, and schedule downtime for this Saturday, January 21.

The downtime window will be from 3PM to 7PM CST (GMT-6) this Saturday, January 21.

We apologize for the interruption today, and thank you for your patience.

Chris Hefley
CEO, LeanKit