Growing Pains: CircuitLab Downtime

Apr 09 2013, 11:30 PM PDT · 2 comments »

CircuitLab Fail Whale

By now, you may have noticed that CircuitLab was down for a total of about ten hours today. The failure occurred when one of the processes that manages our internal dashboard had to be restarted. In the process of coming back up, the dashboard goes through our log files -- which it turns out have gotten much, much bigger over the last month. Churning through the logs rapidly consumed all the RAM on our primary server, which caused a hard crash that resulted in severe corruption in one of our file systems.

We immediately began attempting to restore, but it quickly became obvious that just patching the current machine back together would only be a very temporary solution. So we began the process of restoring CircuitLab from a backup onto a more powerful machine. We are happy to report that at this point it seems that no data was lost in the server crash, and CircuitLab is now running on a server that is 8 times as fast and can scale with our growing CircuitLab community!

Users who had previously installed the CircuitLab app from the Chrome Web Store should have experienced little to no disruption to their workflow since the editor is able to work offline.

Thank you for your patience during the downtime. We’re very sorry about the outage, and in the coming days, we plan to do a full evaluation of the incident so we can understand exactly what happened and prevent CircuitLab from going down in the future.

If you have any other questions about the downtime, please feel free to contact us.

--The CircuitLab Team


Comments

Thanks, guys!

I am only one of many who really appreciate your efforts to put something like this onto the net.

Your site is extremely useful to me when wanting to check out some circuit and try to understand how and why it works ( or why it didn't ). I also appreciate your lack of DRM and other hindrances. Your graphics is so clean I use it often to present my circuit ideas and what to expect of a circuit to colleagues.

by anubi
May 01, 2013

I use CircuitLab to teach circuits. Is it possible to plot capacitor ac current and voltage with the same vertical zero axis? (say for a simple series RC circuit) Currently the zero axis for current and voltage are slightly offset when plotted on the same graph. Thanks for a very useful teaching tool.

by G3YTZ
May 03, 2013

Leave a Comment

Please sign in or create an account to comment.