Apparently one of our UPSs had a power issue. That UPS contained one of our VM hosts so nitron, control, the website, and some other support machines were down. I'm checking on their recovery now.
Mightor went down with the power and three of our VM hosts did not deal well. Reboots are fixing the problem.
The network jack for one of our VM hosts went dead and disconnected all its VMs from the network.
The host has been moved to another network jack and all services are back online.
The mail submission server was upgraded earlier and there were a couple bumps. Mail is flowing normally now.
nitron didn't want to communicate with mightor after mightor's crash, so I restarted nitron. Service is restored.
Systems will be down starting at 8pm tonight in order to install a new control board for the file server. I expect the whole process to take less than 2 hours. Updates will be posted here.
Well, after being up for more than 48 hours and giving hope the problem might be solved, mightor has crashed again. This time the vendor and I should have more information to find the cause.
