The Stanford CS building was off line briefly today starting at about 1:30pm pacific time, lasting for about 3 hours. This meant that all of our machines on the 171.64.65.xx subnet were off line. It looks like everything is back on line and Stanford IT is looking into causes. This will likely lead to a bit of an excess load for a while until things settle down.
We will have a brief (1 hour) server outage tomorrow, October 28 at 10am pacific time. It is expected to last about an hour. This will only affect machines on the 171.64.65.XX network, so most of FAH will be up. However, we expect there to be a server backlog for a little bit after the machines come back up. Also, it's likely that one server or so will have trouble coming back up and will be delayed.
We're continue to work to keep the PS3 servers stoked with jobs. For those who are having problems and are not running the latest FAH software (based on Life With Playstation or "LWP"), please upgrade. We need to concentrate our servers on the latest clients and cannot guarantee work for older clients.
As I've discussed before, we have been having issues with a particular subnet (171.64.122.XX) for Folding@home servers. The symptoms were dropped connections and general challenges returning WUs. We asked for a new network, just for Folding@home, and after much red tape we have received it and it has been installed on a few trial servers. So far, it is looking very promising. VSP07v (188.8.131.52) is an example of a server interface on the new network and it is behaving very well. We are in the process of updating additional servers. It's still possible that this isn't a network issue, but given our results with VSP07v, that looks unlikely, so we hope we can now see the light at the end of the tunnel.
We have also started rolling out new GPU servers. The GPU serverstat page