Folding@home

Planned outage for 171.64.65.xx network, November 5 at 7am to 8:30am

This will involve brief (3-5 minute) network interruptions during the time period.  Most of FAH will not be involved, but the 171.64.65.XX network will see some downtime.

Stanford CS net down briefly, back up now

The Stanford CS building was off line briefly today starting at about 1:30pm pacific time, lasting for about 3 hours.  This meant that all of our machines on the 171.64.65.xx subnet were off line.  It looks like everything is back on line and Stanford IT is looking into causes.  This will likely lead to a bit of an excess load for a while until things settle down.

Brief planned server outage on the 171.64.65.XX network tomorrow (Tuesday, October 28)

We will have a brief (1 hour) server outage tomorrow, October 28 at 10am pacific time.  It is expected to last about an hour.  This will only affect machines on the 171.64.65.XX network, so most of FAH will be up.  However, we expect there to be a server backlog for a little bit after the machines come back up.  Also, it's likely that one server or so will have trouble coming back up and will be delayed.

PS3 update

We're continue to work to keep the PS3 servers stoked with jobs.  For those who are having problems and are not running the latest FAH software (based on Life With Playstation or "LWP"), please upgrade.  We need to concentrate our servers on the latest clients and cannot guarantee work for older clients.

PS3 client out of jobs

We're looking into issues with our PS3 client.  We have a short term fix in place, but are working to do more right now and hopefully will have more to say later today.

stats slow down, should be resolved soon

We found an issue with the stats server this weekend and have resolved it.  The stats will now be updating again, although it may take a few hours from now to resolve the backlog.

Update on network issues

As I've discussed before, we have been having issues with a particular subnet (171.64.122.XX) for Folding@home servers.  The symptoms were dropped connections and general challenges returning WUs.  We asked for a new network, just for Folding@home, and after much red tape we have received it and it has been installed on a few trial servers.  So far, it is looking very promising.  VSP07v (171.67.108.11) is an example of a server interface on the new network and it is behaving very well.  We are in the process of updating additional servers.  It's still possible that this isn't a network issue, but given our results with VSP07v, that looks unlikely, so we hope we can now see the light at the end of the tunnel.

We have also started rolling out new GPU servers.  The GPU serverstat page

http://fah-web.stanford.edu/localinfo/contact.GPU.html

now shows more servers in general, as well as a much lighter load.  This was possible now that we have the new network.  If all looks good, we'll plan on rolling more out in time.

Main AS restarted; back up now, down for the last 20 min

We restarted the main AS.  The stats will also skip one cycle due to this, but everything else should be back to normal.