Update - The network issues in 50A-2109C colo and ALS sector 5 have been resolved.
The remaining network issue is the FlexLab firewall network.
Oct 15, 09:41 PDT
Update - Networking is restored to all locations except for:
* Some possibly degraded networking in 50A-2109C colo
* Beamline network in ALS sector 5
* FlexLab firewall network
LBLnet is working on on restoring full service to those locations.
Shared Drives (G, H, Grouper, etc) and Science Project Storage System (SSPS) are back online. Business Systems are operational. We expect HPC systems to be online later this afternoon.
Oct 14, 13:00 PDT
Update - We continue to monitor the situation.
Oct 12, 18:26 PDT
Monitoring - We continue to monitor the situation.
Oct 12, 18:23 PDT
Update - As of Saturday evening, electrical power and cooling is restored to computer rooms. Networking is restored to most locations. Shared Drives (G, H, Grouper, etc) and Science Project Storage System (SSPS) are back online.
Oct 12, 18:11 PDT
Update - At approximately 12:18 am PG&E power was shut off to the main lab campus, causing all network equipment not on battery to power off. In locations with generator power network coverage has since returned.
Networks at JGI, 971, 977 and 978 continue to operate normally.
Systems anticipated to be operational, including email, identity management, and core business systems, are currently operational.
Oct 10, 06:15 PDT
Investigating - What is the current and expected status of LBL systems?
Currently (10.9.19 at 8:25AM), all systems are operational except for those that were proactively shutdown (see below). Some LBL datacenters are expected to be able to operate on emergency power/generators during this outage, so key systems (see below) should be operational.
What systems are anticipated to be operational?
All Google Suite Services (gmail, docs, drive, calendar, etc) (For clarity, access to lbl email should function normally for all devices).
All Identity Management Services (login, phonebook, directory, etc)
Business Systems (FMS, HRIS, EHS Systems, etc)
Cloud Based Websites (Google Sites, WPengine, Pantheon, etc)
Www2.lbl.gov, status.lbl.gov, and Commons.lbl.gov
Telephones and Voicemail
Security Systems including Physical Access Control
What systems have been shut down?
LBL IT Provided HPC Services
Science Virtual Machine Services (SVM)
Science Project Storage Service (SPSS)
Shared Drives (G, H, Grouper, etc)
What systems are anticipated to go down when power is shutoff?
Networking in buildings without power
Access to any systems located in non-powered buildings
Why do you use the word “Anticipated”
Emergency power is unpredictable. If generators fail, are required to be shutdown, or run out of fuel - or if cooling is insufficient to safely manage systems, systems will be shutdown. Information will be posted
Oct 9, 10:15 PDT