Archived Events

(Completed) Thursday, May 25, 2023, 6:30am to 7:00am - Planned Phone Outage

On Thursday, May 25th from 6:30am to 7:00am, Lab phone service was offline in the Donner building for approximately 30 minutes during a scheduled power maintenance window.

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns.

(Resolved) Monday, May 22, 6pm to 7pm - IdM unplanned outage

There was an unplanned outage of the following IdM services during scheduled systems maintenance:

https://identity.lbl.gov/am
https://identity.lbl.gov/mfa

Please contact Identity Management (idm@lbl.gov) with questions or concerns.

(Completed) Saturday, May 20, 9am to 5pm - Intermittent Service for Avaya Workplace Application during Network Upgrades

The LBLnet planned network upgrade may have resulted in intermittent service for the Avaya Workplace Application during the scheduled period, Saturday, May 20, from 9:00 a.m. to 5:00 p.m.

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns.

(Completed) Saturday, May 20, 9 a.m. to 5 p.m. - Outages for high-performance computing, business and identity systems.  

On Saturday, May 20, from 9:00 a.m. to 5:00 p.m., LBLnet will be upgrading software on devices throughout the Lab’s data center networks. Individual systems may have access disrupted multiple times during the outage window with some outages lasting up to two hours.

The upgrade will disrupt access to many important, widely-used systems, including VPN, employee wireless, eduroam, BAR, FMS, and the computing clusters such as ALICE and Lawrencium. The disruption will affect wired data-center-housed systems only, but wireless access that requires authentication, such as eduroam and lbnl-employee, will also be disrupted. All Identity Management authentication services will be inaccessible during this planned network work, including Single Sign-On authentication for all applications (Gmail), Multi-Factor Authentication, LDAP, ancillary AD services, Phonebook, RADIUS (Employee Wireless and VPN), Grouper, Confluence, Indico, and the Performance Management Application.

For network concerns, please contact lblnet@lbl.gov.
For identity services concerns, please contact the Identity Management Team at idm@lbl.gov.

#lblnet #collaborationservices #idm #maintenance #upgrade

(Completed) Saturday, May 20, 9am to 5pm - Intermittent Service for Performance Management Process (PMP) System Maintenance

The LBLnet planned network upgrade will result in intermittent service for the Performance Management Process (PMP) System. You can still access your prior year performance reviews by searching your Google My Drive for "Performance Review".  

#collaborationservices #pmp #maintenance

 (Completed) Thursday, May 18, 2023 -  Update to Lab Websites

The following websites will undergo updates between 7:30 AM and 10:30 AM:

• www.lbl.gov

• newscenter.lbl.gov

• a-z.lbl.gov

The sites will be inaccessible while the update takes place. Please contact the Web  Services Team (via help@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #webservices #maintenance #upgrade

(Completed) Wednesday, May 17, 2023 - IdM Maintenance

Atlassian accounts ending in “@lbl.gov” will be claimed by the “lbl.gov” Atlassian domain today at approximately 3:00PM. The change will affect approximately 900 accounts.

The change will be transparent except for Trello users who will see a banner stating something to the effect of “This account has been claimed by the lbl.gov domain”

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Tuesday, May 16, 2023 -  Update to Lab Websites

The following websites will undergo updates between 7:30 AM and 10:30 AM:

• www.lbl.gov

• search.lbl.gov

• blds.lbl.gov

• Molecular Foundry, CHiPPs

The sites will be inaccessible while the update takes place. Please contact the Web  Services Team (via help@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #webservices #maintenance #upgrade

(Completed) Friday, May 5, 2023 -  Commons System Maintenance

commons.lbl.gov was offline on May 5, 2023 for about 30 minutes at 4PM for scheduled maintenance.

Please contact the Collaboration Services Team (collaborate@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #confluence #commons #maintenance

(Completed) Week of May 1, 2023 -  Performance Management Process (PMP) System Maintenance

The Performance Management Process (PMP) System will be offline the week of May 1, 2023 for scheduled maintenance in preparation for 2023's Performance Management Process.  You can still access your performance review by searching your Google My Drive for "Performance Review".  For all other requests, contact your division's Human Resources Division Process Owner.

#collaborationservices #pmp #maintenance

(Resolved) Tuesday, May 2, 2023 - Comcast Service Outage Affecting lbl.gov Systems

Starting this morning, subscribers of Comcast's internet service are unable to access many Lab systems, including the central login service, login.lbl.gov. Comcast support has confirmed that this is the result of an error within their networks, and that it will be resolved within a few hours. Berkeley Lab IT advises staff to use the cellular data networks via tethering or MiFi devices in order to work around this issue. Subscribers of other ISPs do not appear to be affected by this outage.

Update: As of 1:30 PM, service has been restored to Comcast customers.

(Announcement) Friday, April 21, 2023 - Zoom App Marketplace Notification

The Zoom App Marketplace sent out a legitimate system-generated email on Friday, April 21, 2023 at 5:20pm.  Messages like this are sent out when Zoom account admins approve marketplace apps for use at Berkeley Lab.  These apps are not installed automatically and they equire each user to install them for their account.  Users may remove any user-installed app by visiting marketplace.zoom.us.  Installed apps are not required to host or attend Zoom meetings and webinars.

#collaborationservices #av #announcement

(Completed) Tuesday, April 25, 2023 - IdM Maintenance

password.lbl.gov underwent brief maintenance at ~4:30PM

We do not believe there was an outage during the maintenance window.

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Friday, April 21, 2023 5:00 PM - IdM Maintenance

Identity Management systems will be undergoing brief maintenance. Applications are expected to operate normally. An outage of up to five minutes is possible.

Impacted systems:

• login.lbl.gov

Visit this page for progress updates.

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Friday, April 21, 2023 Lab Voice Mail Maintenance

The Lab voice mail system was unavailable Friday April 21, 2023 from 5:30pm - 8:00pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Tuesday, April 18, 2023 3:00 PM - IdM Maintenance

Identity Management systems will be undergoing brief maintenance at 3:00 PM.

Applications are expected to operate normally. An outage of up to five minutes is expected.

Impacted systems:

• Active Directory Web Portal: https://adaccounts.identity.lbl.gov/

• Grouper: https://identity.lbl.gov/grouper

• Email Proxy: smtp://smtp-old.lbl.gov

• LinOTP/Radius

Visit this page for progress updates.

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Thursday, March 30, 2023  - Indico Upgrade

conferences.lbl.gov was upgraded to version 3 of the Indico software on Thursday, March 30 at 5:30PM.

Please contact indico-admins@lbl.gov with questions or concerns regarding this upgrade.

#collaborationservices #indico #maintenance

[Intermittent] Monday, March 13, 2023 - RADIUS Issues

RADIUS is intermittently experiencing authentication timeouts for some users.  We believe this is due to a large volume of requests hitting RADIUS.  We are currently investigating to determine the cause and solution.  

Visit this page for progress updates or contact the Identity Management Team (idm@lbl.gov) with questions or concerns.

#collaborationservices #idm #outage #research #radius

(Completed) Thursday, March 9, 2023 Verizon Cellular Maintenance

Verizon in-building cellular phone service in some areas of Building 2, 59, 66, 90 and 91 will be offline for approximately 2 hours on Thursday, March 9, 2023 for maintenance.   Work will start at 7:00am and conclude at 9:00am.  

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

[Resolved] Thursday, March 16, 2023 ~5pm - Login Issues

This issue was transient.  The issue is resolved. 

Visit this page for updates.

(Completed) Tuesday, March 7, 2023 to March 10, 2023 - IdM LDAP Maintenance

Identity Management systems will be undergoing maintenance starting at 1:00 PM on Tuesday, March 7, 2023.

While most redundant applications are expected to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, Multifactor Authentication, LDAP, ancillary AD services, Phonebook, RADIUS (Employee Wireless and VPN), and Grouper. 

Visit this page for progress updates.

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Thursday, March 2, 2023 Verizon Cellular Maintenance

Verizon in-building cellular phone service in some areas of Building 2, 59, 66, 90 and 91 was offline for approximately 2 hours on Thursday, March 2, 2023 for maintenance.   Work started at 10:00am and concluded at 12:00pm.  

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Wednesday, March 1, 2023 Verizon Cellular Maintenance

Verizon in-building cellular phone service in some areas of Building 2, 59, 66, 90 and 91 was offline for approximately 2 hours on Wednesday, March 1, 2023 for maintenance.   Work started at 12:00pm and concluded at 2:00pm.  

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

[Resolved] Tuesday, February 28, 2023 - 2:50 PM - Grouper Issues

We are currently experiencing issues with the Grouper service where the UI is inaccessible.  This issue has been resolved.

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns.

#collaborationservices #idm #incident #grouper

[Completed] Tuesday, February 7, 2023 to February 10 - 3:00 PM - IdM LDAP Maintenance

Identity Management systems will be undergoing maintenance starting at 3:00 PM on Tuesday, February 7, 2023.  The maintenance is projected to last 2 hours.

While most redundant applications are expected to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, Multifactor Authentication, LDAP, ancillary AD services, Phonebook, RADIUS (Employee Wireless and VPN), and Grouper. 

Visit this page for progress updates.

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Friday, February 3, 2023 Lab Voice Mail Maintenance

The Lab voice mail system was unavailable Friday February 3, 2023 from 5:30pm - 8:30pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

[Resolved] Tuesday, January 24, 2023 - 4:30 PM - Issues Authenticating

This issue has been resolved.

We are currently experiencing issues with authentication services.  

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this unscheduled outage.

#collaborationservices #idm #incident

[Completed] Tuesday, December 27, 2022 8:00 AM – Thursday, December 29, 2022 10:00 PM — LBLnet Maintenance Outages

LBLnet planned maintenance in almost all buildings over the Holidays and Curtailment period from December 27-29, 2022. Network services in buildings may be disrupted for periods of up to 1 hour.

Dates:

• Tuesday, December 27, 2022

• Wednesday, December 28, 2022

• Thursday, December 29, 2022

Time: 8:00AM until 10:00PM each day

Duration: 14 hours each day

General Impact: Network devices will receive updated software, which may disrupt wired and wireless network services within buildings for periods of up to 1 hour. Also, some of our services will lose redundancy as we upgrade devices, increasing the risk of a larger outage.  As we finalize the schedule of work we may send more detailed updates. If you are concerned about disruptions to your work, please contact us as we can discuss possible accommodations or a more detailed estimate of outages that might affect you.

#lblnet #maintenance

[Completed] Tuesday, December 27, 2022 8:00 AM – Thursday, December 29, 2022 10:00 PM — Intermittent Telephone Service Outage during Network Maintenance

The LBLnet planned network services maintenance may have resulted in intermittent telephone service outages during the scheduled period, Tuesday, December 27, 2022 8:00 AM – Thursday, December 29, 2022 10:00 PM.

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

#lblnet #maintenance

[Resolved] Monday, December 19, 2022 - Zoom Connectivity Issues

Users connected to the Lab's IP space (onsite and on VPN) experienced issues this morning when using Zoom.  Zoom Rooms were also impacted.  This issue has been resolved, but if you continue experiencing issues, don't hesitate to contact the IT Help Desk by emailing help@lbl.gov or chatting with the team go.lbl.gov/itchat.

#collaborationservices #av #zoom #incident

[Resolved] Tuesday, December 13, 2022 - Zoom Scheduler Issues

December 15, 2022:

Zoom started rolling out the hotfix for this issue starting the morning of December 15th.  Some users may need to clear browsing data (cache) and relaunch the browser for the Make it a Zoom Meeting button to reappear.

December 13, 2022:

Zoom has reported issues affecting the Zoom Scheduler plug-in.  This plug-in is used to add Zoom meeting information to Google Calendar events.  Until Zoom resolves this issue, install and use the Zoom for Google Workspace add-on at go.lbl.gov/zoomplugin.

#collaborationservices #av #zoom #incident

(Completed) Wednesday, December 14, 2022 Lab Voice Mail Maintenance

The Lab voice mail system was unavailable Wednesday December 14, 2022 from 5:30pm - 4:00am for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Monday, December 5, 2022 AT&T Cellular Maintenance

AT&T in-building mobile phone service in some areas of Building 50A was offline briefly Monday, December 5, 2022 for replacement of an LBL electrical breaker. Maintenance start time was 8:00 AM and concluded at 10:20am.  

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Tuesday, November 29, 2022 - 3:00 PM - IdM Maintenance

Identity Management systems will be undergoing maintenance starting at 3:00 PM on Tuesday, November 29.  The maintenance is projected to last 3 hours.

While most redundant applications are expected to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, Multifactor Authentication, LDAP, ancillary AD services, Phonebook, RADIUS (Employee Wireless and VPN), and Grouper. 

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Sunday, November 20, 2022 Lab Voice Mail Maintenance

The Lab voice mail system was unavailable Sunday November, 2022 from 8:00am - 10:00am for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Tuesday, November 15, 2022 - 4:00 PM - IdM Maintenance

Identity Management systems will be undergoing maintenance starting at 4:00 PM on Tuesday, November 15.  The maintenance is projected to last 3 hours.

While most redundant applications are expected to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, Multifactor Authentication, LDAP, ancillary AD services, Phonebook, RADIUS (Employee Wireless and VPN), and Grouper. 

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Resolved) Thursday, September 29, 2022 11:50 PM - Friday, September 20, 2022 12:54 PM - Building 50 Network Outage

An unplanned power outage for Building 50 is causing a network outage for all wired and wireless networks in Building 50.  This outage is not impacting other buildings in the 50 complex (50A, 50B, 50C, 50E, or 50F).

Power was restored and all network services were operating normally by 12:54 PM on Friday, September 30.

Please contact LBLnet (lblnet@lbl.gov) with questions or concerns regarding this outage.

#network #maintenance

(Completed) Tuesday, August 24, 2022 - 4:00 PM - IdM Maintenance

Identity Management systems will be undergoing maintenance starting at 4:00 PM on Tuesday, August 24.  The maintenance is projected to last 1 hour.

While most redundant applications are expected to continue to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, MFA, Phonebook, RADIUS (Employee Wireless and VPN), and Multifactor Authentication services. 

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Resolved) Monday, August 8, 2022 Lab Voice Mail Maintenance

The intermittent issues with voice mail message playback and the Lab's Dial-By-Name Auto Attendant have been resolved.  Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this issue. 

(Completed) Monday, August 8, 2022, 6:00 PM - Network Maintenance / Authentication Services

IT Networking will be performing system maintenance this evening.  The maintenance will impact authentication services at the Lab.  The work will start at 6:00 PM on Monday, August 8, and is projected to last at least 15 minutes.

The impacted systems include all the IT Division's authentication services, including Single Sign-On, MFA, Phonebook, RADIUS (Employee Wireless and VPN), and Multifactor Authentication services. 

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding authentication services.

#collaborationservices #idm #lblnet #maintenance

(Completed) Wednesday, August 3, 2022 5:30PM - 7:30PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable August 3, 2022 from 5:30pm - 7:30pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Wednesday, August 3, 2022, 1:00 PM - Shibboleth Upgrade

Identity Management systems will be undergoing maintenance to upgrade the service responsible for authentication at the Lab (Shibboleth).  The upgrade will start at 1:00 PM on Wednesday, August 3.  The maintenance is projected to last up to 3 hours.

While most redundant applications are expected to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, MFA, Phonebook, RADIUS (Employee Wireless and VPN), and Multifactor Authentication services. 

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #upgrade #maintenance

(Completed) Monday, August 1, 2022 5:00PM - 7:00PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable August 1, 2022 from 5:00pm - 7:00pm for scheduled maintenance.

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Resolved) Wednesday, July 27, 2022 - Network issues, Berkeley Lab logins affected

Beginning around 5:37 pm Berkeley Lab began to experience network issues that caused several outages, each lasting 3-5 minutes, for many central data center networks providing many Lab-wide services.  At around 6:40 pm one of the troubleshooting steps during the investigation introduced new, persistent issues for some central services such as Berkeley Lab logins.  By 9:22 pm we had identified and removed the system causing the initial problem and we believe that we've restored all services.  Last update: 9:40 pm.

If you have additional questions, please email help@lbl.gov.

(Completed) Tuesday, July 26, 2022 - User-Level Apps Emails (Pexels and LinkedIn)

Zoom recently sent out a notification to all Lab Zoom users indicating that the Pexels Virtual Backgrounds and the LinkedIn Video Meetings for Zoom apps were approved.  Although this is a legitimate message from Zoom, the message should not have gone out to all Zoom users at the Lab.  Zoom inadvertently enabled this notification for our account.  The notification has been disabled.  

If you have additional questions, please email help@lbl.gov.

(Completed) Monday, June 20, 2022 12:00PM - 2:00PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable June 20th, 2022 from 12:00pm - 2:00pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Sunday, June 5, 2022 Confluence (Commons) Upgrade

Commons (commons.lbl.gov) will get upgraded from 9:00AM - 10:30AM on June 5, 2022. The upgrade will provide security enhancements to our Confluence platform.  

Please contact the Collaboration Services Team (help@lbl.gov) with questions or concerns regarding this upgrade. 

#collaborationservices #idm #upgrade @maintenance

(Restriction removed) Thursday, June 2, 2022 - 6:00PM-  Emergency Restriction on Commons.lbl.gov

Confluence has been upgraded and  the restriction to limit access to public pages has been lifted. 

More information and ongoing updates can be found at https://go.lbl.gov/confluence-vuln

Microsoft Update May Affect Network Attached Storage (Condo-Storage)

Microsoft will be rolling out a new fix in July 2022 for a vulnerability found in CVE-2021-42287. If the vulnerability is successfully exploited, this could lead to the disclosure of sensitive information, modification of data, administration takeover, or Denial of Service (DoS).

Microsoft’s fix may impact the following NAS, but not limited to: NetApp, Hitachi, Dell Compellent and etc.

NAS administrators, please reach out to your NAS vendors to confirm if their NAS OS is going to be affected by Microsoft’s upcoming fix and for a fix if it is.

NAS users (Windows Shared drives, Condo-storage, CIFS), in the event you have trouble accessing the NAS during this time, submit a ticket to help@lbl.gov and specify the network folder path you are having trouble with.

Additional Resources:

• CVE-2021-44228 Apache Log4j Vulnerability in NetApp Products

• CVE-2021-42287 Microsoft Security Center

(Completed) Tuesday, May 17, 2022 - 5:00 PM - IdM Maintenance

Identity Management systems will be undergoing maintenance starting at 5:00 PM on Tuesday, May 17.  The maintenance is projected to last up to 2.5 hours.

While most redundant applications are expected to continue to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, MFA, Phonebook, RADIUS (Employee Wireless and VPN), and Multifactor Authentication services. 

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Tuesday, May 3, 2022 - 6:00 PM - IdM Maintenance

Identity Management systems will be undergoing maintenance starting at 6:00 PM on Tuesday, May 3.  The maintenance is projected to last up to 3 hours.

While most redundant applications are expected to continue to operate normally, there is the possibility of a brief outage.

These systems include all the IT Division's authentication services, including Single Sign-On, MFA, Phonebook, RADIUS (Employee Wireless and VPN), and Multifactor Authentication services. 

Please contact the Identity Management Team (idm@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #idm #maintenance

(Completed) Week of May 2, 2022 -  Performance Management Process (PMP) System Maintenance

The Performance Management Process (PMP) System will be offline the week of May 2, 2022 for scheduled maintenance in preparation for 2022's Performance Management Process.  You can still access your performance review by searching your Google My Drive for "Performance Review".  For all other requests, contact your division's Human Resources Division Process Owner.

#collaborationservices #pmp #maintenance

(Resolved) Wednesday, March 30, 2022 1:00PM - AT&T Cellular Outage

AT&T in-building cellular phone service on the main LBL Hill Campus was offline due to an unplanned maintenance by AT&T to replace failed components. In the interim, cellular calls could be made over WiFi using the instructions found here. Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Saturday, March 26, 2022 11:30AM - 2:30PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable March 26th, 2022 from 11:30am - 2:30pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Sunday, February 27, 2022 11:00AM - 2:00PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable February 27th, 2022 from 11:00am - 2:00pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Sunday, January 30, 2022 1:00PM - 3:00PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable January 30th, 2022 from 1:00pm - 3:00pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Sunday, December 19, 2021 1:00PM - 4:00PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable December 19th, 2021 from 1:00pm - 4:00pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Friday, December 3, 2021 Disabling Hangouts

Hangouts will be disabled on December 3, 2021 so https://hangouts.google.com will not work anymore. Please use https://chat.google.com instead. Please contact help@lbl.gov with questions or concerns regarding this change.

#collaborationservices #googleworkspace #maintenance

(Completed) Saturday, November 27, 2021 - 11 PM to Midnight

Scheduled Outage - Google Workspace Security Upgrade

On Saturday, November 27, 2021, from 11 PM until midnight, IT will be performing a security upgrade on our SSO configuration with Google Workspace (Gmail, Calendar, Drive, Sites, Forms, etc.).  This work should not impact users who are already logged into Google Workspace before the upgrade begins.  However, this work will prevent new logins to Google Workspace, along with any third-party applications that use Google Sign-In, until the upgrade is completed.

#collaborationservices #googleworkspace #maintenance

(Completed) Monday, November 1, 2021 

The Performance Management Process (PMP) System

The Performance Management Process (PMP) System will be offline the week of November 1, 2021 for scheduled maintenance.  You can still access your performance review by searching your Google My Drive for "FY21 Performance Review".  For all other requests, contact your division's Human Resources Division Process Owner.

#collaborationservices #pmp #maintenance

(Completed) Sunday, October 31, 2021 - 8:00 PM - Commons & Conferences

commons.lbl.gov (Confluence) and conferences.lbl.gov (Indico) underwent scheduled maintenance. Both were back up by 8:10pm.

Please contact help@lbl.gov with questions or concerns regarding this maintenance.

#collaborationservices #commons #maintenance

(Completed) Sunday, October 17, 2021 12:00PM - 2:00PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable October 17th, 2021 from 12:00pm - 2:00pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Completed) Monday, October 4, 2021 7:00PM - 7:30PM Lab Voice Mail Maintenance

The Lab voice mail system was unavailable October 4th, 2021 from 7:00-7:30pm for planned maintenance. 

Please contact Telephone Services (tsc@lbl.gov) with questions or concerns regarding this maintenance.

(Resolved) Wednesday, September 15 2021 - 5:50PM IDM/Login/SAML/Enterprise Directory

There was an issue with LBL login services which reports on login that the user is not registered for MFA even though this isn't the case.  The service has been restored after being down for ~1 hour.

#collaborationservices #idm #maintenance

(Completed) Thursday, August 26, 2021 - 8:00 PM - Commons

commons.lbl.gov (Confluence) underwent scheduled maintenance starting at 8:00 PM on Thursday, August 26.

Commons was down for ~15 minutes.

Please contact the help@lbl.gov with questions or concerns regarding this maintenance.

#collaborationservices #commons #maintenance

(Completed) Friday, August 6, 2021 - 2:00 PM - Indico

conferences.lbl.gov (Indico) underwent maintenance starting at 2:00 PM on Friday, August 6.  The maintenance was completed at 2:45PM.

Please contact the indico-admins@lbl.gov with questions or concerns regarding this maintenance.

#collaborationservices #indico #maintenance

(Resolved) Monday, September 14, 2020 - MFA Issues

Users may experience some issues when using MFA to login to services (Gmail, Calendar, LETS, FMS, etc.).  We are currently investigating these issues. 

(Resolved) Sunday, September 13, 2020 - MFA Issues

A brief MFA outage began at approximately 4:30 PM today.  The issue was resolved by 6 PM.  

(Completed) Saturday, September 12, 2020 - Multi Factor Authentication Upgrade

On Saturday, September 12, 2020, between 10 PM and 12 AM Sunday, IT will be performing an upgrade of the servers that handle Multi Factor Authentication (MFA) for the Lab.  

While we expect limited to no interruption to the MFA service during this period, there is a potential for outages lasting as long as 30 minutes.  If such an outage occurs, it may impact logging into services that require MFA, including the Lab's Web single sign-on service at login.lbl.gov, FMS, and IT's HPC clusters.  

During the upgrade period, users will not be able to create or modify existing tokens.  Should you use a Yubikey during this period to login and later experience problems, we recommend that you login to the MFA Management application at https://identity.lbl.gov/mfa and resync the affected token. 

If you experience any other issues with your MFA tokens or Yubikey, please contact the IT Help Desk at help@lbl.gov.

(Resolved) August 24, 2020 - Zoom Outage 

Zoom is reporting outages that affect meetings and webinars.  For further information, please visit https://status.zoom.us/. 

Alternatively, you may use Google Meet to host your meetings while Zoom resolves the issue.  For more information about Google Meet, click here. To start or join a Meet meeting, visit https://meet.google.com/.  

(Resolved) August 16, 2020 - Commons Outage

Updated 8/16/20 6PM

As of 6PM, service has been restored to commons.lbl.gov 

Starting on Sunday, August 16 at around 10:45 AM, commons.lbl.gov, the Lab's Confluence server, was offline for about 7 hours due to an unscheduled outage.

(Resolved) August 6, 2020 - Bitbucket Repository Write Issues

Updated 8/6/20 5:45PM

The read-only issues with the Lab's Bitbucket repositories have been resolved as of 5:35PM, so repositories are writeable again.

The issues were first reported at 3:40PM (Pacific).

(Completed) August 5, 2020 - Scheduled Commons Outage

Updated 8/5/2020 10PM

On Wednesday, August 5 starting at 6PM, commons.lbl.gov, the Lab's Confluence server, was offline for about 3.5 hours during a scheduled maintenance window.

(Completed) July 10, 2020 - Scheduled Email Change

Updated 7/10/2020 5PM

On Friday, July 10 at about 4PM, the lbl.gov MX record changed from mailgate.lbl.gov to Google's MX record values: https://support.google.com/a/answer/174125

This change was made to protect the Lab's critical email communications in the event of another PSPS, hardware and/or software failures in the email pipeline, or any other outages in the LBL infrastructure because, in most instances, email will no longer flow through the Hill before being delivered.

More detailed documentation about this email migration is available at: https://commons.lbl.gov/x/QhD5Cg

Please contact emailteam@lbl.gov if you notice any related issues after SMTP traffic starts shifting directly to Google.

March 18, 2020 - Brief Power Outage

Updated 3/18/2020 10:12AM

There was a brief power outage affecting the Lab at approximately 9:00AM today. 

Power has been restored, but not all desktop computers automatically reboot when power has been lost.  For many people, this has likely resulted in the inability to connect to your Lab desktop computer since it is now powered off.  If you need assistance getting your Lab desktop computer powered back on, please contact the IT help desk. 

IT Provided HPC Services are still in the process of recovering from this outage.  

March 2020 - COVID Curtailment

Updated 3/15/2020

IT is currently operating normally.   

Most services are anticipated to continue in normal operation during the curtailment.

Beginning on Friday March 20, deskside support (workstation staffing troubleshooting while present at your workstation) will be curtailed, with most support being provided remotely.   

November 20, 2019 - PSPS Outage

Updated 11/19/2019 2:11PM

The PSPS Outage has been cancelled.   No systems will be proactively shutdown at LBL.   Normal operations anticipated.

November 19, 2019 - Network Outage - Resolved

Resolved.   Prior: IT is investigating a large-scale network outage at the Laboratory that began around 10:20AM.   No ETA available for restoration.

AT&T In-Building Mobile Phone Outage 04 November 2019

Updated 11/02/2019 12:44PM

AT&T in-building mobile phone service on the main LBL Hill Campus will be offline Monday, 04 November, 2019 from 06:00AM to 02:00PM for hardware maintenance by AT&T to repair and/or replace failed components.

Questions?   Email tsc@lbl.gov

PG&E Public Safety Power Outage 25 October 2019

Updated 10/29/2019 4:16PM

All IT services including HPC have returned to normal operation.

PRESERVED OUT OF DATE INFORMATION

Updated 10/29/2019 at 11:28AM

IT is engaged in the re-energization of the Laboratory.   We anticipate that all services except HPC will be available by the time the Laboratory is re-opened.   HPC services require full cooling capacity in Building 50, which generally occurs 24 hours after re-energization.

At this time, IT service availability is generally the same as during the last PSPS Outage (though this is subject to change).

What systems are operational?

• All Google Suite Services (gmail, docs, drive, calendar, etc) (For clarity, access to lbl email should function normally for all devices).

• All Identity Management Services (login, phonebook, directory, etc)

• Business Systems (FMS, HRIS, EHS Systems, etc)

• Cloud Based Websites (Google Sites, WPengine, Pantheon, etc)

• Www2.lbl.gov, status.lbl.gov, and Commons.lbl.gov

• Core Networking and VPN

• Telephones and Voicemail

• Security Systems including Physical Access Control (where controllers have power)

• Science Project Storage Service (SPSS) (Operational, but can be shut off at any time due to heat load issues)

• Shared Drives (G, H, Grouper, etc) (Operational, but can be shut off at any time due to heat load issues)

• The Helpdesk is operational at help.lbl.gov and available to provide assistance to offsite facilities and telecommuting employees.

• All IT service teams are either fully operating remotely or on call (e.g. networking, telephony, security, collaboration, etc).

What systems were shut down?

• LBL IT Provided HPC Services (Shut Down as of 10/25 COB)

• Science Virtual Machine Services (SVM) (Shut down as of 10/26 9AM)

• Systems in the Colo Facility (2109) (Operational for All Customers (were previously shut down as of 10/26 2PM)

Why do you use the word “Anticipated”

Emergency power is unpredictable. If generators fail, are required to be shutdown, or run out of fuel - or if cooling is insufficient to safely manage systems, systems will be shutdown. 

Questions?   Email it-communications@lbl.gov

In the event of any disruption of IT services, this site will provide a means for Lab employees to communicate with each other and stay informed on the status of IT's operations. 

The Emergency Status Information Line is: 1-800-445-5830.

(Scheduled) Thursday, May 18, 2023 -  Update to Lab Websites

The following websites will undergo updates between 7:30 AM and 9 AM:

• www.lbl.gov

• newscenter.lbl.gov

• search.lbl.gov

The sites will be inaccessible while the update takes place. Please contact the Web  Services Team (via help@lbl.gov) with questions or concerns regarding this maintenance.

#collaborationservices #webservices #maintenance #upgrade