Skip to content

Instantly share code, notes, and snippets.

@frederickding

frederickding/gist:8d0c9e892160f07dbe03

Created December 5, 2014 00:30
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save frederickding/8d0c9e892160f07dbe03 to your computer and use it in GitHub Desktop.
Save frederickding/8d0c9e892160f07dbe03 to your computer and use it in GitHub Desktop.
Download ZIP
MAJOR PENNNET OUTAGE 2014-12-04T19:22:05-05:00
Raw
gistfile1.txt
Date: Thursday, December 4, 2014 EST
Start time: 4:00 pm
Duration: Unknown
Building(s) Affected: Entire Campus
Service(s) Affected: ALL
Description: Good Evening,
Shortly before 4:00pm we experienced a problem on
our primary core services network (NOC1) that
caused widespread disruption to several campus
services including but not limited to:
1. Your ability to log in to websites with your
PennKey username and password.
2. Central Email Services: Individuals who use
either Zimbra and ISC Exchange, or the ISC
Mailing Lists service were likely unable to send
and receive email messages. During the
disruption, messages sent to these users from
other mail services were cached offsite and will
be delivered this evening.
3. Wireless Connectivity: AirPennNet and
AirPennNet-Guest may have been visible, but users
were unable to log in or get/maintain a network
address.
4. Wired Connectivity: If your network connection
relied on the central DHCP service you may have
been unable to obtain or renew your IP address
lease.
The nature of the outage also disrupted
connectivity to our monitoring systems making it
difficult to provide a complete list of all the
services that were impacted.
Our Systems team completed restoration of all the
systems and services hosted on the NOC 1 network
at 6:37pm. We will continue to investigate the
root cause and will take necessary measures to
prevent a reoccurrence of this evening's
disruption.
Our sincere apologies for the inconvenience that
many in the Penn community experienced as a
result of this problem and thank you for your
patience as we worked to restore normal and
reliable service.
ISC Client Care
University of Pennsylvania
help@isc.upenn.edu
http://www.upenn.edu/isc/help/
(215)898-1000
Monday-Friday 8:00am - 6:00pm
To check the status of PennNet, please visit http://www.upenn.edu/isc/help/ and select "PennNet Status".
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment