Generated Report for NLR PacketNet

NLR PacketNet Network Operations Report
02/25/2009 - 03/03/2009

NLR PacketNet Network Operations Center

New Connections

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	*Start Time (UTC)*	*End Time (UTC)*

8314	2-High	2-High	NLR Layer 3 Backbone Circuit DENV-SEAT Outage Resolved	Circuit - Other	02/25/2009 12:55 AM	02/25/2009 1:18 PM
8330	2-High	2-High	NLR Layer 3 Backbone Circuit LOSA-SEAT Outage Resolved	Circuit - Other	03/02/2009 9:00 AM	03/02/2009 9:19 AM
8334	2-High	2-High	NLR Layer 3 Member OneNet (CHIC) Outage Resolved	Software	03/03/2009 7:01 AM	03/03/2009 8:14 AM

Unscheduled Outages Detail

Ticket No.:	8314:77
Subject:	NLR Layer 3 Backbone Circuit DENV-SEAT Outage Resolved
Affected:	NLR-DENV-SEAT-10GE-58
Start Time:	Wednesday, February 25, 2009, 12:55 AM (0055) UTC
End Time:	Wednesday, February 25, 2009, 1:18 PM (1318) UTC
Description:	NLR Layer 3 Backbone Circuit DENV-SEAT is now available to the community. NLR Layer 1 NOC Engineering, with the assistance of a Level(3) Communications technician, identified a bad fiber jumper in Seattle, WA. The jumper has been replaced and no further outages are expected.

Ticket No.:	8330:77
Subject:	NLR Layer 3 Backbone Circuit LOSA-SEAT Outage Resolved
Affected:	NLR-LOSA-SEAT-10GE-256
Start Time:	Monday, March 2, 2009, 9:00 AM (0900) UTC
End Time:	Monday, March 2, 2009, 9:19 AM (0919) UTC
Description:	NLR Layer 3 Backbone Circuit LOSA-SEAT is now available following fiber testing in Seattle, WA. NLR Layer 1 NOC Engineering worked with PNWGP and Level(3) Communications technicians to finish testing and restore service. This is a continuation of ticket 8323:77.

Ticket No.:	8334:77
Subject:	NLR Layer 3 Member OneNet (CHIC) Outage Resolved
Affected:	Member OneNet (CHIC)*
Start Time:	Tuesday, March 3, 2009, 7:01 AM (0701) UTC
End Time:	Tuesday, March 3, 2009, 8:14 AM (0814) UTC
Description:	NLR Layer 3 Member OneNet's backhaul circuit is now available following a re-homing maintenance (8325:77). NLR Layer 3 Engineering encountered difficulties during this maintenance and have returned to the former circuit. No further outages are expected. *Member OneNet is multi-homed and therefore remained reachable.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	*Start Time (UTC)*	*End Time (UTC)*

8316	3-Elevated	2-High	NLR Layer 3 Backbone Circuit ATLA-CHIC Maintenance Completed	Circuit	02/28/2009 1:09 PM	02/28/2009 2:34 PM
8317	3-Elevated	2-High	NLR Layer 3 Backbone Circuit HOUS-LOSA Maintenance Completed	Circuit	03/02/2009 6:07 AM	03/02/2009 6:14 AM
8323	3-Elevated	2-High	NLR Layer 3 Backbone Circuit LOSA-SEAT Maintenance Completed	Circuit	03/02/2009 8:04 AM	03/02/2009 8:00 AM
8325	3-Elevated	2-High	NLR Layer 3 Member OneNet (CHIC) Maintenance Completed	Software	03/03/2009 6:02 AM	03/03/2009 7:00 AM

Scheduled Maintenances Detail

Ticket No.:	8316:77
Subject:	NLR Layer 3 Backbone Circuit ATLA-CHIC Maintenance Completed
Affected:	NLR-ATLA-CHIC-10GE-01591
Start Time:	Saturday, February 28, 2009, 1:09 PM (1309) UTC
End Time:	Saturday, February 28, 2009, 2:34 PM (1434) UTC
Description:	NLR Layer 3 Backbone Circuit ATLA-CHIC was unavailable while NLR's fiber provider replaced a damaged optical fiber jumper. An outage was observed. Maintenance has been completed.

Ticket No.:	8317:77
Subject:	NLR Layer 3 Backbone Circuit HOUS-LOSA Maintenance Completed
Affected:	NLR-HOUS-LOSA-10GE-87
Start Time:	Monday, March 2, 2009, 6:07 AM (0607) UTC
End Time:	Monday, March 2, 2009, 6:14 AM (0614) UTC
Description:	NLR Layer 3 Backbone Circuit HOUS-LOSA was unavailable while NLR Layer 1 NOC Engineering, with the assistance of a Level(3) Communications technician, replaced a failing card in Giddings, TX. A brief outage was observed. Maintenance has been completed.

Ticket No.:	8323:77
Subject:	NLR Layer 3 Backbone Circuit LOSA-SEAT Maintenance Completed
Affected:	NLR-LOSA-SEAT-10GE-256
Start Time:	Monday, March 2, 2009, 8:04 AM (0804) UTC
End Time:	Monday, March 2, 2009, 8:00 AM (0800) UTC
Description:	NLR Layer 1 NOC Engineering, with the assistance of a PNWGP technician, have required additional time for fiber troubleshooting. The maintenance window has expired and the problem is now being tracked in outage ticket 8330:77.

Ticket No.:	8325:77
Subject:	NLR Layer 3 Member OneNet (CHIC) Maintenance Completed
Affected:	Member OneNet (CHIC)*
Start Time:	Tuesday, March 3, 2009, 6:02 AM (0602) UTC
End Time:	Tuesday, March 3, 2009, 7:00 AM (0700) UTC
Description:	NLR Layer 3 Engineering attempted to re-home OneNet's backhaul circuit in preparation for Phase IV of the NLR upgrade. Difficulties were encountered during the re-homing and the maintenance window has expired. This will now be tracked as an outage in ticket 8334:77. *Denotes multi-homed status.

Downtime and Availability

NLR PacketNet Core Nodes	Down Time	Reporting Period Availability	52 Week Availability
atla.layer3.nlr.net	0 hr 0 min	100.00000%	99.98634%
chic.layer3.nlr.net	0 hr 0 min	100.00000%	99.99715%
denv.layer3.nlr.net	0 hr 0 min	100.00000%	99.98406%
hous.layer3.nlr.net	0 hr 0 min	100.00000%	99.99696%
indylab.layer3.nlr.net	0 hr 0 min	100.00000%	100.00000%
newy.layer3.nlr.net	0 hr 0 min	100.00000%	99.98824%
seat.layer3.nlr.net	0 hr 0 min	100.00000%	99.99639%
wash.layer3.nlr.net	0 hr 0 min	100.00000%	99.99507%
losa.layer3.nlr.net	0 hr 0 min	100.00000%	99.99583%

Aggregate NLR PacketNet Core Nodes	0 hr 0 min	100.00000%	99.99334%

NLR PacketNet Backbone Circuits	Down Time	Reporting Period Availability	52 Week Availability
NLR-DENV-SEAT-10GE-58	12 hr 23 min	92.62897%	99.27899%
NLR-DENV-CHIC-10GE-36	0 hr 0 min	100.00000%	99.22833%
NLR-DENV-HOUS-10GE-82	0 hr 0 min	100.00000%	99.10140%
NLR-CHIC-HOUS-10GE-67	0 hr 0 min	100.00000%	99.78578%
NLR-HOUS-LOSA-10GE-87	0 hr 7 min	99.93056%	99.36798%
NLR-DENV-LOSA-10GE-90	0 hr 0 min	100.00000%	99.68693%
NLR-NEWY-WASH-10GE-98	0 hr 0 min	100.00000%	99.98634%
NLR-ATLA-CHIC-10GE-01591	1 hr 25 min	99.15675%	99.85428%
NLR-ATLA-HOUS-10GE-217	0 hr 0 min	100.00000%	99.71463%
NLR-WASH-ATLA-10GE-232	0 hr 0 min	100.00000%	99.99772%
NLR-LOSA-SEAT-10GE-256	0 hr 23 min	99.77183%	99.96642%
NLR-NEWY-CHIC-10GE-275	0 hr 0 min	100.00000%	100.00000%
NLR-CHIC-WASH-10GE-277	0 hr 0 min	100.00000%	100.00000%

Aggregate All NLR PacketNet Backbone Circuits	14 hr 18 min	99.34524%	99.68991%

Upcoming Scheduled Maintenances

Ticket No.:	8331:77
Subject:	NLR Layer 3 Core Node NEWY Maintenance
Affected:	Core Node NEWY and its Members and Peers
Start Time:	Friday, March 6, 2009, 5:01 AM (0501) UTC
End Time:	Friday, March 6, 2009, 6:00 AM (0600) UTC
Description:	NLR Layer 3 NOC Engineering will be performing a hardware upgrade to the core router in New York, NY. A brief outage is expected; however the entire maintenance window has been reserved.

Ticket No.:	8335:77
Subject:	NLR Layer 3 Backbone Circuit DENV-SEAT Maintenance
Affected:	NLR-DENV-SEAT-10GE-58
Start Time:	Tuesday, March 10, 2009, 7:00 AM (0700) UTC
End Time:	Tuesday, March 10, 2009, 8:00 AM (0800) UTC
Description:	NLR Layer 1 NOC Engineering, with the assistance of a Level(3) Communications technician, will be installing new equipment in Denver, CO. Outages are expected throughout the maintenance window.