News Items 0-2041

Tonkawa hub router Posted Friday, November 13, 2009 - 8:52 AM by Sam
Start Date:Tuesday, November 17, 2009 - 10:00 PM
End Date:Tuesday, November 17, 2009 - 11:00 PM
Scope:All customers behind Tonkawa router
Reason:Replace hardware

Description: Flexwan at Tonkawa needs to be replaced. This should take 15 minutes, but entire window is reserved.

Warner Hub Posted Friday, October 23, 2009 - 2:39 PM by Todd
Start Date:Friday, October 28, 2009 - 10:00 PM
End Date:Friday, October 28, 2009 - 10:30 PM
Scope:All customers on the Warner hub site.
Reason:Hardware replacement.

Description: OneNet will be replacing hardware on the Warner hubsite router. The expected outage is 10 mintues. However, the entire 30 minute window will be reserved, thank you.

Tishomingo Hub Outage Posted Friday, October 23, 2009 - 1:25 PM by Randy
Start Date:Friday, October 23, 2009 - 9:45 AM
End Date:Friday, October 23, 2009 - 1:22 PM
Scope:All customers connected to Tishomingo Hub
Reason:Equipment Failure

Description: Telco equipment became usstable and failed. Techs have replaced failed equipment and service has been restored.

Web Server Updates Posted Thursday, October 22, 2009 - 11:37 AM by Paul
Start Date:Friday, October 23, 2009 - 06:30
End Date:Friday, October 23, 2009 - 08:00
Scope:Web Services
Reason:Software update installation

Description: Software updates will be installed on the OneNet web servers beginning at 6:30AM. Web services should be restored before 8AM.

Datacenter Storage Maintenance Posted Tuesday, October 20, 2009 - 5:31 PM by Frank
Start Date:Thursday, October 22, 2009 - 4:00 AM
End Date:Thursday, October 22, 2009 - 8:00 AM
Scope:Web Services
Reason:Maintenance on storage system.

Description: OneNet will perform maintenance that will affect Web services. Services will be intermittent during this window. All services should be restored by 8 A.M.

Fiber cut near panhandle area Posted Thursday, October 8, 2009 - 11:05 AM by Todd
Start Date:Thursday, October 8, 2009 - 11:02 AM
End Date:Thursday, October 8, 2009 - 11:02 AM
Scope:Various T1 customers in the Northwestern portion of the state.
Reason:Fiber Cut.

Description: Panhandle Telephone had a major fiber cut in the Northwestern portion of the state. The Fiber cut has been repaired and T1 connectivity has been restored.

Wilburton hub site DS3 down last night Posted Friday, September 25, 2009 - 8:37 AM by Bobby
Start Date:Friday, September 25, 2009 - 8:32 AM
End Date:Friday, September 25, 2009 - 8:32 AM
Scope:Wilburton Hub site DS3 went down last night due to a cut over that Oklahoma Western was doing. The circuit was down for an hour and a half coming back up at 10:22pm.
Reason:Cut over for Oklahoma Western Telephone company.

Description: Cut over affected the DS3 that services the Wilburton Hub site. All services were restored at 10:22pm.

DS3 circuit down Posted Thursday, September 24, 2009 - 9:55 PM by Bobby
Start Date:Thursday, September 24, 2009 - 9:46 PM
End Date:
Scope:DS3 link to OneNet equipment down. All customers behind hub site do not have internet services at this time. Hub site is power has been verified.
Reason:Telco is checking out the problem.

Description: DS3 circuit to OneNet equipment is down. Telco had been made aware. No eta at this time.

Fiber Cut Posted Tuesday, September 22, 2009 - 5:17 PM by Randy
Start Date:Tuesday, September 22, 2009 - 4:38 PM
End Date:
Scope:Ardmore Hub service degraded and Mid America Career Center Wayne Campus
Reason:Fiber Cut near Purcell

Description: Telco fiber has been cut near Purcell and crews are dispatching. No ETA at this time.

Emergency Reload of Firewall Posted Thursday, September 10, 2009 - 5:00 PM by Todd
Start Date:Thursday, September 10, 2009 - 4:58 PM
End Date:Thursday, September 10, 2009 - 4:58 PM
Scope:DNS,Web,Email and D2L services.
Reason:Software issue

Description: Outage is expected to be 10 minutes.

Seminole Hub Posted Saturday, September 5, 2009 - 9:35 PM by Todd
Start Date:Saturday, September 5, 2009 - 9:33 PM
End Date:Saturday, September 5, 2009 - 9:33 PM
Scope:All customers on hub.
Reason:Possible issue with fiber shelf

Description: The telco is reporting a possible issue with a fiber shelf that appears to affecting connecitvity to the Seminole hub. A Technician is in routed no ETR.

Seminole Hub Posted Saturday, September 5, 2009 - 9:21 PM by Todd
Start Date:Saturday, September 5, 2009 - 9:20 PM
End Date:Saturday, September 5, 2009 - 9:20 PM
Scope:Connectvity
Reason:Unknown outage

Description: The telco has been contacted to investigate the cause of the outage. no ETR.

Core Router reload correction Posted Thursday, September 3, 2009 - 4:10 PM by Todd
Start Date:Sunday, September 6, 2009 - 7:00 AM
End Date:Sunday , September 6, 2009 - 7:20 A.M
Scope:All Co-location, Research Park, Hosted VoIP, and Video customers.
Reason:Router reload.

Description: We will be rebooting a core router at 7:00 a.m. The above clients will be affected, all other services will not be impacted.

Core Router reload Posted Thursday, September 3, 2009 - 4:04 PM by Todd
Start Date:Thursday, September 6, 2009 - 7:00 A.M
End Date:Thursday, September 6, 2009 - 7:20 AM
Scope:All Co-location, Research Park, Hosted VoIP, and Video customers.
Reason:Router reload.

Description: We will be rebooting a core router at 7:00 a.m. The above clients will be affected, all other services will not be affected.

Core Router Upgrade Posted Tuesday, September 1, 2009 - 9:36 AM by Todd
Start Date:Tuesday, September 1, 2009 - 10:30 PM
End Date:Tuesday, September 1, 2009 - 10:50 PM
Scope:All Co-location, Research Park, Hosted VoIP, and Video customers.
Reason:Software upgrade

Description: OneNet will be upgrading software on a core router at 10:30 p.m. tonight to resolve a potential software related issue. The expected window is 20 minutes. Only these customers will be affected. All other services will remain unaffected during this window.

Email system outage on new system Posted Sunday, August 30, 2009 - 11:29 AM by Brian
Start Date:Saturday, August 29, 2009 - 11:00 PM
End Date:Sunday, August 30, 2009 - 7:40 PM
Scope:OneNet hosted mail on new messaging/calendaring system. Calendaring is still available.
Reason:Software failures

Description: We're working with the vendor to resolve this issue. Messaging services are currently unavailable.

Update:
The bug has been identified and a workaround is in place. Service is restored.

Seminole Hub site outage Posted Friday, August 28, 2009 - 3:14 PM by Bobby
Start Date:Friday, August 28, 2009 - 3:12 PM
End Date:Friday, August 28, 2009 - 3:12 PM
Scope:Telco testing causes an outage for the Seminole Hub site. All customers on the hub were affected.
Reason:Telco testing caused outage.

Description: Telco testing caused the outage that lasted one hour. All services have been restored.

Chickasha Hub site Posted Thursday, August 27, 2009 - 7:33 AM by Bobby
Start Date:Thursday, August 27, 2009 - 7:28 AM
End Date:
Scope:Loss of power. No ET at this time.
Reason:Loss of Service to the Hub site and customers due to power outage.

Description: Loss of power (Power outage) on the campus.

Ada Hub site Posted Wednesday, August 26, 2009 - 1:53 PM by Bobby
Start Date:Wednesday, August 26, 2009 - 12:44 PM
End Date:Wednesday, August 26, 2009 - 12:44 PM
Scope:Problem with Telco Transport equipment.
Reason:Transport equipment failure.

Description: Loss of service was caused by Telco Transport equipment failure...all services have been restored.

Ada Hub site Posted Wednesday, August 26, 2009 - 11:29 AM by Bobby
Start Date:Wednesday, August 26, 2009 - 11:26 AM
End Date:
Scope:Down DS3 circuit. Service affecting for customers off of the site.
Reason:Telco is investigating the problem. No ET at this time.

Description: Customers off the Hub site have lost service and Telco is investigating the problem.

No ET at this time.

Alva Hub site Posted Tuesday, August 25, 2009 - 3:25 PM by Todd
Start Date:Tuesday, August 25, 2009 - 3:23 PM
End Date:Tuesday, August 25, 2009 - 3:23 PM
Scope:All T1 customers
Reason:Unknown

Description: OneNet has engaged the Telco to investigate cause of T1 outages on a CT3 connection. No ETR at this time.

Altus Hub Posted Friday, August 14, 2009 - 11:38 AM by Todd
Start Date:Friday, August 14, 2009 - 11:34 AM
End Date:Friday, August 14, 2009 - 11:34 AM
Scope:All customer on the Altus hub.
Reason:Fiber cut

Description: Southwest Oklahoma Telephone has reported a fiber cut that occurred late last night. A temporary splice is in place and the telco will work through out today for a permenant fix. Intermittent connectivity is expected until the full repair is complete.

Datacenter Network Maintenance Posted Tuesday, July 28, 2009 - 3:52 PM by Frank
Start Date:Friday, July 31, 2009 - 8:00 PM
End Date:Saturday, Aug 1, 2009 - 6:00AM
Scope:Web Services
Reason:Datacenter Network Maintenance

Description: OneNet will perform maintenance that will affect Web services. Services will be intermittent during this window. All services should be restored by 6 A.M.

Cox Maintenance Window Posted Tuesday, July 28, 2009 - 11:38 AM by Randy
Start Date:Saturday, August 1, 2009 - 12:01 AM
End Date:Saturday, August 1, 2009 - 3:00 AM
Scope:OneNet customers with Cox Ethernet or Fast Ethernet circuits in OKC Metro area including FAA, OK County, Tax Commission and schools.
Reason:Equipment Maintenance

Description: Services may be interuppted from 5 - 15 minutes during the maintenance window. Extended outages are not expected.

OKC Datacenter Maintenance Posted Monday, July 27, 2009 - 9:31 AM by Von
Start Date:Saturday, August, 1 2009 - 12:00 AM
End Date:Saturday, August, 1 2009 - 6:00 AM
Scope:Internet Access into/out of OKC NOC Datacenter. Datacenter hosted DNS, Email, Web, VoIP, D2L including customer hosted services.
Reason:Datacenter network maintenance.

Description: Network maintenance within the OKC NOC Datacenter will disrupt internet access to all hosted services including but not limited to DNS, Email, Web, VoIP, D2L as well as locally hosted customer services. The maintenance includes upgrade and reengineering of datacenter network and security hardware. There will be intermittent loss of access to services throughout the maintenance window.

Stillwater GigE links Posted Wednesday, July 15, 2009 - 10:57 PM by Von
Start Date:Wednesday, July 15, 2009 - 10:30 PM
End Date:Thursday, July 16, 2009 - 12:00 AM
Scope:OSU-Stillwater Gig Links
Reason:Maintenance

Description: OSU Stillwater networking staff is performing maintenance on campus network. They are testing both redundant and failover systems throughout campus. Primary and secondary links may bounce up/down through maintenance window.

Loss of power at Alva Hub site Posted Sunday, July 12, 2009 - 1:41 PM by Bobby
Start Date:Sunday, July 12, 2009 - 1:37 PM
End Date:
Scope:Alva lost power last night around 2300 hours. Emergency hardware restart was done.
Reason:Power loss.

Description: Due to power loss emergency restart was done on equipment to reload all blades. One blade did not recover from the loss of power Saturday evening. Reload completion about 15 mins.

Emergency Reload of Alva site Posted Sunday, July 12, 2009 - 1:16 PM by Bobby
Start Date:Sunday, July 12, 2009 - 1:07 PM
End Date:
Scope:Emergency reload of Alva Hub site equipment.
Reason:Module reset of equipment.

Description: Reload of equipment. Expected time to completion of reloan about 15 mins.

Okmulgee Hub Relocation Posted Thursday, July 9, 2009 - 4:31 PM by Randy
Start Date:Thursday, July 30, 2009 - 11:30 PM
End Date:Thursday, July 31, 2009 - 6:00 AM
Scope:All Customers connected to Okmulgee Hub and Okmulgee Tower
Reason:Moving to new facility

Description: Equipment and connectivity will be relocated to new facility. Services will experience a disruption in service as equipment is migrated to the new facility. Outages may last 2 hours or more.

Datacenter Network Maintenance Posted Wednesday, July 8, 2009 - 8:44 AM by Frank
Start Date:Thursday, July 9, 2009 - 5:00 AM
End Date:Thursday, July 9, 2009 - 8:00 AM
Scope:Web Services
Reason:Datacenter Network Maintenance

Description: OneNet will perform maintenance that will affect Web services. Services will be intermittent during this window. All services should be restored by 8 A.M.

Alva Hub Site Posted Wednesday, July 8, 2009 - 7:57 AM by Bobby
Start Date:Wednesday, July 8, 2009 - 7:54 AM
End Date:Power Outage in Alva
Scope:Loss of Power in the town of Alva. Half the town is without power according to Campus Police.
Reason:Loss of Power

Description: Loss of Power affecting the town and campus. No ET at this time.

Claremore Hub Posted Monday, July 6, 2009 - 8:57 AM by Todd
Start Date:Monday, July 6, 2009 - 8:54 AM
End Date:Monday, July 6, 2009 - 8:54 AM
Scope:All Customers at the Claremore Hub.
Reason:City of Claremore Power outage.

Description: The City of Claremore has power issues, ETR is 9:30.

Claremore Hub Posted Monday, July 6, 2009 - 8:38 AM by Todd
Start Date:Monday, July 6, 2009 - 8:36 AM
End Date:Monday, July 6, 2009 - 8:36 AM
Scope:All T1 customers
Reason:Suspected Telco issue.

Description: The CT3 that supplies connectivity to all T1 connections is down at this time. The telco has been contacted and investigation is underway.

Maintenance Update Posted Wednesday, July 1, 2009 - 8:12 AM by Todd
Start Date:Thursday, July 2, 2009 - 5:00 AM
End Date:Thursday, July 2, 2009 - 8:00 AM
Scope:Email, Web, DNS, Hosted VoIP, and Co-location services.
Reason:Maintenance

Description: OneNet will perform maintenance that will affect Email, Web, DNS, Hosted VoIP and Co-location services. Services will be intermittent during this window. All services should be restored by 8 A.M.

Maintenance Posted Tuesday, June 30, 2009 - 5:02 PM by Todd
Start Date:Thursday, July 2, 2009 - 5:00 AM
End Date:Thursday, July 2, 2009 - 8:00 AM
Scope:Email, Web, and DNS services
Reason:Maintenance.

Description: OneNet will perform maintenance that will affect email, web, and DNS services intermittently during this window. All services should be restored by 8 A.M.

Alva Hubsite Posted Sunday, June 28, 2009 - 9:52 PM by Joe
Start Date:Sunday, June 28, 2009 - 9:49 PM
End Date:Unknown
Scope:T3 from Alva hub to OKC6 is down.
Reason:Telco is checking issue.

Description: T3 down at 854 PM

Emergency Maintenance Posted Wednesday, June 24, 2009 - 3:59 PM by Todd
Start Date:Wednesday, June 25, 2009 - 6:00 AM
End Date:Wednesday, June 25, 2009 - 7:00 AM
Scope:Research Park, Co-location clients, and Hosted VoIP services
Reason:Hardware replacement

Description: OneNet will be replacing hardware tomorrow morning to resolve an issue with a core switch.

Duncan hub router Posted Thursday, June 18, 2009 - 4:06 PM by Sam
Start Date:Thursday, June 18, 2009 - 10:00 PM
End Date:Thursday, June 18, 2009 - 11:00 PM
Scope:All customers behind Duncan hub router
Reason:Errors on DS3IP

Description: INFO will test DS3IP for errors.

Goodwell hub router Posted Friday, June 12, 2009 - 9:36 AM by Sam
Start Date:Tuesday, June 16, 2009 - 5:00 AM
End Date:Tuesday, June 16, 2009 - 6:00 AM
Scope:All customers behind Goodwell hub router
Reason:INFO hardware upgrade

Description: INFO needs to move this circuit for hardware upgrade. This should take 10 minutes, but entire window is reserved

Cancelled Network Maintenance Posted Thursday, June 11, 2009 - 1:32 PM by Randy
Start Date:Saturday, June 27, 2009 - 10:00 AM
End Date:Saturday, June 27, 2009 - 2:00 PM
Scope:Stillwater DWDM Upgrade
Reason:Remove system vulnerabilities on OKC-Stillwater path

Description: This Maintenance has been cancelled.
Intermittent interuptions on OKC to Stillwater DWDM path while services are moved to redundant equipment. No outages are expected, services will remain up on alternate ring path. Switch hits <50 ms. may be observed

INFO hardware move Posted Monday, June 8, 2009 - 3:23 PM by Sam
Start Date:Thursday, June 11, 2009 - 11:59 PM
End Date:Friday, June 12, 2009 - 1:00 AM
Scope:Customers behind Alva hub router.These DS3 connections: Commanche Schools,Purcell H/S. Tonkawa and Durant hub routers will have diminished IP bandwidth during move.
Reason:INFO is moving circuits to single mux

Description: This is a first step for INFO lightwave upgrade.

Stillwater Hub Posted Friday, June 5, 2009 - 11:27 AM by Todd
Start Date:Friday, June 5, 2009 - 11:22 AM
End Date:Friday, June 5, 2009 - 11:22 AM
Scope:All cusotmers on the Stillwater Hub including Oklahoma State University, Ok Dept of Career Technology, and Meridian Technology.
Reason:Emergency Maintenance

Description: OneNet will performing maintenance on the Stillwater hub. A 10 to 15 minute outage is expected.

Goodwell hub router Posted Thursday, June 4, 2009 - 11:47 AM by Sam
Start Date:Thursday, June 4, 2009 - 11:43 AM
End Date:Thursday, June 4, 2009 - 11:43 AM
Scope:All customers behind Goodwell hub router
Reason:Electrcial work

Description: Crews working on electrical plant. No ET for completion

MBO Maintenance Window Posted Wednesday, June 3, 2009 - 9:31 AM by Randy
Start Date:Thursday, June 11, 2009 - 12:01 AM
End Date:Thursday, June 11, 2009 - 6:00 AM
Scope:Seminole Hub Link and Okla. Baptist University
Reason:Hardware Upgrade

Description: Telco will be performing maintenance on equipment. No outage is expected.

Tishomingo Hub Outage Posted Wednesday, June 3, 2009 - 8:06 AM by Randy
Start Date:Wednesday, June 3, 2009 - 4:50 AM
End Date:
Scope:All Customers connected to Tishomingo
Reason:Power Outage in Local Area

Description: The local utility reports a widespread power outage in City of Tishomingo since 3 am. They are working to restore electrical service as soon as possible.

NLR router maintenance Posted Tuesday, June 2, 2009 - 10:58 AM by Todd
Start Date:Friday, June 5, 2009 - 10:00 PM
End Date:Saturday, June 6, 2009 - 2:00 AM
Scope:Internet2 and NLR services.
Reason:Scheduled Maintenance.

Description: OneNet will be performing maintenance on redundant Internet 2 and NLR services. Services should not be not be impacted on the primary Internet 2 and NLR connections.

Cox Maintenance Window Posted Tuesday, June 2, 2009 - 8:19 AM by Randy
Start Date:Friday, June 5, 2009 - 12:00 AM
End Date:Friday, June 5, 2009 - 2:00 AM
Scope:Cox ethernet services to Francis Tuttle, Norman Public Library
Reason:Software Upgrade

Description: Circuits will observe 10 minute outage while equipment reboots after software upgrade

Cox Maintenance Window Posted Tuesday, June 2, 2009 - 8:16 AM by Randy
Start Date:Thursday, June 4, 2009 - 12:00 AM
End Date:Thursday, June 4, 2009 - 2:00 AM
Scope:Cox Ethernet Customers in OKC including Francis Tuttle, OKC PS, ODOT, County Annex,Veterans Center
Reason:Software Upgrade

Description: A outage of 10 minutes will be observed on circuits during the maintenance window while equipment reboots.

Okmulgee Hub Maintenance Posted Wednesday, May 27, 2009 - 1:08 PM by Randy
Start Date:Wednesday, June 3, 2009 - 1:00 AM
End Date:Wednesday, June 3, 2009 - 6:00 AM
Scope:Customers connected to Okmulgee Hub
Reason:Telco Maintenance - Circuit Grooming

Description: Telco will be performing maintenance on their system causing a 10 minute outage during the maintenance window.

Network Maintenance Posted Tuesday, May 26, 2009 - 11:59 AM by Randy
Start Date:Saturday, June 6, 2009 - 8:00 AM
End Date:Saturday, June 6, 2009 - 5:00 PM
Scope:DWDM system upgrade
Reason:Remove system vulnerabilities on OKC-TULSA path

Description: Intermittent interuptions on OKC to TULSA DWDM path while services are moved to redundant equipment. No outages are expected, services will remain up on alternate ring path. Switch hits <50 ms. may be observed.

Network Maintenance Posted Tuesday, May 26, 2009 - 11:26 AM by Randy
Start Date:Thursday, May 28, 2009 - 10:00 PM
End Date:Thursday, May 28, 2009 - 11:00 PM
Scope:OneNet Hubs McAlester, Idabel and Tishomingo
Reason:Hardware Replacement

Description: Hardware affecting the hub link circuits for McAlester, Idabel and Tishomingo will be replaced with new hardware. Outage is expected to last 15 minutes but entire window is reserved.

NLR router Posted Tuesday, May 19, 2009 - 1:00 AM by Von
Start Date:Monday, May 18, 2009 - 4:00 PM
End Date:Tuesday, May 19, 2009 - 12:00 AM
Scope:Internet2 and National Lambda Rail services.
Reason:Failed hardware in router.

Description: Failed hardware in our NLR router caused instability on the border router with I2 and NLR. Hardware has been replaced and stability restored. OneNet support staff will continue to monitor.

Data Center Maintenance Posted Wednesday, May 6, 2009 - 9:38 AM by Joe
Start Date:Saturday, May 16 2009 - 4:00AM
End Date:Saturday, May 16 2009 - 7:00AM
Scope:During the maintenance period the following all OneNet hosted services will be interrupted. This includes DNS, VOIP, and web hosting.
Reason:Upgrade/maintenance to Data Center switch.

Description: OneNet engineers will perform maintenance/upgrade on a core switch that provides connectivity to all servers located in the OneNet Data Center.

OKC 13 Hub Posted Monday, May 4, 2009 - 12:38 PM by Todd
Start Date:Monday, May 4, 2009 - 12:34 PM
End Date:Monday, May 4, 2009 - 12:34 PM
Scope:Select T1 customers
Reason:Telco issue with CT3

Description: ATT found a faulty DSX jack that was affecting connectivity on the CT3. All connectivity had been restored.

OKC 13 Hub Posted Monday, May 4, 2009 - 8:23 AM by Todd
Start Date:Monday, May 4, 2009 - 8:21 AM
End Date:Monday, May 4, 2009 - 8:21 AM
Scope:Select T1 Customers.
Reason:Telco issue.

Description: OneNet has a CT3 that supplies connectivity to multiple T1 connections that is down at this time. The Telco has be engaged and troubleshooting is underway. No ETR has been given at this time.

Dates for OKC6 Newspro Posted Monday, April 20, 2009 - 2:26 PM by Joe
Start Date:Monday, April 22, 2009 - 11:59 PM
End Date:Monday, April 23 2009 - 12:59 AM
Scope:Dates for OKC6 newspro are 22 April 2009-11:59 PM to 23 April 2009-12:59 AM. Please disregard dates from previous newspro.
Reason:

Description:

OKC6 Repair Posted Monday, April 20, 2009 - 11:50 AM by Joe
Start Date:Wednesday April 22 2009 - 11:59 PM
End Date:Thursday, April 23, 2009 - 01:59 AM
Scope:Onenet will perform router maintenance which will cause outages for customers off the following hubsites: Ada, Alva, Durant, Edmond, El Reno, Goodwell, Midwest City, OKCCC, Tonkawa, and Warner.
Reason:Line module in one of our core routers taking errors.

Description: Router line module is taking errors and requires replacement. Replacement will require 15 - 20 minutes, but full maintenance window is reserved.

Miami Hub Posted Wednesday, April 15, 2009 - 10:50 PM by Bobby
Start Date:Wednesday, April 15, 2009 - 10:48 PM
End Date:
Scope:Hub site down due to power issues.
Reason:Miami Power station down according to Miami Police dept.

Description: Site is down due to power loss. No ET at this time.

Maintenance On Cpanle Server Posted Tuesday, April 14, 2009 - 3:18 PM by Jack
Start Date:Tuesday, April 14, 2009 - 6:00 PM
End Date:Tuesday, April 14, 2009 - 8:09 PM
Scope:Upgrading php from 5.2.6 to 5.2.8
Reason:A bug issues with html entities

Description: Rebuilding Apache with php upgrade 5.2.8

Tulsa 3 Hub Posted Friday, April 10, 2009 - 4:35 PM by Todd
Start Date:Friday, April 10, 2009 - 4:33 PM
End Date:Friday, April 10, 2009 - 4:33 PM
Scope:Various T1 customers
Reason:Emergency hardware replacement.

Description: OneNet and ATT replaced hardware on both side of a CT3 to resolve on going issues with select T1 connections.

Goodwell Hub Posted Saturday, April 4, 2009 - 9:40 PM by Joe
Start Date:Saturday, April 4, 2009 - 9:34 PM
End Date:Saturday, April 4, 2009 - 9:34 PM
Scope:An emergency reset of equipment was done to restore connection to Goodwell hub.
Reason:Errors on slot 2 on OKC6 switch required a hardware module reset.

Description: Problem on OneNet equipment caused a outage for Goodwell hub.

OKC14 Hub Posted Friday, March 27, 2009 - 10:06 AM by Todd
Start Date:Friday, March 27, 2009 - 10:04 AM
End Date:Friday, March 27, 2009 - 10:04 AM
Scope:Various T1 customers on this hub.
Reason:Emergency hardware reset.

Description: A hardware reset on a card that supplies connectvity to various T1 connections has been reset to resovle connectivity issues.

Claremore Hub Posted Thursday, March 19, 2009 - 9:57 AM by Todd
Start Date:Thursday, March 19, 2009 - 9:55 AM
End Date:Thursday, March 19, 2009 - 9:55 AM
Scope:All T1 customers
Reason:Power outage to localized area.

Description: A power outage has occured in a localized area on the campus where the CT3 fiber traverses. ETR is 3:00 p.m.

Claremore Hub Posted Thursday, March 19, 2009 - 8:57 AM by Todd
Start Date:Thursday, March 19, 2009 - 8:54 AM
End Date:Thursday, March 19, 2009 - 8:54 AM
Scope:All T1 customers.
Reason:Connectivity outage

Description: The CT3 that the T1 connections ride on is down at this time. The telco has been contacted and they currently checking the circuit. No ETR has been given at this time.

Fiber Maintenance Posted Tuesday, March 10, 2009 - 10:49 AM by Randy
Start Date:Friday March 20, 2009 - 12:01 AM
End Date:Friday March 20, 2009 - 6:00 AM
Scope:Fiber optic cable maintenance near Hallet, OK
Reason:Relocation of cable

Description: Date has changed to Friday March 20, 2009
Telco is performing fiber optic cable maintenance affecting link between Stillwater and Tulsa. Traffic will be protected on ring. No impact to services are expected. Entire window is reserved.

Idabel Hub Outage Posted Friday, March 6, 2009 - 10:13 AM by Randy
Start Date:Friday, March 6, 2009 - 9:50 AM
End Date:
Scope:Customers connected to Idabel Hub
Reason:Fiber Cut

Description: Fiber cable cut. Telco is still attempting to finalize location of cut.
No ETA at this time

Resolved: Web hosting performance issues Posted Wednesday, March 4, 2009 - 9:34 AM by Jack
Start Date:
End Date:Wednesday, March 4, 2009 - 12:00 AM
Scope:OneNet cPanel based web hosting services
Reason:Storage tuning.

Description: OneNet engineers found a storage tuning setting that was slowing performance on the web servers. The base performance problem is fixed. Web servers are very responsive this morning. Any continuing issues should be reported to the OneNet helpdesk.

DNS domain onenet.net expired Posted Wednesday, March 4, 2009 - 9:27 AM by Jack
Start Date:Wednesday, March 4, 2009 - 12:00 AM
End Date:Wednesday, March 4, 2009 - 8:20 AM
Scope:OneNet hosted email and some web services.
Reason:The OneNet DNS domain name registration lapsed this morning.

Description: The domain name is back in place now, but during the above times, there were many issues with email delivery. If you continue to have problems accessing email, please purge your DNS caches. (ipconfig /flushdns on Windows).

Lawton Hub Relocation and Outage Posted Tuesday, March 3, 2009 - 2:05 PM by Randy
Start Date:Tuesday, March 17, 2009 - 9:00 AM
End Date:Tuesday, March 17, 2009 - 5:00 PM
Scope:All customers connected to the Lawton hub router
Reason:Relocation of equipment on campus

Description: OneNet and ATT will be relocating equipment and services to new building on Cameron University campus at Lawton. Outage is expected to last 2 hours but the entire window is reserved.

cPanel MySQL upgrade Posted Monday, March 2, 2009 - 1:14 PM by Jack
Start Date:Monday, March 2, 2009 - 10:00 PM
End Date:Tuesday, March 3, 2009 - 12:00 AM
Scope:All web services utilizing MySQL backends
Reason:MySQL upgrade to version 5

Description: MySQL will be upgraded to version 5. Upgrade should take approximately 10 minutes, but entire window is reserved.

OKC Lightwave Maintenance Posted Wednesday, February 25, 2009 - 11:55 AM by Randy
Start Date:Tuesday, March 10, 2009 - 03:00 AM
End Date:Tuesday, March 10, 2009 - 05:00 AM
Scope:Circuits that transit OKC to Stillwater and OKC to Tulsa
Reason:Replace Failing Card in OKC Core Lightwave

Description: Time has been changed to 0300 hrs to 0500 hrs.
Date has been changed to Tuesday March 10, 2009
Lightwave vendor has requested replacement of standby control card in OKC lightwave equipment. No outage is expected but entire window is reserved.

Ardmore Hub site Posted Sunday, February 22, 2009 - 7:38 PM by Bobby
Start Date:Sunday, February 22, 2009 - 7:35 PM
End Date:
Scope:Power outage to equipment. All customers behind the Ardmore Hub are affected.
Reason:Power outage to the equipment has not yet been resolved. Onenet Techs will be going to the site to investigate. No ET at this time.

Description: Techs will be inroute to the site to investigate the power outage problem.

Ardmore Hub site Posted Sunday, February 22, 2009 - 2:04 PM by Bobby
Start Date:Sunday, February 22, 2009 - 2:01 PM
End Date:
Scope:Customers behind Ardmore hub site dealing with loss of service to power issues.
Reason:Power outage. Power company is investigating the problem...no ET at this time.

Description: Power outage at the site.

OKC Core Outage Posted Friday, February 20, 2009 - 6:46 PM by Randy
Start Date:Friday, February 20, 2009 - 3:23 PM
End Date:Friday, February 20, 2009 - 6:00 PM
Scope:All services connecting OKC to Stillwater, Tulsa. Some services from OKC to Norman were also impacted.
Reason:Lightwave failure

Description: Lightwave carrying services from OKC to Stillwater and OKC to Tulsa were down due to control card failure in lightwave equipment. The card has been replaced and services restored.

Link Maintenance of OBU-Shawnee link Posted Thursday, February 19, 2009 - 1:07 PM by Bobby
Start Date:Monday, February 23, 2009 - 6:00 AM
End Date:Monday, February 23, 2009 - 7:00 AM
Scope:Link Maintenance: Only customer to be affected is OBU-Shawnee.
Reason:Testing the link.

Description: Link maintenance and link testing.

Seminole State College/OBU Posted Friday, February 13, 2009 - 11:40 PM by Von
Start Date:Friday, February 13, 2009 - 11:35 PM
End Date:Friday, February 13, 2009 - 11:35 PM
Scope:Oklahoma Baptist University - Shawnee & Seminole State College
Reason:Equipment issue.

Description: Transport issue on telco equipment caused degradation in circuit throughput. Link has been repaired and issue resolved. OneNet engineers will continue to monitor.

Seminole State College Posted Friday, February 13, 2009 - 9:42 PM by Von
Start Date:Friday, February 13, 2009 - 9:38 PM
End Date:Friday, February 13, 2009 - 9:38 PM
Scope:Seminole State College, Oklahoma Baptist University
Reason:Telco equipment issue

Description: Telco (MBO) is experiencing issues with ethernet interface on the transport equipment. MBO engineer is addressing the problem. No ETA currently. OneNet engineers are monitoring.

Tulsa Community College Posted Friday, February 13, 2009 - 6:38 PM by Von
Start Date:Friday, February 13, 2009 - 6:00 PM
End Date:Friday, February 13, 2009 - 10:00 PM
Scope:All connectivity to Tulsa Community College Campus
Reason:Maintenance upgrades on the TCC campus network

Description: TCC is performing network upgrades on their campus which will cause periodic connectivity disconnect. OneNet is monitoring. Any queries into TCC specific information should be directed to TCC network administration.

circuit maintenace Posted Wednesday, February 11, 2009 - 1:38 PM by Bobby
Start Date:Thursday, February 12, 2009 - 6:00 AM
End Date:Thursday, February 12, 2009 - 7:00 AM
Scope:OneNet will be doing maintenace on one of its OC-12 connections. There should be slight to no impact of service. Expect less than 5 minutes to complete maintenace.
Reason:Maintenace on a OneNet OC-12 connections.

Description: OC-12 connection maintenace.

Maintenace of this OC-12 may cause a slight bump in service. The bump in service should be no more than a minute or two...but the entire window is reserved.

Alva Hub site Posted Wednesday, February 11, 2009 - 7:55 AM by Bobby
Start Date:Wednesday, February 11, 2009 - 7:50 AM
End Date:
Scope:Service to customers behind the Alva Hub site has gone down. Telco's are trouble shooting at this time.
Reason:Circuit is down. Hub site has power and is showing alarm for circuit.

Description: Telco's are trouble shooting the circuit problem. No ET at this time.

Ardmore Posted Sunday, February 8, 2009 - 2:18 PM by Bobby
Start Date:Sunday, February 8, 2009 - 2:15 PM
End Date:
Scope:Power outage in the area.
Reason:Power outage....OG&E had been notified and working on it. No ET at this time

Description: All customers off of the Ardmore hub site are affected by the power outage...OG&E is aware of the situation. No ET at this time.

McAlester Hub Posted Tuesday, February 3, 2009 - 2:26 PM by Todd
Start Date:Tuesday, February 12, 2009 - 10:00 PM
End Date:Tuesday, February 12, 2009 - 10:15 PM
Scope:All Customers on the McAlester Hub.
Reason:Hub maintenance

Description: OneNet will be performing hub maintenance at 10:00 p.m.. The expected outage will be 10 to 15 minutes.

Goodwell Hub Posted Sunday, February 1, 2009 - 7:19 PM by Todd
Start Date:Sunday, February 1, 2009 - 7:16 PM
End Date:Sunday, February 1, 2009 - 7:16 PM
Scope:All customers.
Reason:Power outage

Description: A power outage has been reported in the area. No ETR has been at this time. This outage appears to be affecting large geographic area.

Miami Hub Posted Friday, January 30, 2009 - 5:14 PM by Todd
Start Date:Friday, January 30, 2009 - 5:13 PM
End Date:Friday, January 30, 2009 - 5:13 PM
Scope:All Customers
Reason:Telco related issue

Description: The Telco is looking into the outage for the main connection for this hub. No determination has been made at this time as to the cause of this outage.

OC-12 Maintenace Posted Friday, January 30, 2009 - 1:54 PM by Bobby
Start Date:Wednesday, February 4, 2009 - 11:59 PM
End Date:Thursday, February 5, 2009 - 1:00 AM
Scope:OneNet will be doing maintenace on one of its OC-12 connections.This will entail a slight bump in service for the select customers:DOC-Lindsay Municipal Hospital, DOH Eufaula, DOH Jay, DOC Lexington A&R, OCI/DOC Mack Alford and Dick Conner Correctional Facility, OCI/DOC OSR Correctional Facility, Sac & Fox Nation, OCI/DOC James Crabtree & Mabel Bassett Cor. Facility, Mental Health Services of Southern OK-Sulphur, DOH Guiding Right, OK Dept of VA Ardmore, DOH Harper County Health, Stigler Health and Wellness center, Fairfax Memorial Hospital.
Reason:Maintenace on a OneNet OC-12 connections.

Description: OC-12 connection maintenace.

Maintenace of this OC-12 will cause a slight bump in service. The bump in service should be no more than a minute or two...but the entire window is reserved.

Duncan Hub Posted Tuesday, January 27, 2009 - 7:34 AM by Todd
Start Date:Tuesday, January 27, 2009 - 7:31 AM
End Date:Tuesday, January 27, 2009 - 7:31 AM
Scope:All Customers on this hub.
Reason:Telco issue related to main connection to this hub.

Description: The telco is reporting a weather related power outage. They have staff in route, no ETR is given at this time.

COX SCHEDULED MAINTENANCE Posted Thursday, January 22, 2009 - 1:36 PM by Cheri
Start Date:Thursday, January 29, 2009 - 12:00 AM
End Date:Thursday, January 29, 2009 - 3:00 AM
Scope:OSU Tulsa, Broken Arrow City Hall, Coweta Jr. High, Owaso Public Schools. Northeastern University, Tulsa Community College, Sapulpa Public Schools, Tulsa Compsource, Tulsa University, University of Tulsa, and Oral Roberts University
Reason:Due to a software issue Cox Communications will need to reboot some of the e-520’s on their various rings to prevent them from rebooting unexpectedly on their own. This issue is being addressed in the next software release from their vendor. This maintenance will be performed between 12am to 3am on 01-29-2009 and the majority of the circuits will only be down for approximately 15 mins at a time but the entire window is reserved.

Description: Due to a software issue Cox Communications will need to reboot some of the e-520’s on their various rings to prevent them from rebooting unexpectedly on their own. This issue is being addressed in the next software release from their vendor. This maintenance will be performed between 12am to 3am on 01-29-2009 and the majority of the circuits will only be down for approximately 15 mins at a time but the entire window is reserved.

OSU Tulsa, Broken Arrow City Hall, Coweta Jr. High, Owaso Public Schools. Northeastern University, Tulsa Community College, Sapulpa Public Schools, Tulsa Compsource, Tulsa University, University of Tulsa, and Oral Roberts University

Tulsa3 Hubsite Mintenance Posted Wednesday, January 21, 2009 - 1:59 PM by Joe
Start Date:Saturday, January 24, 2009 - 1100PM
End Date:Saturday, January 24, 2009 - 1200AM
Scope:DPS-Troop B Tulsa, DPS-Broken Arrow, Central Tech-Sapulpa, Tulsa Techology Center, City of Broken Arrow-Police Dept, Central Tech (Drumright), DPS-Jenks, Drumright Regional Hospital, Tulsa Tech Center, Hillcrest Memorial Hospital, Broken Arrow City Hall.
Reason:Maintenance on Tulsa hub equipment.

Description: A short disruption in service will occur, however, we reserve the entire maintenance window (1 Hour).

Tulsa 3 and Claremore hubs Posted Friday, January 9, 2009 - 2:31 PM by Todd
Start Date:Friday, January 9, 2009 - 2:28 PM
End Date:Friday, January 9, 2009 - 2:28 PM
Scope:The following customers are affected, Broken Arrow City Hall, Tulsa Public Schools, Coweta Public Schools, Owasso Public School, Northeastern State Univ, Tulsa Community College, Sapulpa High School, CompSource-Tulsa, University of Tulsa, Union PS, and Oral Roberts University. All customers behind the Claremore Hub.
Reason:Cox Communications hardware failure.

Description: Cox has replaced the switch that failed and connectivity has been restored. All service are stable at this time.

Tulsa 3 and Claremore hubs Posted Friday, January 9, 2009 - 1:59 PM by Todd
Start Date:Friday, January 9, 2009 - 1:48 PM
End Date:Friday, January 9, 2009 - 1:48 PM
Scope:The following customers are affected, Broken Arrow City Hall, Tulsa Public Schools, Coweta Public Schools, Owasso Public School, Northeastern State Univ, Tulsa Community College, Sapulpa High School, CompSource-Tulsa, University of Tulsa, Union PS, and Oral Roberts University. All customers behind the Claremore Hub.
Reason:Cox Communications hardware failure.

Description: Cox Communications has had a switch failure that has resulted in a outage for the above clients. Cox has a technician in route with replacement equipment. No estimated time of repair has been given at this time.

Internet connectivity disruption Posted Thursday, January 8, 2009 - 3:50 PM by Von
Start Date:Thursday, January 8, 2009 - 12:30 AM
End Date:Thursday, January 8, 2009 - 2:00 PM
Scope:Customers accessing DNS, e-mail, VoIP and other services via core OneNet Data Center.
Reason:Core router crash in Data Center.

Description: Router crash in the core prevented customers from accessing services in the OneNet Data Center. Router has been stablized and services restored.

Cpanel and D2L Maintenance Posted Tuesday, December 30, 2008 - 11:31 AM by Frank
Start Date:Tuesday, December 30, 2008 - 9:00 PM
End Date:Tuesday, December 30, 2008 - 11:00 PM
Scope:Customers utilizing Cpanel web hosting and Desire 2 Learn hosting services.
Reason:Cpanel servers move and storage system update.

Description: Cpanel web hosting servers will be relocated to a new rack. We will also be applying an update to the underlying storage system. The expected downtime will be 15 minutes. However the entire window will be reserved, thank you.

Ineternet Latency Posted Wednesday, December 10, 2008 - 1:35 PM by Von
Start Date:Wednesday, December 10, 2008 - 11:30 AM
End Date:Wednesday, December 10, 2008 - 1:00 PM
Scope:Select internet traffic - NTR & I2.
Reason:Core routing issues.

Description: Routing issues within the Tulsa core caused latency and some loss of traffic accessability. Routing has been stablized and traffic flow returned to normal.

OKC13 Hub Posted Friday, November 21, 2008 - 12:21 PM by Todd
Start Date:Friday, November 21, 2008 - 10:00 PM
End Date:Friday, November 21, 2008 - 10:15 PM
Scope:Select Ethernet and FastEthernet customers off the OKC 13 hub. The following will be affected as well as various metro schools, JD McCarty, FAA, Metro Area VoTech, Metropolitan Library System, Oklahoma Christian University, Francis Tuttle Vo-Tech, City of Edmond, OK County Annex, Veterans Affairs, Oklahoma Housing Finance Agency, Mid-Del Vo-Tech, Integris Tele-Health Network, Oklahoma City-County Health Department, Moore Public Library, DOT-Shepherd Mall, Canadian Valley Tech Center, Cleveland County, Mid America Bible College, Moore Norman Vo-Tech, Norman Public Library, Veterans Center, Oklahoma Tax Commission
Reason:Potential connectivity issue found.

Description: OneNet will be working with the Telco to resolved a potential issue with the main connection that these customers ride on. The expected down time is less that five minutes but the entire window will be reserved.

BGP troubleshooting - OU Posted Friday, November 14, 2008 - 4:55 PM by Von
Start Date:Sunday, November 16, 2008 - 6:00 AM
End Date:Sunday, November 16, 2008 - 7:00 AM
Scope:OU - Norman campus
Reason:Troubleshoot potential routing issues.

Description: Troubleshooting will be performed in attempt to isolate potential BGP routing between OneNet/OU peering. No loss of connectivity is expected, but latency to/from campus may be experienced.

Woodward Hub Posted Friday, November 14, 2008 - 11:49 AM by Bobby
Start Date:Friday, November 17, 2008 - 6:00 AM
End Date:Friday, November 17, 2008 - 7:30 AM
Scope:All customers off of the Woodward Hub site.
Reason:Errors are coming from the Woodward side. Telco and OneNet will be testing to find the issue and restore link to prior state.

Description: Description: All customers off of the Woodward Hub site will experience a short interruption of service due to circuit testing. This is to eliminate errors that are coming from the Hub site (Z-end) direction. This should only take a few minutes but the entire window is reserved.

Woodward Hub Posted Wednesday, November 12, 2008 - 3:43 PM by Bobby
Start Date:Thursday, November 13, 2008 - 6:00AM
End Date:Thursday, November 13, 2008 - 7:00AM
Scope:All customers off of the Woodward Hub site.
Reason:Hub site is taking errors from Telco equipment.

Description: All customers off of the Woodward Hub site will experience a short interruption of service due to circuit reroute. This is to eliminate errors that are coming from the Telco side. This should only take a few minutes but the entire window is reserved.

Claremore Hub Reload Posted Thursday, October 23, 2008 - 1:27 PM by Joe
Start Date:Thursday, October 23, 2008 - 1:23 PM
End Date:Thursday, October 23, 2008 - 1:23 PM
Scope:An emergency reload of the router at the Claremore is required to resolve hardware issues.
Reason:Equipment faults.

Description: At approx 130PM a hardware reset at the Claremore hub was done to resolve problems.

UPDATE: Indian Nations Fiber Optics, Inc. Re-Scheduled Maintenance Posted Thursday, October 23, 2008 - 9:20 AM by Cheri
Start Date:Friday, October 31, 2008 -12:01 AM
End Date:Friday, October 31, 2008 -6:00 AM
Scope:All persons off the following OneNet Hubsites:Sayre, Ada, Duncan, Alva, Woodward, Tishomingo, Tonkawa, Pauls Valley and Purcell.
Reason:Work originally scheduled for tonight has been moved to Friday October 31st.

Description: Indian Nations Fiber Optics, Inc. will be relocating fiber for a road project in the City of Norman.

All persons off the following OneNet Hubsites:
Sayre, Ada, Duncan, Alva, Woodward, Tishomingo, Tonkawa, Pauls Valley and Purcell.

Persons on these hub sites should not feel any outages but need to be aware of the the work being done and that the entire window is reserved.

Date correction for All OSF Services Posted Thursday, October 16, 2008 - 7:11 AM by Cheri
Start Date:Saturday October 18, 2008 - 1:00 PM
End Date:Saturday October 18, 2008 - 5:00 PM
Scope:
Reason:

Description: All customers off the OSF network will be without services during this maintenance window while they perform quarterly maintenance. This will include all OSF supported email, PeopleSoft systems, Internet connections, VPNs, Budget Request, etc.

All OSF Services Posted Thursday, October 16, 2008 - 7:02 AM by Cheri
Start Date:Saturday October 18, 2008 - 1:00 PM
End Date:Saturday, October 18, 2008 - 5:00 PM
Scope:All customers off the OSF network will be affected.
Reason:Quarterly Maintenance

Description: All customers off the OSF network will be without services during this maintenance window while they perform quarterly maintenance. This will include all OSF supported email, PeopleSoft systems, Internet connections, VPNs, Budget Request, etc.

Seminole Hub Posted Wednesday, October 15, 2008 - 10:37 AM by Todd
Start Date:Wednesday, October 15, 2008 - 10:18 AM
End Date:Wednesday, October 15, 2008 - 10:18 AM
Scope:All Customers
Reason:Connectivity to hub site.

Description: There was a temporary outage on the main connection to the Seminole hub. This was a telco related issue. Connectivity is stable at this time.

Posted Tuesday, October 14, 2008 - 2:32 PM by Joe
Start Date:Tuesday, October 14, 2008 - 2:26 PM
End Date:Tuesday, October 14, 2008 - 2:26 PM
Scope:Service has been restored to customers off Bartlesville hubsite.
Reason:Power issues have been corrected that caused outage.

Description: At approx 0130 AM service was interrupted for customers off Bartlesville hub. Initially local power company had outages that cause TELCO equipment at hubsite to go down. After power came back hubsite electrical issues needed to be fixed before service could be restored.

Bartlesville Hubsite Posted Tuesday, October 14, 2008 - 8:07 AM by Joe
Start Date:Tuesday, October 14, 2008 - 8:02 AM
End Date:Tuesday, October 14, 2008 - 8:02 AM
Scope:Bartlesville hubsite and all customers of hubsite lost connectivity at approx 130AM.
Reason:Power outage

Description: Power outage interupted service from Barltesville hubsite. Currently partial power restored, however, circuits and service remain down. No ETA.

Indian Nations Fiber Optics, Inc. Scheduled Maintenance Posted Friday, October 10, 2008 - 8:22 AM by Cheri
Start Date:Friday, October 24, 2008 - 12:01 AM
End Date:Friday, October 24, 2008 - 6:00 AM
Scope:All persons off the following Onenet Hub sites:Sayre, Ada, Duncan, Alva, Woodward, Tishomingo, Tonkawa, Pauls Valley and Purcell.Persons on these hubsites should not feel any outages but need to be aware of the the work being done.
Reason:Indian Nations Fiber Optics, Inc. will be relocating fiber for a road project in the City of Norman.

Description: Indian Nations Fiber Optics, Inc. will be relocating fiber for a road project in the City of Norman.

All persons off the following OneNet Hubsites:
Sayre, Ada, Duncan, Alva, Woodward, Tishomingo, Tonkawa, Pauls Valley and Purcell.

Persons on these hub sites should not feel any outages but need to be aware of the the work being done and that the entire window is reserved.

National Lambda Rail 10Gig connection update Posted Thursday, October 9, 2008 - 5:07 PM by Von
Start Date:Thursday, October 9, 2008 - 5:03 PM
End Date:Thursday, October 9, 2008 - 5:03 PM
Scope:Connection to NLR via 10Gig link and NTR-Chicago CPS services.
Reason:NLR equipment issues upstream.

Description: Upstream provider has corrected all issues and service is fully restored and stable. OneNet will continue to monitor.

Altus Hub Posted Thursday, October 9, 2008 - 2:06 PM by Todd
Start Date:Thursday, October 9, 2008 - 2:15 PM
End Date:Thursday, October 9, 2008 - 2:20PM
Scope:All customers
Reason:Telco making repairs.

Description: The Telco will be doing and emergency move of the Altus hub connection to new path in order resolve on going connectivity issue with the existing connection. Expected down time is 2 to 5 minutes.

National Lambda Rail 10Gig connection down Posted Thursday, October 9, 2008 - 1:25 PM by Von
Start Date:Thursday, October 9, 2008 - 1:16 PM
End Date:Thursday, October 9, 2008 - 1:16 PM
Scope:Connection to NLR via 10Gig link and NTR-Chicago CPS services. This does NOT include NLR 1Gig or I2 services.
Reason:NLR equipment issues upstream.

Description: Internet services across the primary 10Gig NLR connection as well as NTR-Chicago is currently down. This loss of service could create latency for some internet sites. NLR engineers are currently addressing the issues, but no ETA is currently known. OneNet will continue to monitor and update once further information is known.

Altus Hub Posted Tuesday, October 7, 2008 - 1:44 PM by Todd
Start Date:Tuesday, October 7, 2008 - 1:35 PM
End Date:Tuesday, October 7, 2008 - 1:35 PM
Scope:All customers on Altus hub
Reason:Intermittent connectivity issues

Description: The Telco is testing the main connection to the Altus hub. Intermittent connectivity issues warranted emergency testing of the circuit in effort to isolate the trouble. As information becomes available an update will be sent.

Hub Outage Posted Saturday, October 4, 2008 - 11:26 AM by Randy
Start Date:Saturday, October 4, 2008 - 9:00 AM
End Date:Saturday, October 4, 2008 - 11:00 AM
Scope:Customers behind OSU-OKC, ElReno, OKCCC and MWC hub routers
Reason:UPS Maintenance

Description: UPS maintenance caused power failure to telco equipment without redundant power input causing intermittent outages to listed hub sites.
Maintenance has been completed.

Ineternet outage Posted Friday, October 3, 2008 - 3:12 PM by Von
Start Date:Friday, October 3, 2008 - 10:30 AM
End Date:Friday, October 3, 2008 - 11:30 AM
Scope:All internet traffic.
Reason:Routing failure within core network.

Description: A routing failure within the core network caused a loss of internet access for all customers. The routing issue has been identified and corrected. All network traffic is stable at this time with no other known issues. OneNet's support staff will continue to monitor and update if other issues arise.

McAlester Hub Outage Posted Monday, September 22, 2008 - 4:18 PM by Randy
Start Date:Monday, September 22, 2008 - 3:26 PM
End Date:Monday, September 22, 2008 - 4:15 PM
Scope:All customers connected to McAlester Hub
Reason:Hardware failure

Description: Hardware error required reboot of router. A TAC case has been opened for problem resolution with Cisco.

Rogers State College(Claremore) Posted Monday, September 22, 2008 - 2:15 PM by Sam
Start Date:Tuesday, September 23, 2008 - 6:00 AM
End Date:Tuesday, September 23, 2008 - 8:00 AM
Scope:Customers on ATT CT3
Reason:Building remodel

Description: Power will need to be rerouted for remodel. This should take less than an hour, but entire window is reserved

Email outage Posted Thursday, September 18, 2008 - 3:25 PM by Brian
Start Date:Thursday, September 18, 2008 - 2:40 PM
End Date:Thursday, September 18, 2008 - 3:05 PM
Scope:All OneNet hosted email
Reason:Directory(LDAP) server failure.

Description: OneNet hosted email was down due to a directory server failure. All services are fully functional at this time.

OKC5 Core Router Posted Monday, September 15, 2008 - 4:57 PM by Todd
Start Date:Wednesday, September 17, 2008 - 10:00 PM
End Date:Wednesday, September 17, 2008 - 10:20 PM
Scope:The following hubs will be impacted; Woodward, Weatherford, Wilburton, and Duncan hubs.
Reason:Hardware replacement.

Description: OneNet will be performing a hardware replacement of a defective card to resolve recent connectivity issues associated with the above mention hubs. The expected down time is 10 minutes, however, the entire window will be reserved.

OKC Core Router Posted Sunday, September 14, 2008 - 12:59 PM by Todd
Start Date:Sunday, September 14, 2008 - 12:52 PM
End Date:Sunday, September 14, 2008 - 12:52 PM
Scope:Weatherford, Wilburton, Woodward, and Duncan hubs.
Reason:Emergency hardware reset.

Description: Emergency hardware reset of card in core router was performed in an effort to resolve connectivity issues for the above mentioned hubs. OneNet will monitor the situation. All connections are stable at this time.

Altus Hub Posted Wednesday, September 3, 2008 - 2:28 PM by Todd
Start Date:Wednesday, September 3, 2008 - 2:24 PM
End Date:Wednesday, September 3, 2008 - 2:24 PM
Scope:All customers on the Altus hub.
Reason:Intermittent connectivity

Description: The main connection to the Altus hub has been experiencing intermittent connectivity issues. The Telco has replaced a card on the main circuit for this hub and connectivity is stable at this time.

Posted Tuesday, August 26, 2008 - 11:30 AM by Joe
Start Date:Tuesday, August 26, 2008 - 11:23 AM
End Date:Tuesday, August 26, 2008 - 11:23 AM
Scope:The following customers have lost internet connection off the Tishomingo hubsite due to a fiber cut: Madill Public Schools, Madill Public Schools-Baptist School for Girls, DOH-TISHIMINGO,DOH-MADILL, Integris-Marshall hospital, OK Biological Station-Kingston, Madill Elementary School, ARNG-Madill.
Reason:Fiber cut no ETA

Description: Internet service to 8 customers is down due to a fiber cut.

Network Outage Posted Wednesday, August 20, 2008 - 6:02 PM by Joe
Start Date:Wednesday, August 20, 2008 - 5:51 PM
End Date:Wednesday, August 20, 2008 - 5:51 PM
Scope:Customers off Woodward, Duncan, and Wilburton hubsites lost network connectivity at approx 515 PM.
Reason:Hardware module failure at OKC5 facilty caused outage.

Description: Woodward, Duncan, and Wilburton hubsites and customers off those hubsites lost network connectivity for approx 15 minutes.

Altus Hub Posted Sunday, August 17, 2008 - 3:00 PM by Todd
Start Date:Sunday, August 17, 2008 - 2:59 PM
End Date:Sunday, August 17, 2008 - 2:59 PM
Scope:All customers on the Altus hub.
Reason:Localized power outage.

Description: A localized power outage has been reported in the Altus hub site area. No ETR has been given at this time.

Tahlequah Hub Posted Saturday, August 16, 2008 - 9:48 PM by Todd
Start Date:Saturday, August 16, 2008 - 9:46 PM
End Date:Saturday, August 16, 2008 - 9:46 PM
Scope:All customers on the Tahleqauh Hub.
Reason:Emergency Hardware reset.

Description: An emergency Hardware reset was performed to resolve a connectivity issue for the connections that supply this hub.

Warner & Muskogee Hub site DS3 connections Posted Sunday, August 10, 2008 - 1:14 AM by Bobby
Start Date:Sunday, August 10, 2008 - 1:09 AM
End Date:
Scope:Warner & one of the Muskogee Hub site DS3's are down. No ET at this time.
Reason:Telco is checking out the loss of signal for 2 DS3's off of the Warner Hub site.

Description: Both DS3's are on the Warner Hub site. I have verified power and spoke to the emergency contact at Warner's site. Telco is checking out the DS3's.

Tahlequah, Woodward, El Reno, and OKCCC hub sites. Posted Monday, August 4, 2008 - 10:12 AM by Todd
Start Date:Monday, August 8, 2008 - 10:00 PM
End Date:Monday, August 8, 2008 - 11:30 PM
Scope:All customers on these hubs.
Reason:Software Upgrade.

Description: A software upgrade will be performed on these hubs as part of maintenance. The hub sites will be upgraded in succession beginning with Tahlequah, Woodward, El Reno, and the OKCCC hub following. The expected downtime will be 10 to 15 minutes per hub. However the entire window will be reserved, thank you.

Miami and Altus Hub sites Posted Monday, August 4, 2008 - 9:43 AM by Todd
Start Date:Monday, August 6, 2008 - 10:00 PM
End Date:Monday, August 6, 2008 - 11:00 PM
Scope:All customers on the Miami and Altus hub sites.
Reason:Software Upgrade.

Description: A software upgrade will be performed on these hubs as part of maintenance. The hub sites will be upgraded in succession beginning with Miami with the Altus hub following. The expected downtime will be 10 to 15 minutes per hub. However the entire window will be reserved, thank you.

Goodwell Hub Outage UPDATE Posted Sunday, August 3, 2008 - 1:50 PM by Randy
Start Date:Sunday, August 3, 2008 - 1:48 PM
End Date:
Scope:All customer behind Goodwell Hub
Reason:Fiber Cut

Description: Pioneer Telecom reports fiber cut east of Gage OK. Crews in route. NO ETA on repair.

Goodwell Hub site Posted Sunday, August 3, 2008 - 1:29 PM by Bobby
Start Date:Sunday, August 3, 2008 - 1:27 PM
End Date:
Scope:All customers behind the Goodwell hub site
Reason:Pioneer Telco reporting trouble but unable to locate it at this time.

Description: Pioneer is working to locate the trouble with the DS3 at this time. No ET has been given.

Emergency Router Maintenance - Tulsa Core Posted Tuesday, July 29, 2008 - 1:27 PM by Von
Start Date:Tuesday, July 29, 2008 - 11:00 PM
End Date:Tuesday, July 29, 2008 - 11:30 PM
Scope:Tulsa Core2 router : All Tulsa Metro customers - including but not limited to University of Tulsa, Oral Roberts University, OU - Schusterman Campus, TCC, NSU Broken Arrow, Arkansas State University, Tulsa PS, Tulsa City/County Libray, DOH's Tulsa/Sapulpa/Bixby, etc.
Reason:Router hardware failure.

Description: Router hadware failure requires line card replacement to correct stability issue.

Pioneer Maintenance Window- UPDATE Posted Monday, July 28, 2008 - 1:50 PM by Randy
Start Date:Wednesday, August 6, 2008 -12:01 AM
End Date:Wednesday, August 6, 2008 - 3:30 AM
Scope:Hubsites affected has been changed to include Woodward, Alva, Goodwell, Tonkawa and Enid
Reason:Fiber Maintenance

Description: Pioneer Telephone will be moving fiber connections affecting hub link circuit connectivity. Outage is expected to last 5 minutes but entire window is reserved.

Core Router Maintenance Posted Sunday, July 27, 2008 - 11:58 PM by Von
Start Date:Thursday, July 31, 2008 - 11:00 PM
End Date:Thursday, July 31, 2008 - 11:30 PM
Scope:OneNet core router, CoreCat1 & OneNethub-Seminole.
Reason:Hardware/Software upgrade.

Description: Hardware/Software upgrade required for core router maintenance. No traffic disruption is expected, with exception of OneNethub-Seminole which is direct connect to CoreCat1. Expected reload is 10-15 minutes, but full maintenance window is reserved.

Pioneer Maintenance Window Posted Tuesday, July 22, 2008 - 10:01 AM by Randy
Start Date:Wednesday, August 6, 2008 12:01 AM
End Date:Wednesday, August 6, 2008 3:30 AM
Scope:Customers connected to Woodward, Alva and Tonkawa hubsites
Reason:Pioneer fiber optic maintenance

Description: Pioneer Telephone will be moving circuits to new fiber path causing outage on each Hub link circuit. This maintenance will cause outage on each circuit of approximately 5 minutes but entire window is reserved.

Hosted VOIP Posted Thursday, July 17, 2008 - 12:46 PM by Joe
Start Date:Thursday, July 17, 2008 - 12:28 PM
End Date:Thursday, July 17, 2008 - 12:28 PM
Scope:All Hosted VOIP Customers.
Reason:Power failure to hosted VOIP equipment.

Description: Customers experienced an outage of voip/data sevices. Troubleshooting resulted in discovery of a hardware power failure. Power restored to the equipment and all hosted VOIP & data services were restored.

Duncan Hub Posted Tuesday, July 15, 2008 - 3:59 PM by Todd
Start Date:Thursday, July 17, 2008 - 10:00 PM
End Date:Thursday, July 17, 2008 - 10:25 PM
Scope:All customers on the Duncan hub.
Reason:Software upgrade.

Description: OneNet will be performing a software upgrade on this hub. The expected down time is around 10 minutes. However, the entire window will be reserved.

Tishomingo Hub Posted Monday, July 14, 2008 - 3:45 PM by Todd
Start Date:Monday, July 14, 2008 - 3:43 PM
End Date:Monday, July 14, 2008 - 3:43 PM
Scope:All T1 customers
Reason:Telco issue found.

Description: Per AT&T they have a 200 pair cable cut. AT&T is working to resovle the issue. No ETR has been given at this time.

Tishomingo Hub Posted Monday, July 14, 2008 - 2:30 PM by Todd
Start Date:Monday, July 14, 2008 - 2:26 PM
End Date:Monday, July 14, 2008 - 2:26 PM
Scope:All T1 customers.
Reason:Possible hardware failure.

Description: OneNet suspects a possible hardware failure on hub site equipment that supplies connectivity to T1 connections. A technician will be in route soon with replacement hardware. No ETR at this time.

MWC Hub Posted Saturday, July 12, 2008 - 5:04 PM by Joe
Start Date:Saturday, July 12, 2008 - 4:58 PM
End Date:Saturday, July 12, 2008 - 4:58 PM
Scope:MWC hubsite down for approx 1 hour.
Reason:Security reported phones went down at same time-security personnel was not aware of power problem. Called IT on-call person and she stated she is checking into issue to determine outage cause.

Description: MWC hubsite went down at 03:54 PM-returned at 04:47 PM.

El Reno Hub Site date correction Posted Friday, July 11, 2008 - 2:38 PM by Todd
Start Date:Monday, July 14, 2008 - 10:00 PM
End Date:Monday, July 14, 2008 - 10:20 PM
Scope:All customers on the ElReno hub
Reason:Software upgrade

Description: OneNet will be performing a software upgrade on this hub. The expected down time is around 10 minutes. However, the entire window will be reserved.

El Reno Hub Site Posted Friday, July 11, 2008 - 2:15 PM by Todd
Start Date:Monday, July 14, 2008 - 10:00 PM
End Date:Monday, July 14, 2008 - 10:20 PM
Scope:All customers on the ElReno hub.
Reason:Software upgrade.

Description: OneNet will be performing a software upgrade on this hub. The expected down time is around 10 minutes. However, the entire window will be reserved.

OKC - Stillwater Upgrade Posted Thursday, July 10, 2008 - 11:00 AM by Randy
Start Date:Thursday, July 17, 2008 - 12:01 AM
End Date:Thursday, July 17, 2008 - 6:00 AM
Scope:OKC to Stillwater traffic path
Reason:Hardware Upgrade

Description: Transport System will be upgraded during maintenance window affecting bandwidth from OKC to Stillwater. Bandwidth will be reduced during maintenance window but no outage is expected. Switch hits <50 ms may occur as traffic reroutes.

DNS server update Posted Wednesday, July 9, 2008 - 4:15 PM by Brian
Start Date:Wednesday, July 9, 2008 - 10:00 PM
End Date:Wednesday, July 9, 2008 - 11:00 PM
Scope:OneNet DNS services
Reason:Security updates

Description: The OneNet DNS servers will be down one at a time this evening to apply security updates. DNS resolution may be slow during this time, but should continue to be available.

Norman Upgrade Posted Tuesday, July 8, 2008 - 8:04 AM by Randy
Start Date:Wednesday, July 9, 2008 - 12:01 AM
End Date:Wednesday, July 9, 2008 - 6:00 AM
Scope:Customers connected to Norman Hub
Reason:Hardware Upgrade

Description: Transport System hardware upgrade. Bandwidth will be reduced during the maintenance window. No outage is expected.

Sayre Hub site Posted Tuesday, July 8, 2008 - 7:54 AM by Bobby
Start Date:Tuesday, July 8, 2008 - 7:50 AM
End Date:Tuesday, July 8, 2008 - 7:50 AM
Scope:Power outage. The cause of last nights outage was power at the site.
Reason:The Battery UPS system failed and resulted in loss of service.

Description: Yesterday evening the site lost power to the equipment and the UPS backup failed....causing loss of service. The equipment is back up and service has been restored. The UPS backup is going to be replace.

Sayre Hub site Posted Monday, July 7, 2008 - 10:55 PM by Bobby
Start Date:Monday, July 7, 2008 - 10:52 PM
End Date:
Scope:Loss of service from site. Affecting customers behind the Sayre Hub site.
Reason:Loss of connectivity. No ETA at this time for restoration of service.

Description: Loss of Connectivity from the Sayer Hub site.

Stillwater Hub Posted Monday, July 7, 2008 - 9:05 AM by Bobby
Start Date:Monday, July 7, 2008 - 8:44 AM
End Date:
Scope:Customers behind the Stillwater Hub affected by Hardware Failure:Stillwater Medical CenterMorrison Public School DOH-STILLWATER DOE-Stillwater Public Schools-CV OESC-Stillwater Office of Juvenile Affairs(Dist C Office)OSU Foundation Iowa Tribe of Oklahoma Perkins-Tryon High School Perkins-Tryon Public Schools Glencoe Public School Morrison Public School DOT-OSU Design Squad ARNG-Chandler OK Military DOH-CHANDLER DOH-Perry DPS-Troop K Pawnee
Reason:Hardware Failure: Hardward replacement in route no ETA.

Description: Hardward Failure causing loss of service to customers off the Stillwater Hub site.

Ardmore Hub site Posted Tuesday, July 1, 2008 - 7:45 AM by Bobby
Start Date:Tuesday, July 1, 2008 - 7:42 AM
End Date:
Scope:All customers behind the Ardmore Hub. Power outage at the site.
Reason:Loss of connection is due to power outage at the site itself.

Description: OG&E have been called from the site management. No ET on power at this time.

Ardmore Outage Posted Tuesday, July 1, 2008 - 7:06 AM by Randy
Start Date:Tuesday, July 1, 2008 - 5:30 AM
End Date:
Scope:Customers connected to Ardmore Hub and Higher Ed Center
Reason:Power Outage

Description: Power failed at Higher Ed Center at 3:53 AM and UPS held hub up till 5:30 AM. Utility has been notified and they are working to restore service.

Norman Upgrade Posted Friday, June 27, 2008 - 9:29 AM by Randy
Start Date:Sunday, June 29, 2008 - 3:00 PM
End Date:Sunday, June 29, 2008 - 9:00 PM
Scope:Customers connected to Norman hub
Reason:Hardware Upgrade

Description: The transport system providing service to Norman hub will be upgraded causing reduction of available bandwidth during the maintenance window.
No outage is expected.

Claremore Hub Posted Thursday, June 26, 2008 - 10:40 AM by Todd
Start Date:Thursday, June 26, 2008 - 10:30 AM
End Date:Thursday, June 26, 2008 - 10:30 AM
Scope:All T1 customers
Reason:Emergency reset of card.

Description: An emergency reload of the card on which T1 customers ride was required to resolve a potentially service affecting issue. Connectvity has been restored at this time.

Tishomingo Hub Site Router Posted Sunday, June 22, 2008 - 10:37 PM by Bobby
Start Date:Sunday, June 22, 2008 - 10:34 PM
End Date:
Scope:Tishomingo Hub site and all customers off this hub router
Reason:wide spread power outage in the area.

Description: Power outage has been verified and there is no ET at this time.

OKC 14 Hub Maintenance Posted Friday, June 20, 2008 - 12:38 PM by Todd
Start Date:Monday, June 30, 2008 - 11:00 PM
End Date:Monday, June 30, 2008 - 11:15 PM
Scope:All Customers on the OKC14 hub. This will affect Oklahoma State Office of Finance, Oklahoma Dept. of Transportation, Oklahoma Dept. of Education, Army National Guard and other various circuits.
Reason:Router Maintenance

Description: OneNet will be performing a reboot as part of router maintenance on this 11:00 p.m. to 11:15 p.m.

Posted Thursday, June 19, 2008 - 4:03 AM by Bobby
Start Date:Thursday, June 19, 2008 - 4:01 AM
End Date:
Scope:Altus Hub site and all customers behind it.
Reason:Power outage area wide.

Description: Power outage has been verified in the area and no ET at this time.

Claremore Posted Monday, June 16, 2008 - 1:41 AM by Bobby
Start Date:Monday, June 16, 2008 - 1:34 AM
End Date:
Scope:Claremore Hub and all customers behind it.
Reason:Power outage: Loss of power in the area.

Description: Power outage has been verified....no ETA at this time.

Altus Hubiste Down Posted Saturday, June 14, 2008 - 10:28 PM by Joe
Start Date:Saturday, June 14, 2008 - 10:07 PM
End Date:Saturday, June 14, 2008 - 10:07 PM
Scope:Altus hubsite is down due to a power outage no ETA.
Reason:Weather in the Altus area caused a widespread power outage.

Description:

Scheduled Maintenance on the Enid Hub Site Posted Thursday, June 12, 2008 - 11:20 AM by Cheri
Start Date:Wednesday, June 18, 2008 - 2:00 AM
End Date:Wednesday, June 18, 2008 - 6:00 AM
Scope:All customers off the Enid Hub Site
Reason:Pioneer will be performing some equipment changes. Pioneer would like the maintenance window to be on June 18th beginning around 2 AM – 6 AM. Total down time for Enid services should be less than 15 minutes.

Description: All customers off the Enid Hub Site:

Pioneer will be performing some equipment changes. Pioneer would like the maintenance window to be on June 18th beginning around 2 AM – 6 AM. Total down time for Enid services should be less than 15 minutes.

NLR/I2 outage Posted Wednesday, June 11, 2008 - 2:01 PM by Von
Start Date:Wednesday, June 11, 2008 - 11:39 AM
End Date:Wednesday, June 11, 2008 - 11:45 AM
Scope:All traffic directed to NLR & I2.
Reason:Failed GPN router.

Description: Failed GPN router has caused outages for both NLR and I2 traffic. All NLR traffic has returned to normal, but I2 traffic remains off line. GPN engineers in Kansas City are working on the issue. No ETA at the moment.

Altus Hub Outage Posted Friday, June 6, 2008 - 8:02 AM by Randy
Start Date:Thursday, June 5, 2008 - 7:30 PM
End Date:Friday, June 6, 2008
Scope:All customers behind Altus router
Reason:City wide power outage

Description: Electric power to the City of Altus has been disrupted due to storms in area overnight. Crews are working to restore service to City. ETA is late afternoon Friday.

Stillwater Hub Maintenance Posted Thursday, June 5, 2008 - 2:12 PM by Randy
Start Date:Tuesday, June 10, 2008 - 10:00 PM
End Date:Tuesday, June 10, 2008 - 11:00 PM
Scope:All customers behind Stillwater router
Reason:Hardware upgrade

Description: Router will have new hardware installed and will require reboot. Downtime is expected to be 15 minutes but entire window is reserved.

Claremore Hub Posted Thursday, June 5, 2008 - 1:32 PM by Todd
Start Date:Thursday, June 5, 2008 - 1:20 PM
End Date:Thursday, June 5, 2008 - 1:20 PM
Scope:T1 customers
Reason:Intermittent outages.

Description: T1 customers that ride on a CT3 have been experiencing intermittent outages yesterday and today. Connectivity at this time appears to stable. OneNet technician's will be performing further investigation tomorrow.

Internal OneNet datacenter issue Posted Friday, May 30, 2008 - 12:52 PM by Todd
Start Date:Friday, May 30, 2008 - 12:45 PM
End Date:Friday, May 30, 2008 - 12:45 PM
Scope:All OneNet Customers
Reason:Internal OneNet switching error.

Description: Internal OneNet switching error caused temporary outage to DNS and email services. This has been resolved and no further outages are expected.

National LambdaRail Posted Friday, May 30, 2008 - 12:15 AM by Von
Start Date:Friday, May 30, 2008 - 12:03 AM
End Date:Friday, May 30, 2008 - 12:03 AM
Scope:NLR 10Gig Packetnet, I2 and I2 CPS as well as NTR Chicago CPS.
Reason:Failed linecard in National LambdaRail router(Tulsa).

Description: Failed linecard in National LambdaRail router(Tulsa). NLR Engineers are working with Cisco to address issue.

Redundant paths continue to handle traffic with NLR traffic overflows on 1Gig NLR backup and NTR on LA link. I2 traffic is completely down until repairs are completed.

No ETA at the moment. OneNet engineers will continue to monitor and update once additional information is known.

Tonkawa Hub Posted Thursday, May 29, 2008 - 8:47 AM by Joe
Start Date:Thursday, May 29, 2008 - 8:42 AM
End Date:Thursday, May 29, 2008 - 8:42 AM
Scope:All customers on the Tonkawa Hub.
Reason:Equipment a Tonkawa Husite is periodically boucning/resetting resulting in service interruptions.

Description: OneNet technicians are replacing equipment at the site to resolve service interruptions.

Tonkawa Hub Posted Wednesday, May 28, 2008 - 2:17 PM by Todd
Start Date:Wednesday, May 28, 2008 - 4:30 PM
End Date:Wednesday, May 28, 2008 - 5::00 PM
Scope:All customers on the Tonkawa Hub.
Reason:Main connection to hub taking errors and bouncing periodically resulting in intermittent connectivity issues.

Description: The telco will be doing emergency testing on the main connection to the Tonkawa hub in an effort to isolate trouble associated with intermittent outages.

Ada T1 customers Posted Wednesday, May 28, 2008 - 8:42 AM by Sam
Start Date:Thursday, May 29, 2008 - 5:30 PM
End Date:Thursday, May 29, 2008 - 6:00 PM
Scope:T1 customers behind Ada hub router
Reason:ATT hardware upgrade

Description: ATT upgrading from OC-3 to OC-12 for new DS3IP

McAlester and Muskogee Hubsites Posted Saturday, May 24, 2008 - 9:26 AM by Joe
Start Date:Saturday, May 24, 2008 - 9:21 AM
End Date:Saturday, May 24, 2008 - 9:21 AM
Scope:
Reason:

Description: Interuption of service for customers off McAlester and Muskogee hubsites is resolved. A reset of of OneNet equipment cleared up issues.

Router Maintenance - Tulsa Hub Posted Thursday, May 22, 2008 - 4:40 PM by Von
Start Date:Friday, May 30, 2008 - 11:00 PM
End Date:Friday, May 30, 2008 - 11:59 PM
Scope:Connection to Internet2, National Lambda Rail and all associated services(NTR,I2 CPS) as well as direct connection to University of Arkansas and Tulsa core router(TulsaCore1).
Reason:Network Maintenance - Router upgrade.

Description: Router maintenance is required to upgrade core device hardware and IOS. Maintenance should require 15 to 20 minutes for complete router reload, but the full maintenance window is reserved.

Wilburton Hub Posted Thursday, May 22, 2008 - 10:37 AM by Todd
Start Date:Thursday, May 22, 2008 - 10:34 AM
End Date:Thursday, May 22, 2008 - 10:34 AM
Scope:All customers on the Wilburton Hub.
Reason:Telco outage

Description: The Telco has reported that they have had a fiber shelf failure that is affecting the main connection to the Wilburton hub. No ETR has been given at this time. As information becomes available, updates will be posted.

OKC 5 Core router hardware replacement Posted Monday, May 19, 2008 - 9:34 AM by Todd
Start Date:Monday, May 27, 2008 - 10:00 PM
End Date:Monday, May 27, 2008 - 10:30 PM
Scope:OneNet hubs Weatherford, Sayre, Chickasha, Duncan, Okmulgee, Idabel, Seminole, Woodward, Wilburton, McAlester, and Muskogee.
Reason:Hardware replacement in the OKC5 core router.

Description: OneNet will be replace a flexwan card in the OKC 5 core router. This will require a reboot of this router. The expected outage is 10 minutes, the entire window may be reserved.

Sayre Hub Outage UPDATE Posted Friday, May 16, 2008 - 9:24 AM by Randy
Start Date:Friday, May 16, 2008 - 9:00 AM
End Date:
Scope:All Customers behind Sayre Router
Reason:Fiber Cut affecting Link Circuit

Description: The telco's fiber had been cut and they are working to restore service. NO ET at this time.

Sayre Hyb Outage Posted Friday, May 16, 2008 - 9:15 AM by Randy
Start Date:Friday, May 16, 2008 - 9:00 AM
End Date:
Scope:All customers behind Sayre router
Reason:Link failure

Description: Link circuit has failed. Telco is working to restore service. No ET on repair at this time.

Ada T1 move Posted Wednesday, May 14, 2008 - 2:15 PM by Sam
Start Date:Wednesday, May 14, 2008 - 2:13 PM
End Date:Wednesday, May 14, 2008 - 2:13 PM
Scope:Ada ATT T1 customers
Reason:T1 move cancelled

Description: Work on upgrading to OC-12 at Ada has been canceled for today.

Ada T1 customers Posted Tuesday, May 13, 2008 - 2:13 PM by Sam
Start Date:Wednesday, May 14, 2008 - 5:30 PM
End Date:Wednesday, May 14, 2008 - 6:00 PM
Scope:T1 customers at Ada
Reason:ATT hardware upgrade

Description: ATT upgrading from OC-3 to OC-12 for new DS3IP.

Okmulgee Hub Posted Friday, May 9, 2008 - 2:20 PM by Todd
Start Date:Friday, May 9, 2008 - 2:18 PM
End Date:Friday, May 9, 2008 - 2:18 PM
Scope:All customers on the Okmulgee Hub.
Reason:Fiber cut.

Description: OneNet engineers have been in contact with the Telco and this connection is involved in a fiber cut. No estimated time of repair has been provided at this time.

OneNet hub Norman - Router Maintenance Posted Tuesday, May 6, 2008 - 1:18 PM by Von
Start Date:Sunday, May 18, 2008 - 7:00AM
End Date:Sunday, May 18, 2008 - 8:00AM
Scope:Customers - University of Oklahoma(Norman campus), OU-IT customers WNI, ATSC, WDT, DII, Vieux
Reason:Router maintenance.

Description: Router maintenance is required to upgrade chassis IOS for new hardware installation. Router reboot will be required. Internet access will be inactive for approximately 10-15 minutes for complete system reload.

Wilburton Hub Posted Wednesday, April 30, 2008 - 12:08 AM by Todd
Start Date:Wednesday, April 30, 2008 - 12:06 AM
End Date:Wednesday, April 30, 2008 - 12:06 AM
Scope:All Customers on the Wilburton hub.
Reason:Power outage

Description: PSO is reporting a power outage affecting this hub site. No ETR has been provided.

Tishomingo Hub site Posted Thursday, April 24, 2008 - 8:58 AM by Bobby
Start Date:Thursday, April 24, 2008 - 8:56 AM
End Date:Thursday, April 24, 2008 - 8:56 AM
Scope:Tishomingo hub site.
Reason:All services have been restored.

Description: Power has been restored and all services are up and running.

Tishomingo Hub Site Router Posted Thursday, April 24, 2008 - 4:33 AM by Todd
Start Date:Thursday, April 24, 2008 - 4:28 AM
End Date:Thursday, April 24, 2008 - ongoing
Scope:Tishomingo hut site connectivity: All customers off of the Hub site.
Reason:Tishomingo Hub site is down due to power outages. No ETA on restoration of power.

Description: Telco has verified that the circuit is down due to power outages.

Tishomingo Hub Site Router Posted Thursday, April 24, 2008 - 2:40 AM by Todd
Start Date:Thursday, April 24, 2008 - 2:33 AM
End Date:Thursday, April 24, 2008 - ongoing
Scope:All customers off the Tishomingo Hub site.
Reason:Hub Connectivity Outage.

Description: OneNet equipment is up and responding. OneNet Engineers are in contact with the Telco to find out cause of the outage.

Okmulgee Hub Outage Update Posted Thursday, April 17, 2008 - 2:03 PM by Cheri
Start Date:Thursday, April 17, 2008 - 11:59 PM
End Date:Thursday, April 17, 2008 - on going
Scope: All customers off the Okmulgee Hub
Reason:Possible Fiber Cut between Okmulgee and Henrietta or Node Failure at Okmulgee.

Description: UPDATE: Fiber cut is located 3 miles south of Okmulgee. MBO crew out of Pottawatomie in route. No ETR at this time.

Okmulgee Hub Outage Posted Thursday, April 17, 2008 - 12:26 PM by Cheri
Start Date:Thursday, April 17, 2008 - 11:59 PM
End Date:Thursday, April 17, 2008 - on going
Scope:All customers off the Okmulgee Hub
Reason:Possible Fiber Cut between Okmulgee and Henrietta or Node Failure at Okmulgee.

Description: All customers off the Okmulgee Hub. Possible Fiber Cut between Okmulgee and Henrietta or Node Failure at Okmulgee. MBO Technicians in route.

Okmulgee Hub Posted Thursday, April 17, 2008 - 11:32 AM by Todd
Start Date:Thursday, April 17, 2008 - 11:23 AM
End Date:Thursday, April 17, 2008 - 11:23 AM
Scope:All customers on the Okmulgee Hub.
Reason:Hub Connectivity Outage.

Description: OneNet equipment is up and responding. OneNet Engineers are in contact with the Telco to find out cause of the outage.

Router Maintenance Posted Thursday, April 17, 2008 - 11:14 AM by Von
Start Date:Thursday, April 24, 2008 - 11:00 PM
End Date:Thursday, April 24, 2008 - 11:59PM
Scope:OneNet customers directly connected to hubsites Sallisaw, Poteau and Bartlesville.
Reason:Router hardware maintenance.

Description: Router hardware maintenance is required to upgrade core routers in both OKC and Tulsa. The router in OKC is completely redundant in design and should have no service impact. The router in Tulsa is redundant as well but has additional connections which will impact hubsites in Sallisaw, Poteau and Bartlesville. Maintenance should require 15 to 20 minutes for complete router reload, but the full maintenance window is reserved.

Wilburton Hub Outage Posted Monday, April 14, 2008 - 1:28 PM by Cheri
Start Date:Saturday, April 12, 2008 -
End Date:Monday, April 14, 2008 - on-going
Scope:Customer behind the Wilburton Hub
Reason:Rain washed out the Telco's circuits on the side of a mountain.

Description: Customer behind the Wilburton Hub. Rain washed out the Telco's circuits on the side of a mountain. They have located the circuit's problem area and have been working to replace the cable and restore connectivity to OneNet customers as quickly as possible.

There is no ETR at this moment but they are trying to have the repairs made by the end of the day.

OneNet will send out more information as it becomes available.

Wilburton Hub Outage Posted Monday, April 14, 2008 - 12:32 PM by Cheri
Start Date:Saturday, April 12, 2008
End Date:ongoing
Scope:All persons off the Wilburton hub site
Reason:Local telco (Oklahoma Western) Has had on going issues throughout the weekend that continue on today. It is believed to be a large fiber cut but this has not been confirmed.

Description: All persons off the Wilburton hub site. Local telco (Oklahoma Western) Has had on going connectivity issues throughout the weekend that continue on today.

OneNet engineers have been working diligently throughout the outage to reach the telco in order to help them solve the problem, but the outage has effected the Telco's own phone lines as well.

The Sheriff in the area was sent out to check on the well being of the employees at the Telco and they assure us they are working continuously to fix the problem. There is no ETR at this time. We will keep you advised as more information becomes available.

We apologize for any inconvenience this may cause.

Tishomingo Hub Back Up Posted Thursday, April 10, 2008 - 1:11 PM by Cheri
Start Date:Thursday, April 10, 2008 - 1:08 PM
End Date:Thursday, April 10, 2008 - 1:08 PM
Scope:All customers off the Tishomingo Hub should now be back up
Reason:Power has been restored in the area

Description: All customers off the Tishomingo Hub should now be back up. Power has been restored in the area and we are showing the hub site as up and fully functional.

Warner Hub Outage Posted Thursday, April 10, 2008 - 9:44 AM by Randy
Start Date:Thursday, April 10, 2008 - 9:15 AM
End Date:
Scope:Warner Hub and customers connected to Warner Hub
Reason:power outage

Description: Power outage due to storms. Utility is working to restore service. No ET on repair.

Poteau Hub Outage Posted Thursday, April 10, 2008 - 8:24 AM by Randy
Start Date:Thursday, April 10, 2008 - 8:00 AM
End Date:
Scope:Poteau Hub and customer behind poteau router
Reason:power phase loss at hub site

Description: power outage on one phase of power feeding the poteau hubsite affecting services. Utility has dispatched on issue. No ET on repair.

Tishomingo Posted Thursday, April 10, 2008 - 7:24 AM by Cheri
Start Date:Thursday, April 10, 2008 - 7:20 AM
End Date:Thursday, April 10, 2008 -
Scope:All customers off the Tishomingo hub site.
Reason:Power outage to Murray State College

Description: All customers off the Tishomingo hub site. Power outage to Murray State College. No ETR at this time.

Hub Outage Posted Wednesday, April 9, 2008 - 8:50 PM by Randy
Start Date:Wednesday, April 9, 2008 - 8:00 PM
End Date:
Scope:Customers connected to McAlester Hub
Reason:Power Outage due to Storms

Description: Storms have disabled power in McAlester area affecting OneNet Hub and customers behind the hub router. No ET on repairs as storms continue in area.

Email services down Posted Friday, April 4, 2008 - 4:35 PM by Brian
Start Date:Friday, April 4, 2008 - 4:10 PM
End Date:Friday, April 4, 2008 - 4:53 PM
Scope:All OneNet hosted email
Reason:Storage system trouble

Description: The email system is down with storage system trouble. No ETR at this time.

System is up after a reboot

OKC14 Hub router. Posted Friday, March 28, 2008 - 4:44 PM by Todd
Start Date:Friday, March 28, 2008 - 4:36 PM
End Date:Friday, March 28, 2008 - 4:36 PM
Scope:Select T1 customers on OKC14 Hubsite.
Reason:Emergency hardware reset of select PA Module.

Description: An immediate emergency hardware reset of the module that is affecting select T1 connections on the OKC14 hub router has been preformed to resolve those outages.

UPDATE: Access to select sites. Posted Tuesday, March 18, 2008 - 9:23 AM by Todd
Start Date:Tuesday, March 18, 2008 - 9:11 AM
End Date:Tuesday, March 18, 2008 - 9:11 AM
Scope:All OneNet customers internet access for select sites.
Reason:Issues on Level 3 network.

Description: Level has confirmed they were having issues with MTU sizes across their backbone yesterday. They are reporting the issue cleared last night around 5:30 p.m. to 6:00 p.m. As more details become available, OneNet will post additional updates. Thank you.

Access to select sites. Posted Monday, March 17, 2008 - 7:19 PM by Todd
Start Date:Monday, March 17, 2008 - 7:17 PM
End Date:Monday, March 17, 2008 - 7:17 PM
Scope:All OneNet customers internet access for select sites.
Reason:Issues on Level 3 network.

Description: Issues of intermittent access have been reported throughout the course of the day when trying to reach select websites. Routing functions within the OneNet network are stable. Level 3, one of OneNet’s upstream providers, has identified network problems. Level 3 is addressing these problems, as information becomes available, additional updates will be posted.

OKC13 Hub Posted Sunday, March 16, 2008 - 7:30 PM by Todd
Start Date:Sunday, March 16, 2008 - 7:26 PM
End Date:Sunday, March 16, 2008 - 7:26 PM
Scope:All Customers
Reason:Emergency Maintenance

Description: A reload of this hub router was required to restore service to select customers and prevent further degredation of service. The scheduled maintenance for 10:00 P.M. for tonight is no longer needed and has been cancelled.

OKC13 Hub Posted Sunday, March 16, 2008 - 4:28 PM by Todd
Start Date:Sunday, March 16, 2008 - 10:00 PM
End Date:Sunday, March 16, 2008 - 10:10 PM
Scope:All customers on this hub. This includes but is not limited to the following customers. FAA, OUHSC, City of Edmond, OCU, Metropolitan Library System, Dept. of Veteran Affairs, Oklahoma Tax Commission, OETA, and OSF.
Reason:Emergency Maintenance.

Description: OneNet will be performing a reload of this hub to clear and reset the TCAM of this router. The expected outage time is 10 minutes. Thank you.

OKC13 Hub Posted Sunday, March 16, 2008 - 4:28 PM by Todd
Start Date:Sunday, March 16, 2008 - 10:00 PM
End Date:Sunday, March 16, 2008 - 10:10 PM
Scope:All customers on this hub. This includes but is not limited to the following customers. FAA, OUHSC, City of Edmond, OCU, Metropolitan Library System, Dept. of Veteran Affairs, Oklahoma Tax Commission, OETA, and OSF.
Reason:Emergency Maintenance.

Description: OneNet will be performing a reload of this hub to clear and reset the TCAM of this router. The expected outage time is 10 minutes. Thank you.

Fiber Maintenance Posted Thursday, March 13, 2008 - 4:22 PM by Randy
Start Date:Friday, March 21, 2008 - 12:01 AM
End Date:Friday, March 21, 2008 - 6:00 AM
Scope:OneNet Hubsites located in Ada, Tishomingo, and Duncan
Reason:Telco scheduled maintenance window to complete relocate fiber cable for I-40 construction at May Ave.

Description: Telco is performing second half of fiber move began on March 19. Intermittent outages may occur as fiber is relocated.

Fiber Maintenance Posted Thursday, March 13, 2008 - 4:16 PM by Randy
Start Date:Wednesday, March 19, 2008 - 12:01 AM
End Date:Wednesday, March 19, 2008 - 6:00 AM
Scope:OneNet Hubsites located in ADA, Duncan, Durant, and Tishomingo
Reason:Telco will be moving a 216 fiber cable for New I-40 construction at May Ave.

Description: Telco will be moving fiber cable and each site may see outages as fiber cable is spliced. Outage is not expected for entire window but as fiber is spliced to new cable route. This is window #1 of 2 for this work.

Internet - Intermittent Access Issues Posted Thursday, February 21, 2008 - 9:09 PM by Von
Start Date:Thursday, February 21, 2008 - 7:56 PM
End Date:Thursday, February 21, 2008 - 7:56 PM
Scope:OneNet internet access.
Reason:OneNet core routing issues.

Description: Internal OneNet core routing issues caused intermittent internet access for periods of time throughout the course of the day. The routing issues have been identified and stabalized. Cisco engineers have also been engaged to review the issues and minimize any further impact on OneNet customers.

MWC Hub Posted Saturday, February 16, 2008 - 9:05 PM by Todd
Start Date:Saturday, February 16, 2008 - 2:04 PM
End Date:Saturday, February 16, 2008 - 8:03 PM
Scope:Rose State College
Reason:Localized power outage resulting in loss of connectivity.

Description: Power to the OneNet Hub and ATT equipment has been restored.

NLR 10Gig Connection Posted Thursday, February 14, 2008 - 10:13 AM by Von
Start Date:Thursday, February 14, 2008 - 10:06 AM
End Date:Thursday, February 14, 2008 - 10:06 AM
Scope:All connectivity for NLR via direct 10Gig connection.
Reason:Hardware problem on NLR equipment in Chicago, IL.

Description: NLR 10Gig connection is down due to failed NLR equipment on Chicago, IL hubsite. This impacts all NLR customers connected to this hubsite. NLR traffic remains active via 1Gig backup link and other redundant paths. Engineers are actively working issue. No ETA at present.

OKC13 Hub Posted Wednesday, February 13, 2008 - 7:27 PM by Todd
Start Date:Wednesday, February 13, 2008 - 11:00 PM
End Date:Wednesday, February 13, 2008 - 11:02 PM
Scope:Select Ethernet and Fast Ethernet customers
Reason:Emergency Maintenance.

Description: In an effort to resolve a connectivity issue, OneNet will be resetting an interface that will cause a temporary outage for select customers. Down time is expected to be less than 2 minutes.

Norman Hubsite maintenance Posted Monday, February 11, 2008 - 9:09 AM by Von
Start Date:Sunday, February 17, 2008 - 7:00 AM
End Date:Sunday, February 17, 2008 - 8:00 AM
Scope:University of Oklahoma Norman campus including National Weather Service, Atmospheric Technology Services and IT-Vieux.
Reason:Hardware maintenance.

Description: Hardware upgrade in order to increase routing and performance capabilities. All traffic will be shifted to redundant OKC/Norman circuit during maintenance and NO downtime is expected.

Emergency Level3 Fiber Maintenance Posted Wednesday, February 6, 2008 - 11:57 AM by Von
Start Date:Wednesday, February 6, 2008 - 11:00 PM
End Date:Wednesday, February 6, 2008 - 11:59 PM
Scope:Direct access to Level3 peering connection.
Reason:Fiber repair.

Description: Direct connection to Level3 will be inactive during maintenance window, but internet traffic for all destinations will remain available via alternate connections(Qwest, NTR, NLR & I2). Actual disconnect should only be for 5-10 minutes, but full maintenance window is reserved.

OKC Hub Aggregation router upgrade Posted Tuesday, February 5, 2008 - 9:07 AM by Bobby
Start Date:Wednesday, February 13, 2008 - 11:00 PM
End Date:Thursday, February 14, 2008 - 12:00 AM
Scope:All customers directly connected to the following OneNet hubsites: Altus, Ardmore, Alva, Durant, Edmond, Elreno, Enid, Goodwell, Ada, OKCCC, OSUOKC, MWC, Tonkawa, Warner.
Reason:Hardware upgrade on core router.

Description: Hardware upgrade in order to increase routing and performance capabilities on the OKC aggregation core router. All hubsites and their related customers will experience a loss of internet connectivity during the maintenance. Connectivity should only be down for a 10 to 15 minute duration, but the full maintenance window is reserved.

OKC Hub Aggregation router upgrade Posted Thursday, January 31, 2008 - 12:48 PM by Joe
Start Date:Wednesday, February 6, 2008-11:00PM
End Date:Wednesday, February 6, 2008-11:59PM
Scope:All customers directly connected to the following OneNet hubsites: Chickasha, Duncan, Idabel, McAlester, Okmulgee, Sayre, Seminole, Tishomingo, Weatherford, Wilburton, Woodward.
Reason:Hardware upgrade on core router.

Description: Hardware upgrade in order to increase routing and performance capabilities on the OKC aggregation core router. All hubsites and their related customers will experience a loss of internet connectivity during the maintenance. Connectivity should only be down for a 10 to 15 minute duration, but the full maintenance window is reserved.

Tulsa hub router upgrade Posted Wednesday, January 30, 2008 - 3:16 PM by Von
Start Date:Saturday, February 2, 2008 - 11:00 PM
End Date:Sunday, February 3, 2008 - 12:00 AM
Scope:Tulsa hub border router Level3 connection.
Reason:Hardware upgrade.

Description: Hardware upgrade in order to increase routing and performance capabilities on border router . Direct connection to Level3 will be inactive during maintenance window, but internet traffic for all destinations will remain available via alternate connections(Qwest, NTR, NLR & I2).

Core router upgrade Posted Friday, January 25, 2008 - 3:21 PM by Bobby
Start Date:Wednesday, January 30, 2008 - 11:00 PM
End Date:Wednesday, January 30, 2008 - 11:30 PM
Scope:OneNet customers will not experience any disruption due to network redundancy that is in place.
Reason:Hardware upgrade on 1 of 2 Quest edge router.

Description: A maintenance window is being set aside to perform hardware upgrade to a core router.

Woodward hub router Posted Wednesday, January 23, 2008 - 4:57 PM by Sam
Start Date:Thursday, January 24, 2008 - 1:01 AM
End Date:Thursday, January 24, 2008 - 1:30 AM
Scope:All customers behind Woodward hub router
Reason:Emergency maintenance

Description: Pioneer telco doing emergency maint on Nortel OC-12. DS3IP will be effected.

Lawton hub router/Light Wave Posted Monday, January 14, 2008 - 3:13 PM by Sam
Start Date:Monday, January 14, 2008 - 3:10 PM
End Date:Monday, January 14, 2008 - 3:10 PM
Scope:All customers behind Lawton hub router
Reason:Power issues at Lawton

Description: Installing back up DC power for Light Wave.

OneNethub-Lawton down Posted Sunday, January 13, 2008 - 4:52 AM by Von
Start Date:Sunday, January 13, 2008 - 4:41 AM
End Date:Sunday, January 13, 2008 - 4:41 AM
Scope:all customers directly connected Lawton hubsite
Reason:WAN circuit down

Description: Hubsite Lawton and all customers directly connected are off line. Technicians are working issue. ETA unknown. Will update once more information is known.

Emergency Maintenance Posted Saturday, January 12, 2008 - 1:15 AM by Von
Start Date:Saturday, January 12, 2008 - 1:05 AM
End Date:Saturday, January 12, 2008 - 1:05 AM
Scope:OneNet Customers.
Reason:Routing issues.

Description: The maintenance for tonight has been completed and service fully restored. All known issues have been resolved. We will continue to monitor.

News Alert Address Change Posted Friday, January 11, 2008 - 4:23 PM by Brian
Start Date:Friday, January 11, 2008
End Date:
Scope:OneNet News announcements
Reason:News alerts now going though mailing list manager.

Description: OneNet news alerts will now be coming from the address onenetnews@lists.onenet.net with an envelope address of onenetnews-bounces@lists.onenet.net .

Emergency Maintenance Posted Friday, January 11, 2008 - 3:21 PM by Todd
Start Date:Friday, January 11, 2008 - 11:00 PM
End Date:Friday, January 11, 2008 - 12:00 AM
Scope:OneNet Customers
Reason:Routing Issues.

Description: OneNet will be replacing hardware in order to resolve the routing issue's occuring on the network over the last few days. The expected down is less than 1 hour. However, the entire window will be reserved for the maintenance if needed. Thank you.

Emergency Maintenance Posted Tuesday, January 8, 2008 - 9:08 AM by Todd
Start Date:Tuesday, January 8, 2008 - 12:00 AM
End Date:Tuesday, January 8, 2008 - 2:00 AM
Scope:OneNet Customers
Reason:Emergency Maintenance.

Description: Emergency Maintenance was required due to software issue. Multiple core routers in the Tulsa area required a reboot. All issues are stable at this time.

Claremore Area Problem Resolved Posted Monday, January 7, 2008 - 11:46 AM by Cheri
Start Date:Monday, January 7, 2008 - 7:45AM
End Date:Monday, January 7, 2008 - 11:42 AM
Scope:All circuits in and around the Claremore Area
Reason:The outage in the Claremore area has been resolved. OneNet technicians were able to replace a bad card on the router that appears to have resolved the issue.

Description: All circuits in and around the Claremore Area

The outage in the Claremore area has been resolved. OneNet technicians were able to replace a bad card on the router that appears to have resolved the issue.

We will continue to monitor the hub site to be sure that the connectivity is stable.

As always, we appreciate everyones understanding and if you have any questions you can contact the helpdesk at 888-566-3638.

Claremore Area Sites Down Posted Monday, January 7, 2008 - 10:50 AM by Cheri
Start Date:Monday, January 7, 2008 - 7:45 AM
End Date:Monday, January 7, 2008 - 10:47 AM
Scope:All persons off the Claremore Hub Site
Reason:OneNet Engineers and local telco engineers are in route and on site to determine the nature of the outage and correct the problem. At this time no ETR is available.

Description: All persons off the Claremore Hub Site. OneNet Engineers and local telco engineers are in route and on site to determine the nature of the outage and correct the problem. At this time no ETR is available.

We will update you throughout the day as more information becomes available.

Web Server Memory Upgrade Posted Thursday, January 3, 2008 - 4:46 PM by Brian
Start Date:Thursday, January 3, 2008 - 9:00 PM
End Date:Thursday, January 3, 2008 - 10:00 PM
Scope:OneNet hosted web services
Reason:Memory upgrade to correct a performance problem

Description: The primary web server will be down this evening to install additional RAM.

Access to select internet sites. Posted Thursday, December 27, 2007 - 12:24 PM by Todd
Start Date:Wednesday, December 26, 2007 - 11:00 AM
End Date:Wednesday, December 26, 2007 - 9:00 PM
Scope:OneNet customers
Reason:Upstream service provider issue.

Description: OneNet and all of its customers experienced problems accessing specific sites on the internet during the course of yesterday. Even though OneNet's infrastucture and routing were intact, one of our upstream internet peering partners had implemented new policies that adversely impacted our internet access to select sites. We worked throughout the day with all parties involved until yesterday evening, when our upstream provider was able to identify and correct the problem.

Due to the fact that the problems were external to OneNet's network, we were reliant on our upstream providers for the resolution and explanation of the issues. This delayed our response to our customers, but we wanted to assure that we had the correct facts and details before responding.

We continue to agressively work with all parties involved to maintain a stable connection and avoid this issue in the future.

Bartlesville Hub Outage Posted Thursday, December 13, 2007 - 12:01 PM by Randy
Start Date:Thursday, December 13, 2007 - 11:35 AM
End Date:
Scope:All Customer connected to Bartlesville
Reason:Power Outage

Description: Bartlesville Police report main transformer near mall affecting east side of Bartlesville has failed. PSO responding to repair. No ET at this time.

Duncan Hub Posted Friday, December 7, 2007 - 2:07 PM by Brian
Start Date:Friday, December 7, 2007 - 2:00 PM
End Date:Friday, December 7, 2007 - 2:30 PM
Scope:All Customers on the Duncan Hub.
Reason:Telco Hardware replacement.

Description: INFO (Indian Nations Fiber Optic) will be replacing hardware on the main connection to the Duncan Hub in an attempt to resolve errors and connectivity drops on the connection.

Emergency Firewall software upgrade - Intermittant availability of services in DMZ services Posted Thursday, November 1, 2007 - 2:57 PM by Todd
Start Date:Thursday, November 1, 2007 - 11:00 PM
End Date:Friday, November 2, 2007 - 1:00 AM
Scope:All services located in the DMZ, including client DNS, hosted email, hosted web sites, and all other services.
Reason:A software maintenance patch needs to be applied.

Description: This will not be a continuous outage. It is possible during this time period for services to be interrupted for a few minutes (<5 mins.) while firewall cluster nodes are restarted.

Tulsa web server Posted Thursday, September 6, 2007 - 11:28 AM by Stephen
Start Date:Thursday, September 6, 2007 - 19:00
End Date:Thursday, September 6, 2007 - 20:00
Scope:All websites served from Tulsa web server (sunhub-tulsa)
Reason:Swap storage subsystem to improve IO performance and enable offsite data replication.

Description: At 1900, the Tulsa webserver services (http, ftp, mysql) will be disabled and the data synchronized to a new storage subsystem. The new system will be made active and web services will be restored. Expected outage time will be around 20 minutes, but the entire window is reserved.

Tishomingo Hub Posted Tuesday, September 4, 2007 - 1:59 PM by Todd
Start Date:Tuesday, September 4, 2007 - 1:55 PM
End Date:Tuesday, September 4, 2007 - 1:55 PM
Scope:All Customers on this hub.
Reason:Connectivity outage.

Description: OneNet is currently in contact with the Telco to determine the nature of the outage that supplies connectivity to the Tishomingo Hub.

Goodwell Hub site Posted Friday, August 31, 2007 - 8:07 AM by Cheri
Start Date:Friday, August 31, 2007 - 8:04 AM
End Date:Friday, August 31, 2007 - 8:04 AM
Scope:All customers off the Goodwell Hub site
Reason:A transformer has blown causing a power outage at Panhandle State University, OneNet's hub site. The local power company is working to restore power at this time. There have not given an ETR. When contacting the helpdesk regarding this issue please reference ticket number 23830.

Description: All customers off the Goodwell Hub site

A transformer has blown causing a power outage at Panhandle State University, OneNet's hub site. The local power company is working to restore power at this time. There have not given an ETR. When contacting the helpdesk regarding this issue please reference ticket number 23830.

Firewall software upgrade - Intermittant availability of DMZ services Posted Thursday, August 16, 2007 - 3:02 PM by David
Start Date:Thursday, August 16, 2007 - 11:00 PM
End Date:Thursday, August 17, 2007 - 1:00 AM
Scope:All services located in the DMZ, including client DNS, hosted email, hosted web sites, and all other services.
Reason:A software maintenance patch needs to be applied.

Description: This will not be a continuous outage. It is possible during this time period for services to be interrupted for a few minutes (<5 mins.) while firewall cluster nodes are restarted.

Firewall software upgrade - Intermittant availability of DMZ services Posted Thursday, August 16, 2007 - 3:01 PM by David
Start Date:Thursday, August 16, 2007 - 11:00 PM
End Date:Thursday, August 16, 2007 - 1:00 AM
Scope:All services located in the DMZ, including client DNS, hosted email, hosted web sites, and all other services.
Reason:A software maintenance patch needs to be applied.

Description: This will not be a continuous outage. It is possible during this time period for services to be interrupted for a few minutes (<5 mins.) while firewall cluster nodes are restarted.

Firewall reconfiguration - Intermittant availability of DMZ services Posted Tuesday, August 14, 2007 - 3:35 PM by David
Start Date:Tuesday, August 14, 2007 - 11:00 PM
End Date:Wednesday, August 15, 2007 - 1:00 AM
Scope:All services located in the DMZ, including client DNS, hosted email, hosted web sites, and all other services.
Reason:Reconfiguration and test activation of secondary (backup) firewall services.

Description: This will not be a continuous outage. It is possible during this time period for services to be interrupted for a few seconds while testing secondary (backup) firewall services.

Claremore Hub Posted Tuesday, August 14, 2007 - 9:45 AM by Todd
Start Date:Tuesday, August 14, 2007 - 9:29 AM
End Date:Tuesday, August 14, 2007 - 9:29 AM
Scope:All clients on the Claremore Hub.
Reason:Status Update

Description: The Claremore Hub router is stable and the errors on the CT3 connection are resolved at this time. OneNet will continue to monitor the situation for the next 24 hours.

OKC Datacenter Outage Posted Monday, August 13, 2007 - 1:45 PM by Stephen
Start Date:Saturday, August 18, 2007 - 08:00 AM
End Date:Saturday, August 18, 2007 - 11:00 AM
Scope:OneNet Helpdesk. All hosted email and web services. webCT. DNS services from Oklahoma City. Storage services and hosted backup. OneNet website. VoIP. Vision.
Reason:Upgrade and expand UPS output distribution panel.

Description: Starting at 0800 on 18 August, we will begin an ordered shutdown of the Oklahoma City datacenter. By 0900, all systems will be powered down. Certain critical systems will be transfered to auxiliary generators during this time, which may cause some brief service interruptions. At 0900, power will be turned off to the datacenter and electricians will begin connecting the new panel. By 1000, the new panel should be online and tested, and we can begin an ordered startup of all systems. We expect to resume normal operations by 1100.

Claremore Hub Posted Monday, August 13, 2007 - 11:25 AM by Todd
Start Date:Monday, August 13, 2007 - 1:00 PM
End Date:Monday, August 13, 2007 - 2:00 PM
Scope:All customers on CT3 and the main hub site connection.
Reason:OneNet will be replacing the transport system from telco equipment to OneNet's hub router for the CT3.

Description: We will also be replacing the PA that the CT3 connects to in our hub router for a second time in an effort to resolve errors coming across that connection. The main hub connection will be down for around 5 mins. The transport for the CT3 may be down for an extended time frame. OneNet will reserve the entire window for the CT3 transport replacement.

Claremore Hub Posted Wednesday, August 8, 2007 - 11:20 AM by Todd
Start Date:Wednesday, August 8, 2007 - 11:06 AM
End Date:Wednesday, August 8, 2007 - 11:06 AM
Scope:All T1 customers on the Claremore hub.
Reason:CT3 Testing completed.

Description: OneNet worked extensively with ATT to isolate errors on the CT3 and ATT agreed to replace the DSX card in an attempt to resolve errors. At this time, the CT3 is running clean.

Claremore Hub Posted Wednesday, August 8, 2007 - 9:28 AM by Todd
Start Date:Wednesday, August 8, 2007 - 9:25 AM
End Date:Wednesday, August 8, 2007 - 9:25 AM
Scope:T1 customers
Reason:Testing of CT3

Description: ATT is about 15 to 20 minutes out from the Claremore Hub. Once the arrive the will test the CT3. Testing may be as long a 20 mins depending upon the results.

Claremore Hub Posted Wednesday, August 8, 2007 - 8:50 AM by Todd
Start Date:Wednesday, August 8, 2007 - 8:47 AM
End Date:Wednesday, August 8, 2007 - 8:47 AM
Scope:T1 customers on the Claremore Hub.
Reason:Still seeing errors on the Channelized T3.

Description: OneNet is still seeing errors come in from the Telco on the CT3 that various T1 customers ride on. ATT will be doing an intrusive test on this circuit which will bring connectivity down.

Claremore Hub Posted Tuesday, August 7, 2007 - 3:25 PM by Todd
Start Date:Tuesday, August 7, 2007 - 3:20 PM
End Date:Tuesday, August 7, 2007 - 3:20 PM
Scope:All customers on the Claremore hub.
Reason:Additional Testing.

Description: We will be testing the entire span of the main circuit around 4 P.M. Cox has technician in route to assist on testing through the physical media from the opposite end of the circuit.

Main firewall restart Posted Tuesday, August 7, 2007 - 3:23 PM by David
Start Date:Wednesday, August 8, 2007 - 12:00 AM
End Date:Wednesday, August 8, 2007 - 12:30 AM
Scope:All DMZ hosted services including customer email, dns, and most hosted web sites
Reason:Firewall configuration verification and restart

Description: All DMZ hosted service including customer email, dns, and most hosted web sites will have a temporary loss of connectivity. The loss should be less than two minutes.

Claremore Hub Posted Tuesday, August 7, 2007 - 2:24 PM by Todd
Start Date:Tuesday, August 7, 2007 - 10:14 AM
End Date:Tuesday, August 7, 2007 - 10:14 AM
Scope:All customers on the Claremore hub.
Reason:Errors on the main hub connection and possible Channelized T3.

Description: OneNet is and has been in contact the telco on this issue. OneNet has dispatched a technician with hardware for possible replacement. We will continue to work with the telco until the cause has been determined. We will be testing the circuit at 2:30 p.m.

Tishomingo Hub Posted Monday, August 6, 2007 - 5:10 PM by Todd
Start Date:Monday, August 6, 2007 - 4:53 PM
End Date:Monday, August 6, 2007 - 4:53 PM
Scope:All Customers on the Tishomingo Hub.
Reason:Connectivity restored.

Description: The telco re-routed our main circuit to a new fiber due to problems with the existing connection. All connectivity issues have been resolved. No failures were found in regards to OneNet equipment.

Claremore Hub Posted Monday, August 6, 2007 - 4:19 PM by Todd
Start Date:Monday, August 6, 2007 - 4:17 PM
End Date:Monday, August 6, 2007 - 4:17 PM
Scope:All customers on the Claremore Hub site.
Reason:OneNet is seeing errors come the main connection that supplies this hub.

Description: Emergency testing is required to isolate trouble with Telco on circuit.

Tishomingo Hub Outage Posted Monday, August 6, 2007 - 10:21 AM by Randy
Start Date:Monday, August 6, 2007 - 10:30 AM
End Date:Monday, August 6, 2007 - 11:30 AM
Scope:All customers connected to Tishomingo Hub
Reason:Telco Testing Circuit problems

Description: Router instability is continuing. Telco will be testing the circuit end to end to attempt to isolate the problem.

Tishomingo hub router Posted Sunday, August 5, 2007 - 7:43 PM by Sam
Start Date:Sunday, August 5, 2007 - 7:37 PM
End Date:Sunday, August 5, 2007 - 7:37 PM
Scope:All customers behind Tishomingo hub router
Reason:Unknown

Description: Site is still experiencing stability issues. OneNet Engineers working problem. Telco has been contacted.

Tishomingo hub router Posted Saturday, August 4, 2007 - 8:28 PM by Sam
Start Date:Saturday, August 4, 2007 - 8:26 PM
End Date:Saturday, August 4, 2007 - 8:26 PM
Scope:All customers behind Tishomingo hub router
Reason:Router unstable

Description: Onenethub engineers and Cisco TAC is involved in solving router instalbility.

Tishomingo Hub Posted Friday, August 3, 2007 - 1:05 PM by Todd
Start Date:Friday, August 3, 2007 - 1:02 PM
End Date:Friday, August 3, 2007 - 1:02 PM
Scope:All Customers on the Tishomingo Hub.
Reason:Internetwork Connectivity

Description: OneNet is currently working with the Telco to try and determine the nature of outage.

Claremore Hub Relocation Posted Tuesday, July 31, 2007 - 4:53 PM by Randy
Start Date:Friday, August 3, 2007 - 12:01 AM
End Date:Friday, August 3, 2007 - 6:00 AM
Scope:All customers connected to Claremore Hub Site
Reason:Equipment relocation to new datacenter

Description: Telco and OneNet will be relocating equipment from current location to new datacenter. Outage duration will be at least 2 hrs but entire window is reserved.

Network Maintenance Posted Monday, July 30, 2007 - 4:39 PM by Von
Start Date:Sunday, August 5, 2007 - 8:00 AM
End Date:Sunday, August 5, 2007 - 10:00 AM
Scope:OneNet customers accessing internet via OKC core routers.
Reason:Hardware maintenance.

Description: Router maintenance is required to upgrade core routers to handle increased routing capacity. Internet access should remain up throughout, but intermittent access may be seen. The full maintenance window is reserved.

All customer off the Durant hub site Posted Tuesday, July 24, 2007 - 8:40 AM by Cheri
Start Date:Friday, August 3, 2007 - 12:01 AM
End Date:Friday, August 3, 2007 - 6:00 AM
Scope:All customers off the Durant Hub site
Reason:The City of Durant is widening the road. Expected duration of the outage is 4 hours but the entire window is reserved.

Description: INFO has reported that the City of Durant will widening a road and expect the connectivity to the Durant Hub site to be down for about 4 hours but the entire window is reserved.

Scheduled Maintenance Posted Tuesday, July 24, 2007 - 8:05 AM by Cheri
Start Date:Friday, August 3, 2007 -12:01 AM
End Date:Friday, August 3, 2007 - 6:00AM
Scope:All customer off the Durant hub site
Reason:The City of Durant is widening the road. Expected duration of the outage is expected to be about 4 hours but the entire window is reserved

Description: Info has reported that the City of Durant will widening a road and expect the connectivity to the Durant Hub site to be down for about 4 hours but the entire window is reserved.

Emergency maintenance and upgrades Posted Sunday, July 22, 2007 - 10:41 PM by Todd
Start Date:Sunday, July 22, 2007 - 10:35 PM
End Date:Sunday, July 22, 2007 - 10:35 PM
Scope:All OneNet clients.
Reason:Hardware failures.

Description: OneNet has performed emergency maintenance over the last 2 days due to multiple hardware failures. We have replaced and upgraded multiple core routers at various OneNet locations due to these failures. At this time, OneNet core routers are stable and connectivity should be restored.

Intermittent Connectivty. Posted Friday, July 20, 2007 - 11:00 AM by Todd
Start Date:Friday, July 20, 2007 - 10:49 AM
End Date:Friday, July 20, 2007 - 10:49 AM
Scope:OneNet Customers.
Reason:Networking Issues.

Description: The networking issues are now resolved. Connectivity has been restored and is stable at this time.

Intermittent Connectivity Posted Friday, July 20, 2007 - 9:03 AM by Todd
Start Date:Friday, July 20, 2007 - 8:51 AM
End Date:Friday, July 20, 2007 - 8:51 AM
Scope:OneNet hub sites Bartlesville, Claremore, Poteau, and Sallisaw.
Reason:Issue with a core router in Tulsa area.

Description: At this time, OneNet is experiencing an issue with one of the core Tulsa routers that supplies connectivity to the above mentioned hubs. As information becomes available, we will release further updates. Thank You.

Warner Hub Outage Posted Tuesday, July 10, 2007 - 12:37 PM by Randy
Start Date:Tuesday, July 10, 2007 - 12:10 PM
End Date:
Scope:All customers connected to Warner Hub
Reason:Power Outage

Description: Campus is having a localized power outage affecting OneNet Equipment.
Campus staff are working to restore service. No ET on repair at this time.

Claremore Hub Posted Tuesday, July 3, 2007 - 9:37 AM by Todd
Start Date:Tuesday, July 3, 2007 - 9:34 AM
End Date:Tuesday, July 3, 2007 - 9:34 AM
Scope:Various T1 clients on the Claremore Hubsite.
Reason:Channelized T3 that various T1 clients ride on is taking errors that are affecting services.

Description: ATT will be doing an instrusive test around 10:30 a.m. this morning to isolate trouble on CT3.

Enid Fiber Maintenance Posted Monday, July 2, 2007 - 2:50 PM by Randy
Start Date:Tuesday July 3, 2007 - 10:00 PM
End Date:Tuesday July 3, 2007 - 11:00 PM
Scope:All customers behind Enid Router
Reason:Telco is performing fiber maintenance at Hub site

Description: Customers should expect a short duration outage as fibers are groomed to new fibers at hub location, however entire window is reserved.

Emergency Maintenance Posted Friday, June 22, 2007 - 10:45 AM by Von
Start Date:Friday, June 22, 2007 - 10:40 AM
End Date:Friday, June 22, 2007 - 10:50 AM
Scope:All customer connected behind Sallisaw, Poteau, Bartlesville and Claremore hubsites only.
Reason:Hardware issues.

Description: Reload of core router required to resolve issue related to routing problem for customers connected to affected hubs.

Tishomingo Hub Outage Posted Thursday, June 21, 2007 - 8:28 AM by Cheri
Start Date:Thursday, June 21, 2007 - 7:24 AM
End Date:Thursday, June 21, 2007 - 8:26 AM
Scope:All customers off the Tishomingo hub
Reason:Connectivity has been restored to the Tishomingo hub site and all customers should have connectivity restored at this time.

Description: All customers off the Tishomingo hub

Connectivity has been restored to the Tishomingo hub site and all customers should have connectivity restored at this time.

Tishonmingo hub router Posted Tuesday, June 19, 2007 - 11:10 AM by Sam
Start Date:Tuesday, June 19, 2007 - 1:30 PM
End Date:Tuesday, June 19, 2007 - 2:00 PM
Scope:All customers behind Tishomingo hub router
Reason:bad hardware

Description: Emergency hardware replacement at site. This should take 10 minutes, but entire window is reserved

Enid Hub Outage Posted Monday, June 18, 2007 - 2:31 PM by Cheri
Start Date:Monday, June 18, 2007 - 10:45 AM
End Date:Monday, June 18, 2007 - ?
Scope:All customers off the Enid hub site:
Reason:Pioneer Telco has reported a damaged fiber cable but they are still unable to give an ETR. We apologize for the inconvenience.Please reference ticket number 23018 when contacting the help desk for updates regarding this issue.

Description: All customers off the Enid hub site:

Pioneer Telco has reported a damaged fiber cable but they are still unable to give an ETR. We apologize for the inconvenience.

Please reference ticket number 23018 when contacting the help desk for updates regarding this issue.

Enid Hub Outage Posted Monday, June 18, 2007 - 11:09 AM by Cheri
Start Date:Monday, June 18, 2007 - 10:45 AM
End Date:Monday, June 18, 2007 - ?
Scope:All customers off the Enid hub site
Reason:The hub router is up but there appears to be no signal coming from the DS3. We suspect this is probably a fiber cut. We are working with the Telco to isolate the problem. There is no ETR at this time.

Description: All customers off the Enid hub site: The hub router is up but there appears to be no signal coming from the DS3. We suspect this is probably a fiber cut. We are working with the Telco to isolate the problem. There is no ETR at this time.

Please reference ticket number 23018 when contacting the help desk for updates regarding this issue.

Enid Hub Outage Posted Monday, June 18, 2007 - 10:58 AM by Randy
Start Date:Monday, June 18, 2007 - 10:30 AM
End Date:
Scope:All customers connected to Enid Hub
Reason:Link Circuit down

Description: Telco is troubleshooting the cause of outage. No ET on repair at this time. Will Update.

Durant Hub: Power has been restored Posted Monday, June 18, 2007 - 9:53 AM by Cheri
Start Date:Monday, June 18, 2007 - 7:15 AM
End Date:Monday, June 18, 2007 - 9:50 AM
Scope:All circuits off the Durant hub Site
Reason:Power has been restored to the hub site and all connectivity has been restored.

Description: All circuits off the Durant hub Site: Power has been restored to the hub site and all connectivity has been restored.

Fiber Cut Posted Thursday, June 7, 2007 - 1:32 PM by Cheri
Start Date:Thursday, June 7, 2007 - 1:15 PM
End Date:Thursday, June 7, 2007 - ?
Scope:Fiber cut between AT%T and Windstream effecting customers within the greater Norman area including but not limited to the following areas: Norman, Purcell, Lexington, and Noble.
Reason:Fiber cut between AT%T and Windstream. There is no ETA given at this time.

Description: Fiber cut between AT%T and Windstream effecting customers within the greater Norman area including but not limited to the following areas: Norman, Purcell, Lexington, and Noble.

Cox Maintenance Posted Wednesday, June 6, 2007 - 4:26 PM by Todd
Start Date:Wednesday, June 6, 2007 - 10:00 PM
End Date:Wednesday, June 6, 2007 - 12:00 PM
Scope:The following clients will be affected, Krebs, Mustang, El Reno, Edmond public schools. Also, Mid-America Bible College, Moore-Norman Technology Center, Norman Public Library, and the Ok Tax Commission will be affected.
Reason:COX will be moving the above circuits to another fiber ring to resolve a potential congestion issue.

Description: COX Communications has maintenance scheduled for 6/6/2007 at 10:00 p.m. A 10 min outage will be expected for each client listed above. OneNet will be working with COX Communications during indicated maintenance window to verify connectivity has been fully restored. Thank You.

COX Maintenance Posted Monday, June 4, 2007 - 4:00 PM by Todd
Start Date:Monday, June 5, 2007 - 10:00 PM
End Date:Monday, June 5, 2007 - 11:30 PM
Scope:Select OneNet Customers on the OKC13 hub site. The affected clients will include the FAA, Metro-Tech Technology Center, Metropolitan Library System-Downtown, Oklahoma Christian University, Francis-Tuttle Technology Center, Oklahoma State Insurance, Oklahoma County, Oklahoma Finance Housing Authority, and Mid-Del Technology Center.
Reason:COX will be moving the above circuits to another fiber ring to resolve a potential congestion issue.

Description: COX Communications has maintenance scheduled for 6/5/2007 at 10:00 p.m. A 10 min outage will be expected for each client listed above. OneNet will be working with COX Communications during indicated maintenance window to verify connectivity has been fully restored. Thank You.

Email Scanner Database Outage Posted Thursday, May 24, 2007 - 11:34 AM by Brian
Start Date:Thursday, May 24, 2007 - 6:00 AM
End Date:Thursday, May 24, 2007 - 10:30 AM
Scope:OneNet hosted email
Reason:A database problem caused the email SPAM/Virus scanners to be offline this morning.

Description: Email scanners were unable to process messages this morning due to a database issue. The issue is resolved and mail is flowing again. The system is catching up rapidly. No email was lost during the outage.

Level3 Commodity Internet maintenance Posted Wednesday, May 16, 2007 - 3:37 PM by Von
Start Date:Thursday, May 17, 2007 - 3:00 AM
End Date:Thursday, May 17, 2007 - 6:00 AM
Scope:Level3 OC-12 commodity connection.
Reason:Scheduled maintenance, circuit grooming.

Description: Level3 is reprovisioning OC-12 in OKC from legacy WilTel to full Level3 circuit. During the circuit downtime, commodity traffic will shift to redundant commodity links. Down time should be minimal, but full maintenance window is reserved.

Weatherford hub router Posted Tuesday, May 15, 2007 - 11:35 AM by Sam
Start Date:Wednesday, May 16, 2007 - 8:00 AM
End Date:Wednesday, May 16, 2007 - 8:00 PM
Scope:All customers behind Weatherford hub router
Reason:scheduled electrical maintenance

Description: PSO will be working on campus power on the date/time above. This work will take 8 to 12 hours to complete. Lightwave, telco equip and hub router etc. will be on OneNet generators. Generators will need maintance periodically,may result in brief outages.

Level3 OC-12 BGP peering session Posted Saturday, May 12, 2007 - 7:50 AM by Von
Start Date:Saturday, May 12, 2007 - 7:47 AM
End Date:Saturday, May 12, 2007 - 7:47 AM
Scope:Commodity internet connectivity via OKC Level3 BGP peering.
Reason:Level3 router hardware problem.

Description: Level3 router hardware has been repaired and connectivity has been restored.

Level3 OC-12 BGP peering session Posted Friday, May 11, 2007 - 8:56 PM by Von
Start Date:Friday, May 11, 2007 - 5:30 PM
End Date:Friday, May 11, 2007 - 8:18 PM
Scope:Commodity internet connectivity via OKC Level3 BGP peering down. Commodity internet remains up, with traffic shift to redundant links and peering sessions in OKC and Tulsa.
Reason:Level3 router hardware problem.

Description: Level3 OC-12 BGP peering session is down due to router hardware issues @ the Level3 POP. Engineers are working to repair the link and restore connectivity. No ETA at this time. An update will be posted once additional info known.

Tulsa SAN Maintenance Posted Sunday, May 6, 2007 - 11:34 AM by Stephen
Start Date:Sunday, May 6, 2007 - 11:30 AM
End Date:Sunday, May 6, 2007 - 12:30 AM
Scope:Websites hosted on Tulsa web server, NFS/CIFS storage in Tulsa
Reason:Reallocate storage

Description: Brief outages while FalconStor block mappings are rebuilt.

Anti-SPAM/Virus system maintenance Posted Thursday, May 3, 2007 - 4:17 PM by Brian
Start Date:Thursday, May 3, 2007 - 6:30 PM
End Date:Thursday, May 3, 2007 - 7:30 PM
Scope:All OneNet hosted email
Reason:Updates to Anti-SPAM/Virus systems

Description: Anti-SPAM/Virus systems will be updated this evening. This update should not be service affecting.

Enid Hub Posted Wednesday, April 25, 2007 - 10:21 AM by Todd
Start Date:Wednesday, April 25, 2007 - 10:18 AM
End Date:Wednesday, April 25, 2007 - 10:18 AM
Scope:Enid Hub outage on Tuesday, April 24, 2007
Reason:Offical cause of outage.

Description: Pioneer Telco found and replaced a defective MUX card on the connection that supplies connectivity to the Enid hub.

Woodward hub router Posted Friday, April 20, 2007 - 10:02 AM by Sam
Start Date:Friday, April 20, 2007 - 9:57 AM
End Date:Friday, April 20, 2007 - 9:57 AM
Scope:All customers behind Woodward hub router
Reason:Fiber cut

Description: Pioneer telco has fiber cut. Repair crew in route. No ET of repair

Woodward hub router Posted Friday, April 20, 2007 - 9:58 AM by Sam
Start Date:Friday, April 20, 2007 - 9:57 AM
End Date:Friday, April 20, 2007 - 9:57 AM
Scope:All customers behind Woodward hub router
Reason:Fiber cut

Description: Pioneer telco has fiber cut. Repair crew in route. No ET of repair

Poteau Hub Posted Saturday, April 14, 2007 - 6:15 PM by Todd
Start Date:Saturday, April 14, 2007 - 6:13 PM
End Date:Saturday, April 14, 2007 - 6:13 PM
Scope:All clients on OneNet Poteau Hub.
Reason:Connectivity Restored.

Description: Connectivity has been restored to main connection that supplies this hub. Telco worked issue and the connection appears to be stable at this time.

Poteau Hub Posted Saturday, April 14, 2007 - 1:11 PM by Todd
Start Date:Saturday, April 14, 2007 - 12:30 PM
End Date:Saturday, April 14, 2007 - 1:07 PM
Scope:All client's on the Poteau Hub site.
Reason:Hub site connectivity.

Description: A ticket has been open with the Telco to determine the cause of the outage on the main connection to the Poteau hub site. As information becomes available updates will be sent, thank you.

Circuit upgrade for Office of State Finance Posted Thursday, April 12, 2007 - 3:55 PM by Von
Start Date:Saturday, April 14, 2007 - 6:00 AM
End Date:Saturday, April 14, 2007 - 7:00 AM
Scope:Oklahoma Office of State Finance network and customers directly connected behind.
Reason:Circuit upgrade to redundant link.

Description: Redundant circuit will be installed to enhance OSF to OneNet connectivity.

Scheduled Maintenance Posted Wednesday, April 11, 2007 - 1:56 PM by Cheri
Start Date:Wednesday, April 12, 2007 - 2:00 AM
End Date:Wednesday, April 12, 2007 - 3:00 AM
Scope:Moore Public Library
Reason:Repairing switch fabric

Description: Cox Communications will be preforming emergency maintenance April 12, 2007 from 2:00 AM until 3:00 AM to repair switch fabric.

Continued Scheduled Maintenance Posted Tuesday, April 10, 2007 - 7:35 AM by Cheri
Start Date:Thursday, May 3, 2007 - 1:01AM
End Date:Thursday, May 3, 2007 - 6:00 AM
Scope:Red River Vo-Tech and Comanche Schools
Reason:Fiber damaged by elements restoring from temporary to permanent.New fiber cable has been installed and will be cut into existing fiber cable. Fibers will be cut in one at a time to minimize outage potenti

Description: Continued Scheduled Maintenance for Red River Vo-Tech and Comanche Schools, fiber damaged by elements restoring from temporary to permanent.
New fiber cable has been installed and will be cut into existing fiber cable. Fibers will be cut in one at a time to minimize outage potential.

Outages are expected to be approx. 1 hour each line but the entire window is reserved.

Scheduled Maintenance Posted Tuesday, April 10, 2007 - 7:32 AM by Cheri
Start Date:Tuesday, May 1, 2007 - 1:01 AM
End Date:Tuesday, May 1, 2007 - 5:00 AM
Scope:Red River Vo-Tech and Comanche Schools
Reason:Fiber damaged by elements restoring from temporary to permanent.New fiber cable has been installed and will be cut into existing fiber cable. Fibers will be cut in one at a time to minimize outage potential.

Description: Red River Vo-Tech and Comanche Schools, fiber damaged by elements restoring from temporary to permanent.
New fiber cable has been installed and will be cut into existing fiber cable. Fibers will be cut in one at a time to minimize outage potential.

Outages are expected to be approx. 1 hour each line but the entire window is reserved.

Scheduled Maintenance Posted Tuesday, April 10, 2007 - 7:25 AM by Cheri
Start Date:Tuesday, May 8, 2007 - 1:01 AM
End Date:Tuesday, May 8, 2007 - 5:00 AM
Scope:All customers in and around the following hub areas: Weatherford, Altus, Tishomingo, Chickasha, Guymon, Ft. Cobb, OKCCC, Tulsa, Alva, Durant, and Ada. Also the following customers: Davis Schools, Veterans Center in Ardmore,Comanche Schools, OU Sante Fe Plaza, GM Skills Center SW 74th,and OETA Cheyenne OK.
Reason:Fiber damaged by contractor restoring from temporary to permanent. New fiber cable has been installed and will be cut into existing fiber cable. Fibers will be cut in one at a time to minimize outage potential.

Description: All customers in and around the following hub areas: Weatherford, Altus, Tishomingo, Chickasha, Guymon, Ft. Cobb, OKCCC, Tulsa, Alva, Durant, and Ada.

Also the following customers: Davis Schools, Veterans Center in Ardmore,Comanche Schools, OU Sante Fe Plaza, GM Skills Center SW 74th,and OETA Cheyenne OK.

Fiber damaged by contractor restoring from temporary to permanent. New fiber cable has been installed and will be cut into existing fiber cable. Fibers will be cut in one at a time to minimize outage potential.

Customers should only experience switch hit outages but the entire window is reserved.

Amended Dates for Scheduled Maintenance Posted Wednesday, April 4, 2007 - 2:52 PM by Cheri
Start Date:Thursday, April 26, 2007 - 12:01 AM
End Date:Thursday, April 26, 2007 - 6:00 AM
Scope:Only Comanche Public Schools will experience an outage
Reason:Indian Nations is doing scheduled maintenance on April 26, 2007 from 12:01 am to 6:00 am and although the outage is expected to only be approx. 1 hour the entire window is reserved

Description: Indian Nations is doing scheduled maintenance on April 26, 2007 from 12:01 am to 6:00 am that will take down the connection to Comanche PS and although the outage is expected to only be approx. 1 hour the entire window is reserved

Scheduled Maintenance Posted Wednesday, April 4, 2007 - 2:49 PM by Cheri
Start Date:Tuesday, April 24, 2007 - 6:01 AM
End Date:Tuesday, April 24, 2007 - 12:00 AM
Scope:All customers in and around the Durant, Enid and Sayre areas
Reason:Indian Nation's has scheduled maintenance on April 24th

Description: Indian Nation's has scheduled maintenance on April 24th from 12:01 AM until 6:00 AM that will effect all customers in and around the Durant, Enid and Sayre areas. Although the outage is expected to only be for an hour the entire window is reserved.

Scheduled Maintenance Posted Wednesday, April 4, 2007 - 2:44 PM by Cheri
Start Date:Thursday, April 26, 2007 - 12:01 AM
End Date:Wednesday, April 4, 2007 - 6:00 AM
Scope:Only Comanche Public Schools will experience an outage
Reason:Indian Nations is doing scheduled maintenance on April 26, 2007 from 12:01 am to 6:00 am and although the outage is expected to only be approx. 1 hour the entire window is reserved

Description: Indian Nations is doing scheduled maintenance on April 26, 2007 from 12:01 am to 6:00 am that will take down the connection to Comanche PS and although the outage is expected to only be approx. 1 hour the entire window is reserved

Telco Maintenance for Select clients Posted Tuesday, March 27, 2007 - 1:33 PM by Todd
Start Date:Wednesday, March 28, 2007 - 10:00 PM
End Date:Thursday, March 29, 2007 - 6:00 AM
Scope:Affected clients will be The University of Fayetteville Arkansas, Arkansas State University, and OETA Eufaula Tower.
Reason:Vendor upgrade on network.

Description: MBO will be performing a vendor upgrade that will affect the above mentioned circuits. Client's will experience switch hits on all circuits.
A 5 to 10 minute outage is expected on all Ethernet interfaces as well as all unprotected optical interfaces. The full window will be reserved.

UCO Scheduled Maintenance Posted Monday, March 19, 2007 - 7:44 AM by Cheri
Start Date:Thursday, March 22, 2007 - 7:40 AM
End Date:Saturday, March 24, 2007 - 7:40 AM
Scope:UCO Community ONLY
Reason:Please note that Thursday, March 22, 2007, at 2 a.m., the Office ofInformation Technology will begin shutting down all university technologysystems for special maintenance.

Description: Please note that Thursday, March 22, 2007, at 2 a.m., the Office of
Information Technology will begin shutting down all university technology
systems for special maintenance. All systems will remain unavailable until
Saturday evening, March 24, 2007. The Spring Break time frame was selected
to cause the least impact.

All University technology services will be unavailable during these three
days. Please see the following web page for examples of systems and
services you will be unable to use whether on or off campus:
http://technology.ucok.edu/systems_notice.htm

If you have specific questions or concerns, please contact the Office of
Information Technology at 974-2688 or Technology Support at 974-2255.

Scheduled Maintenance Posted Monday, March 19, 2007 - 7:39 AM by Cheri
Start Date:Thursday, March 22 2007 - 12:01 AM
End Date:Thursday, March 22, 2007 - 6:00 AM
Scope:Only the following circuits will be effected:Sapulpa High School Seminole PS JD McCarty Cleveland County CourthouseOmniplex Tulsa Regional Medical Center ORU Coweta Jr High Owasso PS ORU
Reason:Cox Communications will be performing scheduled maintenance that will take down the applicable circuits for approximately 5 minutes on each circuit. Although the outage is expected to be brief the entire maintenance window is reserved.

Description: Cox Communications will be performing scheduled maintenance that will take down the applicable circuits for approximately 5 minutes on each circuit.

Only the following circuits will be effected:

Sapulpa High School
Seminole PS
JD McCarty
Cleveland County Courthouse
Omniplex
Tulsa Regional Medical Center
ORU
Coweta Jr High
Owasso PS
ORU

Although the outage is expected to be brief the entire maintenance window is reserved.

OKC6 Slot 3 Failure Posted Friday, March 9, 2007 - 4:16 PM by Jerad
Start Date:Friday, March 9, 2007 - 4:04 PM
End Date:Friday, March 9, 2007 - 4:04 PM
Scope:Customers behind the ElReno, Tonkawa and Ada Hubs
Reason:Hardware Failure

Description: Slot 3 in onenethub-OKC6 suffered a hardware failure causing a temporary loss of connectivity to customers behind the ElReno, Tonkawa and Ada Hub routers. The module was reset and is now stable. No Further issues are expected.

Daylight Savings Time Change Posted Thursday, March 8, 2007 - 2:16 PM by Todd
Start Date:Friday, March 9, 2007 - 10:00 PM
End Date:Friday, March 9, 2007 - 11:00 PM
Scope:Daylight Savings Time change effective March 11, 2007.
Reason:Daylight Savings Time change effective March 11, 2007.

Description: In anticipation of the new U.S. Daylight Savings Time changes signed into law, OneNet will be updating all core routers and switches. These changes are expected to be non-service affecting and no outages are expected from these updates. Thank You.

Email system maintenance Posted Monday, March 5, 2007 - 5:49 PM by Brian
Start Date:Monday, March 5, 2007 - 10:00 PM
End Date:Tuesday, March 6, 2007 - 2:00 AM
Scope:OneNet hosted email and hosted web publishing via FTP
Reason:DST patches

Description: The OneNet mail system will be down this evening to apply DST patches.

Scheduled Maintenance Posted Monday, March 5, 2007 - 11:37 AM by Cheri
Start Date:Wednesday, April 4, 2007 - 10:00 PM
End Date:Thursday, April 5, 2007 - 6:00 AM
Scope:University of Arkansas and Arkansas State University
Reason:MBO has scheduled maintenance to make vendor upgrades.

Description: The University of Arkansas and Arkansas State University will see about a 10 min, outage while MBO preforms scheduled maintenance to make vendor upgrades. Although the outage is expected to be brief the entire window is reserved.

McAlester and Muskogee Posted Wednesday, February 28, 2007 - 8:41 AM by Todd
Start Date:Wednesday, February 28, 2007 - 8:35 AM
End Date:Wednesday, February 28, 2007 - 8:35 AM
Scope:OneNet Customers on the McAlester and Muskogee Hubs.
Reason:Emergency hardware module reset.

Description: Connectivity outage due to hardware failure. Emergency hardware module reset on a core router was issue to restore connectivity. At this time connectivity has been restore and is stable.

Email system outage Posted Tuesday, February 27, 2007 - 10:34 PM by Stephen
Start Date:Tuesday, February 27, 2007 - 10:00 PM
End Date:Wednesday, February 28, 2007 - 3:00 AM
Scope:OneNet hosted email, both inbound and outbound. Webmail. Web publishing services
Reason:Email server suffered a storage controller casualty this evening. Vendor has been contacted for replacement parts.

Description: System response will be extremely slow while in failover mode, until the new storage contoller is installed. Once controller has been replaced, it may take some time to process backlogged email. Delivery will be delayed, but no mail should be lost.
Authentication services for web publishing will also be unavailable during this period.

Scheduled Maintenance Posted Tuesday, February 27, 2007 - 11:25 AM by Cheri
Start Date:Friday, March 16, 2007 - 1:01 AM
End Date:Friday, March 16, 2007 - 5:00 AM
Scope:All persons off the Alva Hub site, the Durant Hub Site and the Commanche School District
Reason:Indian Nations will be performing maintenance on the OC12 in the areas of Durant and Alva.

Description: Indian Nations will be performing maintenance on the OC12 in the areas of Durant and Alva. Down time is expected to be less than 1 hour but the entire window is reserved.

Scheduled Maintenance Posted Tuesday, February 27, 2007 - 11:18 AM by Cheri
Start Date:Wednesday,March 28, 2007 - 10:00 PM
End Date:Thursday, March 29, 2007 - 6:00 AM
Scope:MBO has scheduled vendor upgrade maintenance which will effect the University of Arkansas, Arkansas State University and the OETA Eufaula Tower. Switch hits are all that is expected but we reserve the entire window for the outage.
Reason:MBO has scheduled vendor upgrade maintenance.

Description: MBO has scheduled vendor upgrade maintenance which will effect the University of Arkansas, Arkansas State University and the OETA Eufaula Tower.

Seminole Circuit Issues Posted Monday, February 26, 2007 - 11:42 AM by Jerad
Start Date:Monday, February 26, 2007 - 11:32 AM
End Date:Monday, February 26, 2007 - 11:32 AM
Scope:Customers behind the Seminole hubsite
Reason:Circuit/Interface Errors - Update

Description: The Seminole DS3 continues to have problems resulting in intermittent connectivity. A hardware replacement is currently being dispatched. At this time the ETA is approximately 1:00 PM.

Seminole Circuit Issues Posted Monday, February 26, 2007 - 10:29 AM by Jerad
Start Date:Monday, February 26, 2007 - 10:30 AM
End Date:Monday, February 26, 2007 - 11:00 AM
Scope:Customers behind the Seminole hubsite
Reason:Circuit/Interface Errors

Description: Due to errors on the Seminole DS3, it is being moved immediately to an alternate interface. The estimated downtime is 15 Min, but the actual downtime is expected to be much less and the full maintenance window is reserved.

OneNethub-Altus Posted Sunday, February 25, 2007 - 12:06 AM by Von
Start Date:Sunday, February 25, 2007 - 12:00 AM
End Date:Sunday, February 25, 2007 - 12:00 AM
Scope:All customers directly connected to hubsite in Altus(Western OK State College)
Reason:Backup circuit restored.

Description: Service has been restored via a backup circuit for all customers affected. The main data circuit remains off line while we continue to work with the local telco on the primary DS3, but connectivity for all customers is fully functional at this time.

OneNethub-Altus Posted Saturday, February 24, 2007 - 6:03 PM by Von
Start Date:Saturday, February 24, 2007 - 5:49 PM
End Date:Saturday, February 24, 2007 - 5:49 PM
Scope:All customers directly connected to hubsite in Altus(Western OK State College)
Reason:Possible circuit issue.

Description: Power has been restored to hubsite but connectivity has not returned. Telco has been notified and and is troubleshooting. No ETA. I will update when further information is available.

OneNethub-Altus Posted Saturday, February 24, 2007 - 2:20 PM by Von
Start Date:Saturday, February 24, 2007 - 1:56 PM
End Date:Saturday, February 24, 2007 - 1:56 PM
Scope:All customers directly connected to hubsite in Altus(Western OK State College)
Reason:Power outage.

Description: Campus administration at Western OK State College is reporting a loss of electrical power on and around campus in Altus. The power outage has caused loss of connectivity for all customer directly connected to hubsite. Utility company is addressing outage. No ETA is know at this time.

OKC13 Posted Friday, February 23, 2007 - 4:52 PM by Todd
Start Date:Friday, February 23, 2007 - 4:48 PM
End Date:Friday, February 23, 2007 - 4:48 PM
Scope:Select T1 customers
Reason:Hardware Failure

Description: Hardware module failure caused connectivity loss to multiple T1 clients. An emergency reset of the hardware module has restored connectivity at this time.

Goodwell Hub Outage Posted Friday, February 23, 2007 - 10:57 AM by Randy
Start Date:Friday, February 23, 2007 - 10:34 AM
End Date:
Scope:All customers connected to Goodwell Hubsite
Reason:telco trouble possible fiber cut

Description: Telco is having trouble with link circuit. May be fiber cut. No ET on repair at this time.

Core router reload - hardware issues Posted Thursday, February 22, 2007 - 12:04 PM by Von
Start Date:Thursday, February 22, 2007 - 11:00 PM
End Date:Thursday, February 22, 2007 - 11:59 PM
Scope:Wide range of customers connecting directly to OneNet core routers in OKC. (ie OSF,FAA,Francis Tuttle,Norman Public Schools, etc)
Reason:Hardware issues related to core routers within the OneNet network. Customers have experienced intermittent loss of connectivity on and off for the past few days. A reload of the routers is required to facilitate the additional modifications to further stablize.

Description: Do to ongoing issues with select core routers, customers have been experiencing connectivity loss on and off for the last few days. The OneNet engineers in conjunction with Cisco TAC have been diligently working to resolve the problem. The routers are stable at this point but will require a reload to facilitate additional modifications. The reload is scheduled for off hours to minimize impact. It will require 15-20 minutes for all services to be restored, but the full maintenance window is reserved.

Alva Hub DS3 Down Posted Thursday, February 22, 2007 - 8:21 AM by Bill Davis
Start Date:Thursday, February 22, 2007 - 2:45 AM
End Date:Thursday, February 22, 2007 -
Scope:All OneNet sites on the Alva hub router.
Reason:OneNet's Alva carrier, Chickasaw Telephone Company, had scheduled equipment maintenance overnight. OneNet's Alva DS3 link went down and did not recover.

Description: OneNet has contacted Chickasaw Telephone. Their techs are working on the problem. No ETR at this time.

OKC13 Hub Posted Thursday, February 22, 2007 - 8:12 AM by Todd
Start Date:Thursday, February 22, 2007 - 7:55 AM
End Date:Thursday, February 22, 2007 - 7:55 AM
Scope:All client's on this hub.
Reason:Hardware Failure

Description: Hardware Failure in core router. Engineers are working with Cisco Tac in regard to this issue. The router is currently stable and connectivity should be restored at this time.

Telco Optical Maintenance Posted Wednesday, February 21, 2007 - 10:31 AM by Randy
Start Date:Friday, February 23, 2007 - 1:00 AM
End Date:Friday, February 23, 2007 - 2:00 AM
Scope:Customers behind Alva and Durant HubsComanche PS
Reason:Optical circuit provisioning

Description: The circuits are on optical equipment that is being moved into optic DACS. Outage is expected to last 1 hour

Telco Optical Maintenance Posted Wednesday, February 21, 2007 - 10:27 AM by Randy
Start Date:Thursday, February 22, 2007 - 1:00 AM
End Date:Thursday, February 22, 2007 - 2:00 AM
Scope:Customers behind Ada, Tishomingo and Durant Hubs.Veterans Center-ArdmoreDavis PS
Reason:Optical circuits provisioning

Description: The affected circuits are on optical equipment that is being moved into optical DACS. Outage is expected to last 1 hour

Email system maintenance Posted Monday, February 19, 2007 - 2:31 PM by Brian
Start Date:Monday, February 19, 2007 - 10:00 PM
End Date:Tuesday, February 20, 2007 - 2:00 AM
Scope:OneNet hosted email and web publishing
Reason:Remove I/O boards

Description: The OneNet email server will be down about an hour tonight to remove some I/O boards.

OneNethub-Bartlesville Customer channelized DS3 Posted Friday, February 16, 2007 - 11:15 PM by Von
Start Date:Friday, February 16, 2007 - 11:08 PM
End Date:Friday, February 16, 2007 - 11:08 PM
Scope:All customers connected to 2nd of 2 channelized DS3 (ie. Oklahoma Wesleyan University, DOH-BARTLESVILLE, DPS-Burch Lake Patrol, Bowring Public Schools, City of Bartlesville, Barnsdall Public School, etc)
Reason:Telco, SBC, repaired customer DS3 circuit.

Description: Telco repaired channelized DS3. Customer access restored at CO for all customers. Complete.

Customer channelized DS3 - Bartlesville Posted Friday, February 16, 2007 - 9:18 PM by Von
Start Date:Friday, February 16, 2007 - 4:45PM
End Date:Friday, February 16, 2007 - 9:06 PM
Scope:All customers connected to 2nd of 2 channelized DS3 (ie. Oklahoma Wesleyan University, DOH-BARTLESVILLE, DPS-Burch Lake Patrol, Bowring Public Schools, City of Bartlesville, Barnsdall Public School, etc)
Reason:Telco, SBC, experiencing circuit failure at local CO.

Description: The 2nd of 2 channelized DS3's is experiencing failure between CO and hubsite. Telco engineers are working to resolve problem. No ETA as of now. I will update when additional information is known.

Bartlesville Hub Posted Friday, February 16, 2007 - 5:05 PM by Todd
Start Date:Friday, February 16, 2007 - 5:02 PM
End Date:Friday, February 16, 2007 - 5:02 PM
Scope:Various T1's on this hub.
Reason:A CT3 has gone down that services some clients on the Bartlesville hub.

Description: We are working with ATT to determine cause of outage. No ETR at this time.

NLR - Router Maintenance Posted Friday, February 9, 2007 - 4:26 PM by Von
Start Date:Tuesday, February 13, 2007 - 10:00 PM
End Date:Tuesday, February 13, 2007 - 11:00PM
Scope:National Lamba Rail internet traffic.
Reason:Router maintenance.

Description: Router maintenance for the NLR router is to be performed to replace a failed fan tray. Traffic disruption will affect NLR traffic and should not impact the commodity internet. The downtime should be limited to 15-20 minutes, but the full maintenance window is reserved.

Tulsa web server Posted Thursday, February 1, 2007 - 8:20 PM by Stephen
Start Date:Thursday, February 1, 2007 - 8:19 PM
End Date:Thursday, February 1, 2007 - 8:19 PM
Scope:All websites on sunhub-tulsa
Reason:Storage connectivity issue

Description: Storage connectivity issue on Falconstor preventing webserver from accessing files.

National Lambda Rail link outage Posted Thursday, February 1, 2007 - 1:05 PM by Von
Start Date:Wednesday, January 31, 2007 - 9:30 PM
End Date:Thursday, February 1, 2007 - 11:00 AM
Scope:NLR traffic.
Reason:Hardware failure.

Description: Hardware failure on NLR device caused outage for customer traffic directed to National Lambda Rail. This traffic primarily impacted research traffic to NLR members. The failed device has been replaced and connectivity restored.

Connection to NLR Posted Thursday, February 1, 2007 - 8:30 AM by Randy
Start Date:Wednesday, January 31. 2007 - 2300
End Date:
Scope:NLR Connectivity
Reason:Hardware Failure

Description: Hardware Failure has affected OneNet NLR Connection - technician is enroute No ET at this time.

OKC13 Hub Posted Wednesday, January 31, 2007 - 10:00 AM by Todd
Start Date:Wednesday, January 31, 2007 - 9:55 AM
End Date:Wednesday, January 31, 2007 - 9:55 AM
Scope:Select clients on the OKC13 Hub.
Reason:Hardware Failure.

Description: Select customers were affected by a hardware failure of one of our modules on this hub router. The module has been reset and connectivity restored. The module is functional and stable at this time.

Hardware Failure Posted Wednesday, January 24, 2007 - 4:45 PM by Von
Start Date:Wednesday, January 24, 2007 - 3:40 PM
End Date:Wednesday, January 24, 2007 - 4:15 PM
Scope:Customers (ie. FAA, OUHSC, OKCPS)that directly connect to OneNet core router OKC13 only.
Reason:Hardware failure of core router.

Description: Hardware fialure on one core router caused loss of service for select customers that are directly connected to this device. The router has been recovered and internet access for the affected customers restored. Access for the affected customers is stable and no other issues are expected at this time.

El Reno, Alva, Woodward, Tonkawa Hubs Posted Wednesday, January 24, 2007 - 9:24 AM by Todd
Start Date:Wednesday, January 31, 2007 - 12:01 AM
End Date:Wednesday, January 31, 2007 - 6:00 AM
Scope:All OneNet customers connected to these hub sites.
Reason:Indian Nations Fiber Optic will be moving Optical Fiber.

Description: INFO has indicated that working fibers of an OC-48 will be moved. The outage is expected to be less than the maintenance window indicated. However, the full window will be reserved.

OneNethub-Seminole Posted Friday, January 19, 2007 - 4:17 PM by Von
Start Date:Friday, January 19, 2007 - 4:14 PM
End Date:Friday, January 19, 2007 - 4:14 PM
Scope:OneNethub-Seminole and all directly connected customers.
Reason:MBO telco circuit outage on campus.

Description: MBO telco is performing maintenance on campus at Seminole State University. Problems with telco equipment has caused DS3 link outage to the OneNet router and all customers directly connected to the site.

Seminole hub router Posted Friday, January 19, 2007 - 4:16 PM by Sam
Start Date:Friday, January 19, 2007 - 4:13 PM
End Date:Friday, January 19, 2007 - 4:13 PM
Scope:All customers behind Seminole hub router
Reason:Light Wave equipment

Description: MBO is experiencing problems with equipment at Seminole. No ET of repair

Hub Outages Posted Friday, January 19, 2007 - 9:43 AM by Randy
Start Date:Friday, January 19, 2007 - 9:41 AM
End Date:
Scope:All customers connected to McAlester and Wilburton Hub
Reason:Power failure

Description: Power failed again in the McAlester area affecting service to Wilburton and McAlester Hubs. PSO crews are working to restore power. No ETA on restoration of service.

McAlester hub router Posted Thursday, January 18, 2007 - 4:26 PM by Sam
Start Date:Thursday, January 18, 2007 - 4:23 PM
End Date:Thursday, January 18, 2007 - 4:23 PM
Scope:All customers behind McAlester hub router
Reason:Power outage

Description: Entire building without power. Power crews checking entire line, before power can be restored

Hardware Failure on OKC14 Posted Thursday, January 18, 2007 - 3:30 PM by Jerad
Start Date:Thursday, January 18, 2007 - 3:21 PM
End Date:Thursday, January 18, 2007 - 3:21 PM
Scope:T1 Customers off of the OKC13 hub router
Reason:Failure of 2 CT3's

Description: T1 customers off of the OKC13 router may have experienced a 5-10 minute outage due to the failure of 2 channelized DS3's on the router. The hardware affected was reset and connectivity was restored no further problems are expected.

Hub Outages Posted Monday, January 15, 2007 - 10:03 AM by Randy
Start Date:Monday, January 15, 2007 - 9:53 AM
End Date:
Scope:All customers connected to Warner, Wilburton and McAlester.
Reason:Power Outage due to ice storm

Description: OneNet is dispatching technicians to McAlester to restore power at Hub site. Wilburton hub outage is a telco issue and they are working to restore service.

Hub Outages Posted Sunday, January 14, 2007 - 7:13 AM by Randy
Start Date:Sunday, January 14, 2007 - 7:07 AM
End Date:
Scope:All customers behind Warner, Wilburton, McAlester, and Okmulgee Hubs
Reason:Power Outages due to ice storm

Description: Multiple power outages in Warner, Okmulgee and McAlester areas continue to affect OneNet services. MBO telephone is working to resolve power issues on their network. No ETA on service restoral at this time.

Warner Hub Outage Posted Saturday, January 13, 2007 - 3:28 PM by Randy
Start Date:Saturday, January 13, 2007 - 2:45 PM
End Date:
Scope:All customers connected to Warner Hub
Reason:Power Outage

Description: Commercial power has failed at Warner and UPS batteries have been exhausted. NO ETA on restoration of power at this time.

Okmulgee Hub Outage Posted Saturday, January 13, 2007 - 1:14 PM by Randy
Start Date:Saturday, January 13, 2007 - 12:30 PM
End Date:
Scope:All customers connected to Okmulgee
Reason:Power Outage

Description: MBO telco reports power failure on their ring. They are working to restore power and service. ETA 2 hrs.

Wilburton Hub Outage Posted Saturday, January 13, 2007 - 11:13 AM by Randy
Start Date:Saturday, January 13, 2007 - 9:12 AM
End Date:
Scope:All customers connected to Wilburton Hub
Reason:OK Western Sonet in alarm

Description: DS3 link to hub is down. Power at Wilburton is OK. Called in to MBO for resolution. NO ETA on Repair.

OKC13 Hub Site. Posted Thursday, January 11, 2007 - 2:13 PM by Todd
Start Date:Thursday, January 11, 2007 - 1:38 PM
End Date:Thursday, January 11, 2007 - 1:38 PM
Scope:Ethernet and Fast Ethernet customers.
Reason:Latency and degraded service across Gigabit connection supplied by COX.

Description: Various Ethernet and Fast Ethernet customers that ride on a Gigabit connection supplied via COX Communications are experiencing latency, packet loss, and poor response times. COX has indicated they are having a congestion issue on their network specific to this connection and are their engineers are working on a resolution at this time.

Tulsa 3 Hub Router Posted Tuesday, January 9, 2007 - 8:47 AM by Todd
Start Date:Tuesday, January 9, 2007 - 2:30 AM
End Date:Tuesday, January 9, 2007 - 8:37 AM
Scope:All Ethernet,Fast Ethernet, Gigabit Ethernet connections on Tulsa 3 hub site. Also, this outage affected the DS3 to the Claremore hub.
Reason:COX Communication equipment failure.

Description: COX communications reported that 2 DC power rectifiers failed on their fiber shelf. This caused the equipment to go down and loose it’s configuration. The redundancy that Cox had in place also failed. At this time all connectivity has been restored.

Directory server maintenance Posted Thursday, January 4, 2007 - 3:51 PM by Brian
Start Date:Thursday, January 4, 2007 - 9:00 PM
End Date:Friday, January 5, 2007 - 6:00 AM
Scope:Hosted email and web publishing
Reason:Continued work to correct index corruption on directory server

Description:

Directory Server Maintenance Posted Wednesday, January 3, 2007 - 4:47 PM by Brian
Start Date:Wednesday, January 3, 2007 - 10:00 PM
End Date:Thursday, January 4, 2007 - 6:00 AM
Scope:Hosted email and web publishing
Reason:Fix directory server index corruption

Description: The email system and directory server will be down tonight to rebuild corrupt server indexes.

OKC SAM-FS Outage Posted Wednesday, January 3, 2007 - 4:08 PM by Stephen
Start Date:Wednesday, January 5, 2007 - 5:30 PM
End Date:Wednesday, January 5, 2007 - 7:00 PM
Scope:Replace v480 centerplane on okc-sam1 (SAM-FS meta-master)
Reason:Defect in first-flight v480 centerplane causes panic in high-load scenarios.

Description: All HSM filesystems will be offline during the window, including but not limited to: mailsystem logging, netflow collection, backup/restore functionality, and customer HSM filesystems.

Restart sunhub-okc1 Posted Wednesday, January 3, 2007 - 4:05 PM by Stephen
Start Date:Wednesday, January 3, 2007 - 6:00 PM
End Date:Wednesday, January 3, 2007 - 7:00 PM
Scope:All websites hosted from OKC.
Reason:Customers experiencing high numbers of 403 - Forbidden messages while attempting to view site. Often manifests itself as broken images in a page.

Description: Problem is caused by high load on OKC1, resulting in too many open file descriptors. This reboot will increase the available file descriptors.

Email Services Posted Wednesday, January 3, 2007 - 10:52 AM by Todd
Start Date:Wednesday, January 3, 2007 - 10:46 AM
End Date:Wednesday, January 3, 2007 - 10:46 AM
Scope:All OneNet email clients.
Reason:Server outage.

Description: Directory server corruption caused email server outage. Email service is available again, but account management updates will not be processed until maintenance can be scheduled to fix directory server issues.

OKCCC hub router Posted Tuesday, December 26, 2006 - 9:00 AM by Sam
Start Date:Tuesday, December 26, 2006 - 8:57 AM
End Date:Tuesday, December 26, 2006 - 8:57 AM
Scope:all customers behind OKCCC router
Reason:fiber cut

Description: OKCCC cut fiber providing DS3IP, during data center move. Crews are on site splicing fiber. Connectivity should be restored late this afternoon.

Chickasha Hub Posted Tuesday, December 26, 2006 - 8:45 AM by Todd
Start Date:Tuesday, December 26, 2006 - 8:40 AM
End Date:Tuesday, December 26, 2006 - 8:40 AM
Scope:All T1 customers on the Chickasha Hub.
Reason:Unknown

Description: Emergency module reset failed to resovle the issue on the card these T1 connections ride. A technician is in route to investigate the MUX and or replace any appropriate hardware.

Okmulgee hub router Posted Friday, December 22, 2006 - 11:26 AM by Sam
Start Date:Friday, December 22, 2006 - 11:40 AM
End Date:Friday, December 22, 2006 - 12:10 PM
Scope:All customers behind Okmulgee hub router
Reason:Emergency hardware replacement

Description: PA bad in 3/1/1 hardware needs to be replaced. This should take approx 10 minutes, but entire window is reserved

Patch polaris Posted Monday, December 18, 2006 - 5:14 PM by Stephen
Start Date:Monday, December 18, 2006 - 10:00 PM
End Date:Monday, December 18, 2006 - 11:00 PM
Scope:Dial-up authentication, www.onenet.net, website and email administration
Reason:Correct kernel bugs that caused multiple panics in early December

Description: Apply two Solaris patches to correct a kernel panic caused by deadlocks in ufs experienced with parallel renames.

Hubsite links down Posted Monday, December 18, 2006 - 7:02 AM by Von
Start Date:Monday, December 18, 2006 - 6:52 AM
End Date:Monday, December 18, 2006 - 6:52 AM
Scope:Customers behind hubsites Enid, Alva, Durant and OKCCC.
Reason:Failed Hardware.

Description: Links to several hubsites (Enid, Alva, Durant and OKCCC) were down this morning, do to hardware failure. All customers connecting to these hubsites were directly affected during this time period. Failed hardware was reset and access to the hubsites was recovered. Links are now stable and connectivity for all customers is restored.

OneNet hosted email Posted Thursday, December 14, 2006 - 1:45 PM by Brian
Start Date:Thursday, December 14, 2006 - 10:00 PM
End Date:Friday, December 15, 2006 - 2:00 AM
Scope:All OneNet hosted email
Reason:Software patch intended to enable IE 7 support

Description: The mail system will be down tonight for a software upgrade.

Email system maintenance Posted Tuesday, December 12, 2006 - 2:00 PM by Brian
Start Date:Tuesday, December 12, 2006 - 10:00 PM
End Date:Wednesday, December 13, 2006 - 02:00 AM
Scope:All OneNet hosted email and web hosting FTP authentication.
Reason:Add additional controllers into configuration.

Description: The system will be rebooted to add additional drive controllers into the system configuration. A file system will also be grown during this maintenance window.

Optical Hardware Maintenance Posted Tuesday, December 5, 2006 - 3:37 PM by Randy
Start Date:Thursday, December 7, 2006 - 11:00 PM
End Date:Thursday, December 7, 2006 - 11:30 PM
Scope:Redundant IP connections to Stillwater, Norman and Tulsa
Reason:Hardware upgrade

Description: Optical hardware will be upgraded on each side of the ring at the OKC site. No outage is expected. This upgrade is not expected to be service affecting as traffic will reroute automaticly.

Network Maintenance Posted Sunday, December 3, 2006 - 10:55 PM by Von
Start Date:Wednesday, December 6, 2006 - 10:00 PM
End Date:Wednesday, December 6, 2006 - 11:00 PM
Scope:Internet traffic.
Reason:Routing table modifications.

Description: Routing table modifications will be made to network wide routers in order to provide enhanced stability features. There is no down time expected, but the full maintenance window is reserved.

Mail Server Outage Posted Monday, November 27, 2006 - 10:23 AM by Brian
Start Date:Monday, November 27, 2006 - 9:45 AM
End Date:
Scope:OneNet hosted Email
Reason:Server disk I/O blocked during configuration of additional disks to handle high load

Description: Server is being reset. Current ETR 11:00 AM.

Linecard Failure Posted Friday, November 24, 2006 - 9:30 AM by Von
Start Date:Friday, November 24, 2006 - 9:05 AM
End Date:Friday, November 24, 2006 - 9:05 AM
Scope:Customers connected to OKC14 (Select ARNG's, DOH's, Tag Agencies and City of Moore)
Reason:Hardware failure of router linecard.

Description: Hardware failure of linecard in local router(OKC14) that services wide range of customer base(Select ARNG's, DOH's, Tag Agencies, City of Moore) went into a failed state causing loss of connection to all customers with direct links to router on linecard #4. Linecard has been recovered and links stablized. All customers access is now fully operational.

Idabel Hub Posted Monday, November 20, 2006 - 3:57 PM by Todd
Start Date:Monday, November 20, 2006 - 3:55 PM
End Date:Monday, November 20, 2006 - 3:55 PM
Scope:All customers on the Idabel hub.
Reason:Fiber Cut

Description: ATT is reporting they will begin fiber splicing at 4 p.m. CST. No estimated time of repair has been given by ATT.

Idabel Hub Posted Monday, November 20, 2006 - 2:40 PM by Todd
Start Date:Monday, November 20, 2006 - 2:37 PM
End Date:Monday, November 20, 2006 - 2:37 PM
Scope:All customers on the Idabel hub site.
Reason:ATT fiber cut.

Description: ATT has reported a fiber cut in the Idabel area that is service affecting for all surrounding areas.

Webmail and Microsoft Internet Explorer 7 Posted Tuesday, November 14, 2006 - 5:01 PM by Brian
Start Date:
End Date:
Scope:All OneNet hosted email customers using the web mail interface.
Reason:Significant changes in Internet Explorer's handling of JavaScript between IE 6 and IE 7

Description: After further investigation, much of the functionality of web mail does not work with IE 7, including replying to messages and composing messages in HTML format. This makes IE 7 virtually unusable for web mail. At this time, OneNet recommends staying at IE version 6 or using Firefox or another standards-compliant browser to access OneNet web mail.

Internet Issues Posted Tuesday, November 14, 2006 - 3:52 PM by Von
Start Date:Tuesday, November 14, 2006 - 3:31 PM
End Date:Tuesday, November 14, 2006 - 3:31 PM
Scope:Internet traffic.
Reason:Up stream provider experienced hardware failure.

Description: Hardware failure by one of our upstream providers created a brief loss of internet connectivity for portions of OneNets customer base around 11:30 today. Data traffic overflowed to alternate provider links, but do to the high volume of traffic at the time, it did not gracefully failover.

All upstream provider issues have been repaired and traffic flow has been fully restored.

Webmail and Microsoft Internet Explorer 7 Posted Tuesday, November 14, 2006 - 11:26 AM by Brian
Start Date:
End Date:
Scope:All OneNet hosted email customers using the web mail interface.
Reason:Significant changes in Internet Explorer's handling of JavaScript between IE 6 and IE 7

Description: The options tab in web mail does not function correctly in Internet Explorer 7. To our knowledge, all other functions of web mail work correctly. Sun Microsystems has informed us that IE 7 will not be supported in our current version. OneNet is working on a migration to a newer version of the product, but we have no ETA on the upgrade. In the meantime, customers will need to use IE 6 or earlier or a standards compliant browser such as Firefox (http://www.mozilla.com). Microsoft is pushing IE 7 as a high priority update. They have provided information on how to stop the update from happening automatically at http://www.microsoft.com/technet/updatemanagement/windowsupdate/ie7announcement.mspx

Seminole Hub Outage Posted Friday, November 10, 2006 - 8:24 AM by Randy
Start Date:Friday, November 10, 2006 - 7:40 AM
End Date:Friday, November 10, 2006 - 8:22 AM
Scope:All customers connected to Seminole Hub
Reason:Hardware Failure

Description: Telco has hardware failure on link circuit. Telco forced link circuit to protect hardware until hardware can be replaced later today. No further outage is expected with this issue.

Emergency email system maintenance Posted Thursday, November 9, 2006 - 4:34 PM by Brian
Start Date:Thursday, November 9, 2006 - 8:00 PM
End Date:Friday, November 10, 2006 - 2:00 AM
Scope:All OneNet hosted email
Reason:Repair failing I/O boards and add CPU/Memory board

Description: The OneNet email system will be down this evening to replace failing hardware. The outage should be 2-3 hours, but the entire window is reserved.

Router Maintenance in Tulsa Posted Wednesday, November 8, 2006 - 12:25 PM by Von
Start Date:Wednesday, November 8, 2006 - 11:00 PM
End Date:Wednesday, November 8, 2006 - 11:30 PM
Scope:All customer behind the following hubsites : Sallisaw, Poteau, Claremore, Bartlesville
Reason:Hardware failure.

Description: Maintenance is required to repair a hardware issue to OneNethub-Tulsa2. The linecard supporting the hubsites Sallisaw, Poteau, Claremore and Bartlesville are directly connected and experiencing intermittent loss due to module failure. Replacement equipment will be installed to resolve issue.

State Fiber Cable Re-Termination Work in Tulsa Posted Wednesday, November 8, 2006 - 9:14 AM by Bill Davis
Start Date:Wednesday, November 15, 2006 - 6:00 PM
End Date:Thursday, November 16, 2006 - 4:00 AM
Scope:Fibers for Tulsa-OSF, OSU-Tulsa (UCT), and OSU-CHS (OCOM) on the State Tulsa Metro Fiber Cable will be be re-terminated to use ST connectors and cross-connect equipment will be replaced. OSU services will not be interrupted until 10 pm.
Reason:Legacy D4 type connectors on these fibers are failing and causing reliability problems. Interfacing to these connectors has become troublesome. Future service upgrades require OneNet to correct these problems.

Description: Chickasaw Telecom techs will replace connectors as appropriate. Customer jumper connector terminations will also be replaced as required to interface with the new cross-connect equipment. Tulsa OSF services are fiber protected and will remain online during the work. Fiber work on the OSU-Tulsa and OSU-CHS services will not start until 10 pm. These two services will go down during the service window.

Tulsa Core 2 Router Posted Tuesday, November 7, 2006 - 6:28 PM by Von
Start Date:Tuesday, November 7, 2006 - 4:20 PM
End Date:Tuesday, November 7, 2006 - 4:55PM
Scope:Hubsites - Sallisaw, Poteau, Bartlesville, Claremore
Reason:Hardware failure.

Description: Router hardware linecard failed causing loss of connectivity to select hubsites - Sallisaw, Poteau, Bartlesville, Claremore and all customers directly connected. Hardware was reset and access was restored. Router is stable with no further outage expected.

Email system maintenance Posted Monday, November 6, 2006 - 6:16 PM by Brian
Start Date:Monday, November 7, 2006 - 10:00 PM
End Date:Tuesday, November 8, 2006 - 02:00 AM
Scope:All OneNet hosted email
Reason:Enable replacement system board

Description: This will be a reboot of the server to enable the replacement system board. Actual down time should be less than 30 minutes.

Okmulgee Hub Posted Friday, November 3, 2006 - 11:04 AM by Todd
Start Date:Friday, November 3, 2006 - 12:00 PM
End Date:Friday, November 3, 2006 - 12:05 PM
Scope:All customers on the Okmulgee
Reason:Emergency Router Maintenance

Description: Emergency router maintenance will be performed in effort to resolve a router issue. The expected window will be from 12:00 P.M. to 12:05 P.M. A temporary loss in connectivity is expected. The outage should be less than the 5 minute window. However, the entire window is reserved if needed. Thank you.

Email system maintenance Posted Thursday, November 2, 2006 - 2:57 PM by Brian
Start Date:Thursday, November 2, 2006 - 6:00 PM
End Date:Thursday, November 2, 2006 - 8:00 PM
Scope:All OneNet hosted Email
Reason:System maintenance

Description: A system board will be replace at 6:00 this evening. This maintenance should not be service affecting.

Idabel Hub Maintenance Outage Posted Thursday, November 2, 2006 - 11:32 AM by Randy
Start Date:Friday, November 17, 2006 - 11:00 PM
End Date:Saturday, November 18, 2006 - 5:00 AM
Scope:All customers connected to Idabel Hub Site
Reason:Equipment relocation

Description: OneNet and ATT equipment must be relocated to new datacenter on campus.

El Reno hub site connectivity. Posted Thursday, November 2, 2006 - 8:46 AM by Todd
Start Date:Thursday, November 3, 2006 - 12:00 AM
End Date:Thursday, November 3, 2006 - 12:45 AM
Scope:All customers on the El Reno hub site.
Reason:Fiber move/splice.

Description: Pioneer Telephone is having to move a fiber-optic connection due to the contstruction needs of the Oklahoma Department of Transportation. The fiber move is scheduled for 12:00 A.M. to 12:45 A.M.

MCU Resgistration Posted Tuesday, October 31, 2006 - 8:34 AM by Randy Bishop
Start Date:Tuesday, October 31, 2006 - 8:25 AM
End Date:Tuesday, October 31, 2006 - 8:25 AM
Scope:MCU Conferences not registering with gatekeeper.
Reason:We are currently investigating the cause.

Description: Multiple MCU's not registering conferences with out gatekeeper. Some conferences may not be available at the present time. We can set temporary conferences up for anyone that needs one on alternate MCU's.

DNS Services Posted Friday, October 27, 2006 - 11:24 AM by Todd
Start Date:Friday, October 27, 2006 - 11:16 AM
End Date:Friday, October 27, 2006 - 11:16 AM
Scope:All Customers using OneNet DNS services.
Reason:Issue with OneNet internal firewall.

Description: OneNet DNS services interupted due to an issue with OneNet internal firewall. Engineers have resolved the issue and services have been restored.

Hub Outage Posted Thursday, October 26, 2006 - 9:00 AM by Randy
Start Date:Thursday, October 26, 2006 - 8:30 AM
End Date:Thursday, October 26, 2006 - 8:44 AM
Scope:Customers behind Goodwell, OSUOKC and MWC Hubs
Reason:Hardware problem on OKC Hub router card

Description: DS3 Links to specific hub sites went down due to hardware fault. The hardware was reset on OKC core router and service restored. The hardware fault is being reviewed by engineers and may require replacement at a later time.

Tonkawa hub router Posted Monday, October 23, 2006 - 4:33 PM by Sam
Start Date:Tuesday, October 24, 2006 - 10:00 PM
End Date:Tuesday, October 24, 2006 - 10:30 PM
Scope:All customers behind Tonkawa hub router
Reason:Hardware replacement

Description: Board in slot 3 needs to be replaced. This should take 15 minutes, but entire window is reserved

Internet traffic Posted Tuesday, October 17, 2006 - 4:20 PM by Von
Start Date:Tuesday, October 17, 2006 - 2:01 PM
End Date:Tuesday, October 17, 2006 - 2:01 PM
Scope:Internet traffic from service provider in Tulsa(Level3).
Reason:Routing issues.

Description: Routing issues within the core routers caused high latency and intermittent loss of connectivity. Routing is now stable and traffic flow has returned to normal.

Tishomingo Hubsite Router Posted Saturday, October 14, 2006 - 8:02 PM by Sidney
Start Date:Saturday, October 14, 2006 - 8:00 PM
End Date:Saturday, October 14, 2006 - 8:00 PM
Scope:All customers behind the Tishomingo Hubsite Router
Reason:Internet Service Interruption

Description: The Internet Services provided to the Tishomingo area via the OneNet Tishimingo Hubsite router were related to Fiber Equipmentin OKC which had lost sync with the circuit. The device has been reset and service to the area has been rstored.

Tonkawa Hub Posted Friday, October 13, 2006 - 1:35 PM by Todd
Start Date:Friday, October 13, 2006 - 1:33 PM
End Date:Friday, October 13, 2006 - 1:33 PM
Scope:All customer on the Tonkawa Hub.
Reason:Card reset.

Description: The DS3 card was reloaded and connectvity has been restored. Total outage time was from 12:52 p.m. to 1:24 p.m.

McAlester Hub Maintenance Posted Wednesday, October 11, 2006 - 4:47 PM by Randy
Start Date:Thursday, October 12, 2006 - 6:00 AM
End Date:Thursday, October 12, 2006 - 6:30 AM
Scope:Customers connected to McAlester Hub
Reason:link circuit taking errors

Description: moving the link circuit to alternate path to isolate problem. Outage is expected to be less than 5 min. but entire window is reserved

Network maintenance Posted Wednesday, October 11, 2006 - 12:23 PM by Von
Start Date:Friday, October 13, 2006 - 11:00 PM
End Date:Friday, October 14, 2006 - 1:00 AM
Scope:OneNet commodity and internal internet connectivity.
Reason:Network maintenance.

Description: Network maintenance will be performed on several core routers that will cause intermittent internet access loss during the course of the maintenance window.

Woodward hub router Posted Wednesday, October 11, 2006 - 10:24 AM by Sam
Start Date:Thursday, October 12, 2006 - 10:00 PM
End Date:Thursday, October 12, 2006 - 10:30 PM
Scope:All customers behind Woodward hub router
Reason:IOS upgrade

Description: IOS upgrade on boths sups

Woodward hub router Posted Wednesday, October 11, 2006 - 10:24 AM by Sam
Start Date:Thursday, October 12, 2006 - 10:00 PM
End Date:Thursday, October 12, 2006 - 10:30 PM
Scope:All customers behind Woodward hub router
Reason:IOS upgrade

Description: IOS upgrade on boths sups

Email services Posted Tuesday, October 10, 2006 - 9:42 AM by Todd
Start Date:Tuesday, October 10, 2006 - 9:45 AM
End Date:Tuesday, October 10, 2006 - 10:15 AM
Scope:All OneNet email customers.
Reason:Emergency SMTP server reload.

Description: OneNet system engineers will be rebooting our SMTP server due to back up issues related to the server. The expected outage is 15 minutes. However, the entire window may be reserved. Thank You.

Claremore hub router Posted Tuesday, October 10, 2006 - 7:54 AM by Sam
Start Date:Tuesday, October 10, 2006 - 11:59 PM
End Date:Wednesday, October 11, 2006 - 1:00 AM
Scope:All customers behind Claremore hub router
Reason:Emergency maintenance

Description: Cox will be performing emergency maintenance of fiber to Claremore hub.

OKC13 Router Reload Posted Friday, October 6, 2006 - 11:34 AM by Jerad
Start Date:Friday, October 6, 2006 - 11:18 AM
End Date:Friday, October 6, 2006 - 11:18 AM
Scope:All OneNet customers connected to OKC13
Reason:Memory exception and software bug

Description: OneNet had to enact an emergency reboot of the OKC13 router due to a memory exception causing it to be non-responsive. OKC13 was intermittently down for approx. 45 minutes and is now fully operational. Further root cause is being investigated with the assistance of Cisco.

Warner Hub Posted Monday, October 2, 2006 - 4:18 PM by Todd
Start Date:Monday, October 2, 2006 - 3:08 PM
End Date:Monday, October 2, 2006 - 3:25 PM
Scope:Customers connected to the Warner Hub site.
Reason:Power outage to Warner Area.

Description: The Warner hub experienced a temporary power outage in the Warner area. Power is now restored. The total outage time for the Warner hub was 17 minutes.

Core Upgrade/Reload Posted Friday, September 29, 2006 - 5:37 PM by Jerad
Start Date:Friday, September 29, 2006 - 10:00 PM
End Date:Friday, September 29, 2006 - 12:00 AM
Scope:OneNet Customers
Reason:Emergency upgrade to eliminate ongoing routing issues

Description: A staged upgrade and reload of OneNet’s core routing infrastructure is necessary to eliminate the ongoing intermittent routing issues. Core redundancy will enable traffic flow during the upgrade however brief periods of service interruption can be expected. Customers behind the Bartlesville, Claremore, Miami, Muskogee, Poteau, Sallisaw and Tahlequah hub routers will experience service interruption. The expected downtime is 15 minutes but the entire maintenance window is reserved.

Routing Issues Posted Friday, September 29, 2006 - 10:39 AM by Todd
Start Date:Friday, September 29, 2006 - 10:35 AM
End Date:Friday, September 29, 2006 - 10:35 AM
Scope:OneNet Customers
Reason:Routing Issues

Description: OneNet is still experiencing ongoing routing issues. Our Network Engineers are continuing to work toward a resolution to the routing issues. We currently have no estimated time of repair. Thank you for your patience.

TulsaCore IOS Upgrade Posted Thursday, September 28, 2006 - 6:09 PM by Jerad
Start Date:Thursday, September 28, 2006 - 6:07 PM
End Date:Thursday, September 28, 2006 - 6:07 PM
Scope:Customers behind the Muskogee, Tahlequah, and Miami hub routers.
Reason:Critical IOS issue.

Description: Emergency IOS upgrade to one of OneNet's core Tulsa routers in order to resolve ongoing routing issues. Expected downtime is 30 minutes but the entire window is reserved.

Routing Posted Thursday, September 28, 2006 - 4:19 PM by Todd
Start Date:Thursday, September 28, 2006 - 4:16 PM
End Date:Thursday, September 28, 2006 - 4:16 PM
Scope:OneNet Customers
Reason:Routing issues

Description: OneNet is experiencing ongoing routing issues impacting a small number of reported paths between a core router and an up stream provider. Our Network Engineers are currently working to resolve the issues. We currently have no estimated time of repair. Another update will be posted upon resolution.

Fiber Cut Posted Wednesday, September 27, 2006 - 5:58 PM by Sidney
Start Date:Wednesday, September 27, 2006 - 5:52 PM
End Date:Wednesday, September 27, 2006 - 5:52 PM
Scope:Tulsa links to NLR & OSF are down.
Reason:Fiber cut

Description: Fiber cut in Tulsa area due to road construction at Greenwood & Archer. Crews have been dispatched to effect repairs. OSF Fiber is fault-tolerant, and OneNet traffic is re-routed through OKC links. Crews will work to restore services as fast as possible.

Tonkawa Hub Maintenance Posted Wednesday, September 27, 2006 - 10:03 AM by Randy
Start Date:Thursday, September 28, 2006 - 10:00 PM
End Date:Thursday, September 28, 2006 - 11:00 PM
Scope:All customers connected to Tonkawa Hub
Reason:Router Maintenance

Description: The router must be upgraded requiring a power down of the unit. the maintenance window is expected to last 15 minutes but entire window is reserved.

Email System Maintenance Posted Tuesday, September 19, 2006 - 10:58 AM by Brian
Start Date:Tuesday, September 19, 2006 - 10:00 PM
End Date:Wednesday, September 20, 2006 - 2:00 AM
Scope:All OneNet hosted email
Reason:Software update

Description: The email system will be taken down this evening for a software update. This should correct some issues with new versions of Internet Explorer and webmail.

Email System Maintenance Posted Tuesday, September 19, 2006 - 10:58 AM by Brian
Start Date:Tuesday, September 19, 2006 - 10:00 PM
End Date:Wednesday, September 20, 2006 - 2:00 AM
Scope:All OneNet hosted email
Reason:Software update

Description: The email system will be taken down this evening for a software update. This should correct some issues with new versions of Internet Explorer and webmail.

Limited Connectvity Outage Posted Thursday, September 14, 2006 - 3:38 PM by Todd
Start Date:Thursday, September 14, 2006 - 3:31 PM
End Date:Thursday, September 14, 2006 - 3:31 PM
Scope:Various Ethernet and Fast Ethernet customers on one of the OKC hubs.
Reason:Cox Hardware failure

Description: Cox had a card failure on a Gigabit connection that various circuits ride over. The card was reset and appears to be stable at this time.

Tonkawa Hub Posted Wednesday, September 13, 2006 - 8:20 AM by Todd
Start Date:Wednesday, September 13, 2006 - 8:15 AM
End Date:Wednesday, September 13, 2006 - 8:15 AM
Scope:All Customers off the Tonkawa hub will be down.
Reason:Unknown

Description: Emergency reload done this morning completed. The main connection that supplies the hub did not recover upon reload. Engineers working issue at this to time to restore connectivity.

Tonkawa Router Reload Posted Tuesday, September 12, 2006 - 12:13 PM by Sidney
Start Date:Wednesday, September 13, 2006 - 7:00 AM
End Date:Wednesday, September 13, 2006 - 7:30 AM
Scope:All Customers connected to the Tonkawa Hubsite Router are affected.
Reason:IOS software is inhibiting certain router functions, requiring the router to be rebooted.

Description: The router will be reloaded to clear software related issues that have cause certain IOS processes to hang intermittently. The reload is expected to take 5-10 minutes. The full window is reserved for router maintenance and verification of operation.

Web Hosting Server and Storage Upgrade Posted Tuesday, September 12, 2006 - 11:51 AM by Brian
Start Date:Tuesday, September 12, 2006 - 10:00 PM
End Date:Wednesday, September 13, 2006 - 2:00 AM
Scope:Most of OneNet hosted web services.
Reason:Server and storage upgrade.

Description: We will be replacing the primary web server hardware this evening to address recent load issues.

Router reload Posted Thursday, September 7, 2006 - 2:07 PM by Sidney
Start Date:Friday, September 8, 2006 - 7:00 AM
End Date:Friday, September 8, 2006 - 8:00 AM
Scope:All Customers connected to the Durant Hubsite Router
Reason:Router experienced a forced crash this morning at 5:50AM.

Description: The router will be reloaded to re-initiate the primary supervisor engine which experienced a forced crash this morning. The reload will determine if the device failed due to hardware or software, and will also contribute to recovery of certain customer connections impacted by the crash.

Scheduled maintenance for firewalls for hosted Exchange email service Posted Thursday, September 7, 2006 - 12:40 PM by David
Start Date:Monday, September 11, 2006 - 10:00 PM
End Date:Tuesday, Septermber 12, 2006 - 12:00AM
Scope:The Ardmore Higher Education Center and the Regional University System of Oklahoma will be without email service for the two hour window
Reason:Hardware upgrade

Description: The hosted services Cisco PIX 515 firewalls with have RAM upgrades installed

OneNethub-Okmulgee Emergency Maintenance Posted Tuesday, September 5, 2006 - 9:52 AM by Von
Start Date:Tuesday, September 5, 2006 - 12:00 PM
End Date:Tuesday, September 5, 2006 - 12:15 PM
Scope:All customers connected to Okmulgee hubsite.
Reason:Bad hardware causing loss of connectivity for dozens of customers.

Description: Network line cards must be replaced to resolve local network outage that could effect dozens of customers.

Goodwell hub router Posted Tuesday, September 5, 2006 - 9:25 AM by Sam
Start Date:Tuesday, September 5, 2006 - 9:22 AM
End Date:Tuesday, September 5, 2006 - 9:22 AM
Scope:All customers behind Goodwell hub router
Reason:electrical power

Description: Router rebooted from power on. Howard at Goodwell reports power OK.

Web hosting storage problems Posted Wednesday, August 30, 2006 - 11:40 AM by Brian
Start Date:Wednesday, August 30, 2006 - 11:00 AM
End Date:Wednesday, August 30, 2006 - 1:30 PM
Scope:Much of OneNet hosted web services
Reason:Storage system problems

Description: We are experiencing problems with our backed storage system that hosts storage for a main web hosting server. Engineers are working on the issue. ETR 12:30 PM

New ETR 1:30.

Service restored at 1:15 PM

Email system restart Posted Wednesday, August 30, 2006 - 9:32 AM by Brian
Start Date:Wednesday, August 30, 2006 - 10:00 PM
End Date:Wednesday, August 30, 2006 - 10:30 PM
Scope:All OneNet hosted email
Reason:Restart of message store is required to clear some stale locks that are affecting a small number of users

Description: The message store will be restarted. Actual outage should be less than 10 minutes. Access to mailboxes will be unavailable during the outage.

OneNethub-Altus T1 customer access restored Posted Monday, August 28, 2006 - 6:50 AM by Von
Start Date:Monday, August 28, 2006 - 6:46 AM
End Date:Monday, August 28, 2006 - 6:46 AM
Scope:SBC channelized DS3 customers (all T1 customers) connected to OneNethub-Altus (DPS-TroopM, Quartz Mtn, DOH-Altus, DOT-Altus, DOC-OK State Reform, Office of Juvenile Affairs-Tillman&Harmon, etc...)
Reason:SBC repairs complete.

Description: SBC has completed the repairs to the damaged equipment and all customer access for the T1 customers off OneNethub-Altus has been restored.

OneNethub-Altus T1 customer outage update Posted Sunday, August 27, 2006 - 11:09 PM by Von
Start Date:Sunday, August 27, 2006 - 11:03 PM
End Date:Monnday, August 28, 2006 - 2:00 AM (ETA)
Scope:SBC channelized DS3 customers (all T1 customers) connected to OneNethub-Altus (DPS-TroopM, Quartz Mtn, DOH-Altus, DOT-Altus, DOC-OK State Reform, Office of Juvenile Affairs-Tillman&Harmon, etc...)
Reason:Lightning strike damaged Southwestern Bell equipment at Altus campus location.

Description: SBC reports new ETA of approximately 2:00 AM

OneNethub-Ada power restored Posted Sunday, August 27, 2006 - 9:33 PM by Von
Start Date:Sunday, August 27, 2006 - 9:29 PM
End Date:Sunday, August 27, 2006 - 9:29 PM
Scope:All customer connected to OneNethub-Ada (East Central University, DOH[Ada, Colgate, PaulsValley, Sulphur], DOT-Ada, Potontoc VT, etc....)
Reason:Power restored.

Description: Power has been restored to hubsite and customer access restored.

OneNethub-Altus Posted Sunday, August 27, 2006 - 7:37 PM by Von
Start Date:Sunday, August 27, 2006 - 1:30 PM
End Date:No ETA, several hours at least
Scope:SBC channelized DS3 customers (all T1 customers) connected to OneNethub-Altus (DPS-TroopM, Quartz Mtn, DOH-Altus, DOT-Altus, DOC-OK State Reform, Office of Juvenile Affairs-Tillman&Harmon, etc...)
Reason:Lightning strike.

Description: Thunderstorm with lightning struck communications tower on Western Oklahoma State College campus, knocking out select segments of customer communication links. Southwestern Bell and OneNet techs are in route to repair. ETA is several hours at the least.

OneNethub-Ada Posted Sunday, August 27, 2006 - 6:04 PM by Von
Start Date:Sunday, August 27, 2006 - 7:20 AM
End Date:No ETA
Scope:All customer connected to OneNethub-Ada (East Central University, DOH[Ada, Colgate, PaulsValley, Sulphur], DOT-Ada, Potontoc VT, etc....)
Reason:Power outage.

Description: Power outage at hubsite. All customer connected are affected. ETA several hours, no firm time.

Tonkawa Hubsite IOS Reload Posted Wednesday, August 23, 2006 - 11:29 PM by Sidney
Start Date:Friday, August 25, 2006 - 10:00 PM
End Date:Friday, August 25, 2006 - 11:00 PM
Scope:Local Users on the Tonkawa Hubsite.
Reason:Hardware replaced in Tonkawa on 08/22/2006 will be updated to Cisco IOS version containing encryption options necessary for network security.

Description: Hardware replacement at Tonkawa w/IOS image upgrade which includes encryption. A system reload is required to activate the software, the operation requires 10 minutes to complete, only local users are temporarily affected. The entire window is reserved for the reload.

PIX Firewall Failover Reset Posted Wednesday, August 23, 2006 - 11:15 PM by Sidney
Start Date:Thursday, August 24, 2006 - 10:00 PM
End Date:Thursday, August 24, 2006 - 11:00 PM
Scope:Agency PIX Firewall Failover Operations
Reason:Reset the Primary/Seconday Active/Standby status; Test redundancy.

Description: The Agency PIX Firewalls for the Regents internal network is being reset to verify redundancy & failover operations prior to upgrade to newer OS. This operation is non-impacting to Commodity Internet, NLR & Internet-2 Customers. Failover/Reset is expected to take 30 minutes to complete, but the entire window is reserved for this operation.

Norman Fiber Relocation Posted Wednesday, August 23, 2006 - 3:20 PM by Randy
Start Date:Wednesday, August 30, 2006 - 9:00 AM
End Date:Wednesday, August 30, 2006 - 5:00 PM
Scope:Customers connected to Norman Hub
Reason:Fiber and equipment must be relocated for construction on OU campus

Description: Connectivity will be maintained by protection path during relocation. This maintenance is Not expected to be service affecting.

Norman Hub Maintenance Posted Wednesday, August 23, 2006 - 3:14 PM by Randy
Start Date:Friday, August 25, 2006 - 2:00 PM
End Date:Friday, August 25, 2006 - 2:30 PM
Scope:Customers connected to Norman Hub router
Reason:Link Maintenance

Description: Link between Norman routers requires maintenance. Maintenance is Not expected to be service affecting. This work must be completed prior to scheduled fiber maintenance.

Tonkawa Router Hardware Replacements Posted Monday, August 21, 2006 - 4:52 PM by Sidney
Start Date:Tuesday, August 21, 2006 - 11:00 PM
End Date:Wednesday, August 22, 2006 - 1:00AM
Scope:Hardware modules in the Tonkawa Hubsite Router need to be replaced.
Reason:Local Power interrupted Hubsite router operations.

Description: The Tonkawa router is being scheduled for hardware replacement due to router processes that were interrupted during power problems experienced last week. The full window is reserved for completion of the maintenance work required.

NLR 10Gig Down Posted Saturday, August 19, 2006 - 4:34 PM by Bill Davis
Start Date:Saturday, August 19, 2006 - 4:26 PM