Cobalt Technology Status - Incident history

Holliday Area Degraded

Mon, 27 Oct 2025 15:57:00 +0000

Type: Incident

Duration: 7 days, 1 hour and 46 minutes

Affected Components:

Oct 27, 15:57:00 GMT+0
Investigating - There is currently a primary transport path over fiber that is down. Backup links are engaged but performance may be lower than expected at times..

Nov 3, 17:43:24 GMT+0
Resolved - This incident has been resolved..

Hwy 79 South Storm Damage

Mon, 18 Aug 2025 16:12:43 +0000

Type: Incident

Duration: 1 day, 2 hours and 26 minutes

Affected Components:

Aug 18, 16:12:43 GMT+0
Investigating - Lightning struck the tower and damaged a large portion of equipment on the tower. We are putting together a repair plan. We expect to have a crew on site first thing in the morning to replace all the equipment. .

Aug 19, 14:22:29 GMT+0
Identified - Our Tower crew is on site and in the progress of making repairs. We expect the first group of customers to come back online around 11 am. .

Aug 19, 18:39:04 GMT+0
Resolved - The equipment has been repaired and all customers should be back online. If you are still having connectivity issues, please call our office for individual support at 940-463-0040..

Iowa Park Power Issue

Mon, 11 Aug 2025 23:11:05 +0000

Type: Incident

Duration: 19 hours and 23 minutes

Affected Components:

Aug 12, 18:33:41 GMT+0
Resolved - We have restored service to the last few remaining customers. .

Aug 11, 23:11:05 GMT+0
Investigating - We are investigating a power-related issue due to the severe lightning storm currently over Iowa Park. A portion of customers in the rural areas South of Iowa Park are offline. We will add an update when the source of the issue is discovered. .

Aug 12, 02:27:26 GMT+0
Identified - A piece of equipment was damaged by lightning. It is not safe to climb the tower until the storm passes, so we have our tower crew scheduled to come out first thing on the morning to perform the repairs. The incident is isolated to this one tower, and only 30% of the customers on the tower are experiencing an issue. .

Aug 12, 16:54:35 GMT+0
Monitoring - Our Tower crew arrived this morning and has replaced almost all of the equipment in question. Service to all but five customers has been restored. We are going to continue working on restoring the last five customers..

Holliday Tower Battery Maintenance In Early Morning Hours of Wednesday, June 18th

Wed, 18 Jun 2025 06:00:00 +0000

Type: Maintenance

Duration: 3 hours

Affected Components:

Jun 18, 09:00:00 GMT+0
Completed - Maintenance has completed successfully.

Jun 18, 06:00:00 GMT+0
Identified - Due to the potential of storms later this week, we will be replacing and upgrading the battery backup system at our Holliday tower during the early morning hours of Wednesday, June 18th. Upgrading the power systems requires us to disable power while work is performed. We expect the site to be offline between 1 AM and 4 AM. Once the upgrade is complete, we will have a brand new battery system capable of sustaining prolonged power outages without affecting customers. .

Jun 18, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Potential Storm Damage to Wichita Falls and Iowa Park Towers

Tue, 3 Jun 2025 22:40:54 +0000

Type: Incident

Duration: 2 hours and 6 minutes

Affected Components: , ,

Jun 3, 22:40:54 GMT+0
Investigating - We are currently investigating an outage caused by the damaging storm currently impacting the Wichita Falls area..

Jun 3, 23:30:00 GMT+0
Identified - A lightning arrestor at one of our main towers did its job and absorbed a direct strike. We replaced the unit and have brought almost all customers back online. There are still a few offline that we are working to resolve. .

Jun 4, 00:47:22 GMT+0
Resolved - All equipment is back online. The lightning arrestor did its job and prevented damage to other equipment. Service has been restored. .

Power Outage In Holliday

Fri, 23 May 2025 00:38:11 +0000

Type: Incident

Duration: 56 minutes

Affected Components:

May 23, 00:38:11 GMT+0
Investigating - One of our two towers in Holliday is having a power issue. We are investigating the problem and hope to have a quick resolution. .

May 23, 01:34:06 GMT+0
Resolved - Oncor has an outage in the area. We switched the tower to generator power. .

Degraded Network Performance

Thu, 15 May 2025 13:00:00 +0000

Type: Incident

Duration: 8 hours and 41 minutes

Affected Components: , , , , , , ,

May 15, 13:00:00 GMT+0
Investigating - We are investigating an issue causing connectivity issues to specific websites. Internet service is online across our network, but some websites are having issues loading. We are investigating the root cause of the issue and will bring a resolution ASAP. .

May 15, 18:40:36 GMT+0
Identified - We have identified the source of the connectivity issues. Many of Amazon AWS's servers are unreachable from our network, pointing towards a routing issue with an upstream provider or Amazon. We are working with Amazon engineers to resolve the issue. This will affect customer connections due to the fact that a large amount of websites and services are hosted on Amazon's web servers. .

May 15, 20:52:32 GMT+0
Identified - We are in contact with Amazon AWS engineers, but they have not provided an estimated time to restoration. All other services are operational. .

May 15, 21:41:15 GMT+0
Monitoring - We have implemented a fix for the Amazon AWS connectivity issues, and it appears to have resolved the problems. We will continue to monitor the situation to see if any additional fixes are needed. .

May 15, 21:41:15 GMT+0
Resolved - This incident has been resolved. We got confirmation from Amazon's network engineers that they were having issues with websites hosted in their datacenters, which caused a cascading affect across internet service providers. The problem was resolved at 4:41 PM today. .

Maintenance During Early Morning Hours of Thursday, May 15th.

Thu, 15 May 2025 06:00:00 +0000

Type: Maintenance

Duration: 4 hours

Affected Components: ,

May 15, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

May 15, 10:00:00 GMT+0
Completed - Maintenance has completed successfully.

May 15, 06:00:00 GMT+0
Identified - We are planning for a maintenance in the early morning hours of tomorrow, May 15th, 2025, to upgrade and replace battery backup systems at 3 of our towers. The goal of this maintenance is to ensure power outages do not cause disruptions in our internet services. Maintenance will be done during the hours of lowest network usage so as to reduce impact on customers. During this time, customers should expect intermittent connectivity at the sites listed below, as equipment will be unplugged and transitioned to the upgraded power systems..

Storm Damage in Lakeside City

Wed, 30 Apr 2025 13:42:44 +0000

Type: Incident

Duration: 1 day, 3 hours and 33 minutes

Affected Components: ,

Apr 30, 13:42:44 GMT+0
Investigating - We are currently dealing with a power related issue at our Lakeside City Tower. We have two towers that cover the city, so only some customers are affected. We are working quickly to resolve the issue..

Apr 30, 14:07:47 GMT+0
Identified - After on-site assessment, it appears the tower took a direct lightning strike around 7 AM, which burned through all the surge suppression equipment in the cabinet. We have a lot of spares on hand, and are working to resolve it. .

Apr 30, 16:50:03 GMT+0
Identified - We are continuing to work on a fix for this incident. We have replaced several key components of the surge suppression system, but service has not been restored. The next step is to climb the tower and assess which equipment needs to be replaced. We are continuing to monitor storms in the area to find a suitable time to climb. .

Apr 30, 18:07:19 GMT+0
Identified - We have restored connectivity to our tower covering Hwy 79 S and are continuing to work towards a resolution for Lakeside City. A tower climb will be required to fully restore connection on the Lakeside City Tower..

Apr 30, 21:23:51 GMT+0
Identified - Repairs are continuing. We expect to have 50% of the customers back online by 7:00 p.m. today. Due to the extensive nature of the equipment damage, the remainder of the customers will be addressed tomorrow on a case-by-case basis..

May 1, 03:16:31 GMT+0
Identified - We have restored service to most customers in the Lakeside City area. Only 18 remainin without service, and we will be addressing each one individually to upgrade their equipment to our new Fiber-fed service. We have reached out to each one individually to schedule appointments. .

May 1, 17:16:00 GMT+0
Resolved - This incident has been resolved. Tower equipment has been repaired and all 18 remaining customers have been swapped to Fiber-Fed equipment..

Iowa Park City Limits Tower Upgrade

Fri, 25 Apr 2025 16:00:00 +0000

Type: Maintenance

Duration: 6 hours

Affected Components:

Apr 25, 22:00:00 GMT+0
Completed - Maintenance has completed successfully.

Apr 25, 16:00:01 GMT+0
Identified - Maintenance is now in progress.

Apr 25, 16:00:00 GMT+0
Identified - We will be overhauling the grounding and surge suppression on the Iowa Park City Limits tower beginning at 9 AM, Friday, April 25th. During this time we will need to disconnect various cables and install new surge suppression systems in-line, which will cause intermittent connectivity. This process will strengthen the resilience to storms. We expect the work to conclude by 3 PM. .

Isolated Issues on Iowa Park Tower

Thu, 24 Apr 2025 21:49:23 +0000

Type: Incident

Duration: 6 hours

Affected Components:

Apr 24, 21:49:23 GMT+0
Identified - 22 customers in Iowa Park are without connection. We have identified the source of the issue and will be having a tower crew come out to fully replace and upgrade the associated equipment. There is currently no ETR for this issue, but we are working diligently to get it resolved. .

Apr 25, 01:31:36 GMT+0
Identified - The fix we did yesterday for the storm damage did not accomplish what we expected, so we have a tower crew scheduled for tomorrow morning to overhaul the equipment, surge suppression, and grounding at the top of the tower to accomplish a lasting resolution. We expect work to begin at 9 AM, weather permitting. Currently 22 customers are affected..

Apr 25, 03:49:25 GMT+0
Resolved - We were able to resolve the issues remotely. Please see our posted maintenance for tomorrow, as we are still going to have the tower crew come and overhaul the grounding and surge suppression systems at the tower. .

Partial Outage in Lakeside City and Hwy 79 S. Due to Storms

Thu, 24 Apr 2025 11:20:00 +0000

Type: Incident

Duration: 8 hours and 1 minute

Affected Components: ,

Apr 24, 11:20:00 GMT+0
Investigating - We are currently investigating this incident..

Apr 24, 19:21:00 GMT+0
Resolved - This incident has been resolved. The issue was related to power distribution at a hub tower. Steps have been taken to mitigate future issues of the same variety. .

Partial Outage in Iowa Park Due to Storms

Wed, 23 Apr 2025 07:45:44 +0000

Type: Incident

Duration: 15 hours and 38 minutes

Affected Components:

Apr 23, 22:12:03 GMT+0
Monitoring - The repair crew is on the tower working to resolve the issues. .

Apr 23, 23:23:38 GMT+0
Resolved - The equipment has been replaced and service is back online..

Apr 23, 07:45:44 GMT+0
Identified - 3 pieces of equipment on the Iowa Park City Limits tower quit working during the storm, affecting a portion of our customers in the city. Repairs will require a tower climb, which we will do when there is a safe gap in the storms. .

Apr 23, 17:32:10 GMT+0
Identified - A tower crew has been scheduled to do the repairs. The last ETA we received was for 6 PM this evening for them to arrive on site. Repairs will take a few hours once the crew has arrived. We will provide an update if the ETA changes. .

Network Maintenance

Tue, 4 Mar 2025 07:00:00 +0000

Type: Maintenance

Duration: 1 hour

Affected Components: , ,

Mar 4, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Mar 4, 07:00:00 GMT+0
Identified - We will be performing network maintenance on the backbone network tonight at 1 AM (the morning of Tuesday at 1 AM). We expect downtime to be 1 hour during the maintenance. Only specific areas of the network will be affected. .

Mar 4, 08:00:00 GMT+0
Completed - Maintenance has completed successfully.

Issue Affecting Limited Number of Customers in Iowa Park

Sun, 23 Feb 2025 23:58:57 +0000

Type: Incident

Duration: 1 day, 21 hours and 47 minutes

Affected Components:

Feb 23, 23:58:57 GMT+0
Investigating - We are currently investigating an issue affecting connection for 27 customers in the Northwest Iowa Park area. We will provide more details when we have them. .

Feb 24, 02:49:11 GMT+0
Identified - A piece of equipment on the tower died unexpectedly this afternoon. Attempts to contact the device have been unsuccessful. We will be climbing the tower tomorrow to replace the unit and bring the 27 customers back online. .

Feb 24, 21:46:00 GMT+0
Monitoring - We conducted a tower climb and were able to restore service to all but 3 customers. We are continuing to work on a customized resolution for the 3 remaining customers. .

Feb 25, 21:46:00 GMT+0
Resolved - This issue has been resolved. All customers are back online..

Equipment Failure Due to Extreme Temperatures - 17 Customers Affected

Wed, 8 Jan 2025 05:51:17 +0000

Type: Incident

Duration: 14 hours and 9 minutes

Affected Components:

Jan 8, 05:51:17 GMT+0
Investigating - One radio on the Arena Rd tower failed at 11 PM due to the extreme cold. We have spares and are working on a plan to replace the radio on Wednesday to restore service..

Jan 8, 20:00:00 GMT+0
Resolved - The faulty equipment at the top of the 400ft tower has been replaced and service has been restored. .

Network Congestion

Thu, 12 Dec 2024 02:12:00 +0000

Type: Incident

Duration: 1 day, 1 hour and 3 minutes

Affected Components: , , ,

Dec 12, 02:12:00 GMT+0
Identified - Congestion on a 3rd-party upstream provider's network is causing issues for some of our customers. Services are all operational, but customers will notice slower speeds until the issue is resolved. We are monitoring the situation and are in contact with the 3rd-party company to come up with a quick resolution..

Dec 13, 00:08:52 GMT+0
Identified - The 3rd party upstream providers in Dallas has had crews operating around the clock to resolve the issue. The most recent timeline we have been given is 10 PM tonight for a resolution. Our network is continuing to operate on multiple redundant connections, so connections are up for all customers, although speeds will be lower than normal for the affected sites until the 3rd party network congestion is resolved..

Dec 13, 03:15:00 GMT+0
Resolved - This incident has been resolved. The 3rd party upstream provider has resolved their congestion issues which have in-turn relieved the constraint being felt by some of our customers. Speeds are back to normal. .

Storm-Related Power Issue on Three-Way Rd Tower.

Sun, 3 Nov 2024 14:14:14 +0000

Type: Incident

Duration: 3 hours and 13 minutes

Affected Components:

Nov 3, 14:14:14 GMT+0
Investigating - We are currently experiencing a power issue on our three-way Rd tower due to the storms. We will provide updates as we know more. Expected restoration time is 2 PM..

Nov 3, 17:27:28 GMT+0
Resolved - This incident has been resolved. There was a power supply in the tower cabinet that was damaged in the storm. The power supply has been replaced and everything on the tower is back online. .

Connectivity Issues in Hwy 79 S. Area

Mon, 23 Sep 2024 13:27:11 +0000

Type: Incident

Duration: 1 hour and 18 minutes

Affected Components:

Sep 23, 13:27:11 GMT+0
Investigating - We are currently investigating the cause of connectivity issues around Hwy 79 S. We will post an update when we know more. .

Sep 23, 14:45:22 GMT+0
Resolved - This incident has been resolved. Firmware on one of the uplink radios caused the main feed to the tower to lock up. We have upgraded the firmware and confirmed full speeds are back to the tower. .

Network Maintenance Tonight at 1 AM.

Fri, 30 Aug 2024 06:00:00 +0000

Type: Maintenance

Duration: 4 hours

Affected Components: , , , , , ,

Aug 30, 06:00:00 GMT+0
Identified - We are planning to push updates to equipment in our backbone network tonight to better handle load balancing in the event of fiber cuts. We will begin the maintenance at 1 AM tonight (morning of 8/30). We expect the maintenance to last 4 hours. During this time we expect connection to be intermittent as equipment performs updates. The goal of this maintenance is to increase network resiliency in the event of future fiber cuts and to fully utilize our additional backup link we recently added to the network. .

Aug 30, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Aug 30, 10:00:00 GMT+0
Completed - Maintenance has completed successfully.

Network Issues in Wichita Falls and Surrounding Areas

Thu, 29 Aug 2024 17:25:29 +0000

Type: Incident

Duration: 11 hours and 34 minutes

Affected Components: , , , ,

Aug 29, 17:25:29 GMT+0
Investigating - We are aware of issues affecting our customers in the Greater Wichita Falls area. We are working to isolate the cause and will provide updates soon. .

Aug 29, 17:40:43 GMT+0
Identified - We have identified the source of the problem. After a few minutes of work, our brand new backup circuit has taken the traffic load that normally traverses our main fiber trunks. One of those main trunks just got cut somewhere between Wichita Falls and DFW, so our system switched to our newly installed backup circuits. All customers should be back up and running as of now, and we will continue to monitor the situation as repairs begin on the main line. .

Aug 29, 18:14:14 GMT+0
Identified - We are continuing to work on a fix for this incident. 90% of our customers are back to full speed, but we are still working to restore connection to the remaining 10%, some of whom are in Lakeside City and Iowa Park. .

Aug 29, 21:12:28 GMT+0
Monitoring - Speeds across the network should be back to normal. We are running on multiple backup links right now and have normalized speeds across the links. With this new network design, we expect much less impact on customers during fiber cuts from here on out. .

Aug 30, 04:59:00 GMT+0
Resolved - Issues have been fully resolved and speeds are back to normal. .

Router Upgrade Tonight

Wed, 17 Jul 2024 06:00:00 +0000

Type: Maintenance

Duration: 1 hour and 16 minutes

Affected Components: , , ,

Jul 17, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Jul 17, 06:00:00 GMT+0
Identified - We are planning for a scheduled maintenance tonight. We will be upgrading a backbone router in our network so we can handle growing customer demands. We expect the entire process to take 3 hours. During this time, internet services may be interrupted or unavailable. .

Jul 17, 07:15:38 GMT+0
Completed - The network upgrade has been completed successfully. .

Degraded Speeds Due to DFW fiber Cut

Wed, 5 Jun 2024 23:21:00 +0000

Type: Incident

Duration: 7 hours and 54 minutes

Affected Components: , , , , ,

Jun 5, 23:21:00 GMT+0
Investigating - A major tier 1 carrier had a fiber cut that is affecting a large portion of North Texas. We have reported it to them and they are working on it. Our system switched over to the backup, so service is still operational, but at degraded speeds. .

Jun 6, 03:33:49 GMT+0
Identified - The issue has been identified as an equipment failure of a major Tier 1 network in Fort Worth. They have technicians working on the issue. No ETA given at this time. .

Jun 6, 07:15:00 GMT+0
Resolved - This incident has been resolved and services are back to full speed. .

Iowa Park Power Issue Due To Storms

Fri, 31 May 2024 05:56:48 +0000

Type: Incident

Duration: 41 minutes

Affected Components: ,

May 31, 05:56:48 GMT+0
Investigating - We are currently investigating this incident..

May 31, 06:37:41 GMT+0
Resolved - A power inverter absorbed a surge due to the storms. We have bypassed the equipment for the time being and will be installing a replacement soon. .

Storm Damage To South Iowa Park Tower

Thu, 2 May 2024 11:00:00 +0000

Type: Incident

Duration: 14 hours

Affected Components:

May 2, 11:00:00 GMT+0
Investigating - We are currently investigating this incident. Our southern (rural) Iowa Park tower went offline during the night. We are assessing to situation to see if it can be easily fixed or if it will require a tower crew to come onsite to repair. .

May 2, 15:31:36 GMT+0
Identified - The tower took a direct lightning strike that overloaded the surge suppression at the site. We replaced the equipment in the shed at the bottom of the tower but were unable to get connection to the equipment on the tower. This indicates the equipment on the tower got damaged as well. We have reached out to multiple tower crews to have emergency repairs done on the site. Estimated Restoration Time: Friday, May 3rd by 3 PM. .

May 2, 19:03:28 GMT+0
Identified - We have an emergency repair crew on site working to restore service. We will post an update when we know more. .

May 1, 21:00:00 GMT+0
Resolved - This incident has been resolved. We got an emergency tower crew out here this afternoon and they were able to repair the equipment much sooner than originally expected. All tower equipment is back online and operational, so if you still don't have internet please check the cables on your router, or send us a message on Facebook. .

Fiber Cut in DFW Causing Slow Speeds

Wed, 1 May 2024 19:24:00 +0000

Type: Incident

Duration: 3 hours and 43 minutes

Affected Components: , , , ,

May 1, 19:24:00 GMT+0
Investigating - At 2:24 PM a national fiber carrier had a major outage in North Texas. One of our circuits comes from that company, so traffic that would normally be going down that link has been rerouted to our backup link. We have already submitted a ticket with the fiber carrier and are waiting to receive a time to restoration from them. We will continue to issue updates as we receive them. We have been in the process of adding an additional fiber uplink to our network over the last few weeks to add and additional layer of resiliency to our network. We are very close to turning up the new circuit, so customers should not notice fiber cuts anymore soon. .

May 1, 23:07:24 GMT+0
Resolved - This incident has been resolved. The national carrier updated their incident report to show that it was an equipmemt issue rather than a fiber cut. They were able to resolve it quickly. We are back up to full speed. .

Storm Related Outage In Iowa Park.

Sun, 28 Apr 2024 02:03:36 +0000

Type: Incident

Duration: 1 hour and 32 minutes

Affected Components: ,

Apr 28, 02:03:36 GMT+0
Investigating - We lose connection to our Iowa Park towers at 7:52 PM. We are working on gathering more information about the incident. .

Apr 28, 03:35:26 GMT+0
Resolved - This incident has been resolved. An employee went onsite and found the battery backup solution had failed. He bypassed the battery backup since Oncor power was on and was able to get the site back up. We have ordered replacement parts to repair the battery backup early next week. .

Intermittent Disconnects at Lakeside City

Tue, 19 Mar 2024 15:55:36 +0000

Type: Incident

Duration: 39 minutes

Affected Components:

Mar 19, 15:55:36 GMT+0
Identified - We are seeing 10-15 seconds of connection drops sporadically on the Lakeside City tower. We have identified the issue and are working to resolve it quickly. .

Mar 19, 16:35:00 GMT+0
Resolved - This incident has been resolved. .

Maintenance: Software Updates

Tue, 12 Mar 2024 06:00:00 +0000

Type: Maintenance

Duration: 6 hours and 33 minutes

Affected Components: , , , , , ,

Mar 12, 06:00:00 GMT+0
Identified - We will be doing software updates on our core equipment beginning at 1 AM. .

Mar 12, 06:00:00 GMT+0
Identified - Maintenance has begun. Service will go up and down during the updates. .

Mar 12, 08:00:00 GMT+0
Identified - We will be doing software updates on our core equipment beginning at 1 AM. .

Mar 12, 12:33:02 GMT+0
Completed - Maintenance has concluded and internet connection is back up and running. .

Mar 12, 12:06:38 GMT+0
Identified - We pinpointed the issue with the server and are in the final stages of bringing it back online so internet traffic will start flowing again. We will give another update once the maintenance has concluded. .

Fiber Outage in Ft Worth Causing Congestion

Wed, 7 Feb 2024 20:41:27 +0000

Type: Incident

Duration: 8 days, 13 hours and 33 minutes

Affected Components: , , , ,

Feb 7, 20:41:27 GMT+0
Identified - The same national fiber carrier that was having issues yesterday, and whom had fixed the issue last night, is having another outage in Ft. Worth. We have escalated the issue and are working with a high level repair team to get the issue resolved ASAP. As a result of this instability we will be signing a new contract with an additional fiber carrier to increase refundancy in our network. .

Feb 8, 11:45:53 GMT+0
Monitoring - The national fiber carrier has been taking an unusually long amount of time to find the issue. They dispatched ground crews in the middle of the night to find the damaged fiber but have not updated us on an estimated resolution time as of yet. Our system continues to run on the backup circuit, but like we posted in a previous update, we have decided to add an additional fiber upstream provider in our network in the near future to mitigate these sorts of issues. .

Feb 8, 20:51:13 GMT+0
Identified - The national fiber carrier updated us on the situation. They are having ongoing issues with equipment in Ft Worth that is affecting a lot of their circuits across North Texas. We have escalated our ticket once more, but they already have personnel on-site working on their issue in Ft. Worth. .

Feb 10, 00:07:00 GMT+0
Resolved - The upstream carrier has reported that the outage has finally been resolved. We are extremely displeased with the length of time it took for the issue to be resolved, so we have already begun the process of adding an additional upstream connectivity provider to strengthen the network and prevent future problems such as this. We apologize for the extended issues and are committed to improving the redundancy systems as soon as possible. .

Fiber Outage In Ft. Worth Affecting Capacity

Tue, 6 Feb 2024 21:30:00 +0000

Type: Incident

Duration: 12 hours

Affected Components: , , , ,

Feb 6, 21:30:00 GMT+0
Identified - A fiber outage in Ft. Worth is affecting the capacity on our network. Our system successfully switched over to the backup circuit, but capacity is constrained at the moment. The national fiber carrier has been notified so we expect a resolution this evening. We will post an update once a resolution is made. .

Feb 7, 09:30:00 GMT+0
Resolved - The national fiber carrier has resolved their outage and our network is back to full capacity. .

Arena Rd Partial Outage Due to Storm

Fri, 26 Jan 2024 17:11:21 +0000

Type: Incident

Duration: 1 day and 4 minutes

Affected Components:

Jan 26, 17:11:21 GMT+0
Investigating - One Access Point on our Arena Rd tower (Wichita Falls West Rural) that serves 29 customers got damaged in the lightning storm. We are already in communication with our tower crew to see how soon they can climb and repair the equipment. Currently only 29 customers across our entire network are affected. .

Jan 27, 14:34:07 GMT+0
Identified - Our tower crew will be arriving on site to begin repairs at 9 AM. We will be taking this opportunity to improve the grounding and lightning protection of all equipment on the site. .

Jan 27, 17:15:45 GMT+0
Resolved - This incident has been resolved. The faulty equipment at the top of the tower has been repaired. .

Iowa Park Maintenance Tonight

Thu, 25 Jan 2024 05:59:00 +0000

Type: Maintenance

Duration: 10 minutes

Affected Components: ,

Jan 25, 06:09:00 GMT+0
Completed - Maintenance has completed successfully.

Jan 25, 05:59:01 GMT+0
Identified - Maintenance is now in progress.

Jan 25, 05:59:00 GMT+0
Identified - One of the power supplies at our Watts Rd. tower is having issues. We will be replacing the power supply tonight at midnight which will cause a brief outage of roughly 10 minutes while the power supply is being swapped out. .

Core Capacity Upgrade

Mon, 15 Jan 2024 08:00:00 +0000

Type: Maintenance

Duration: 3 hours

Affected Components: , , , , , ,

Jan 15, 08:00:00 GMT+0
Identified - We are planning for a scheduled maintenance beginning at 2 AM on the Morning of Monday, January 15th and concluding by 5 AM the same morning. During this time we will be upgrading equipment in the core of our network to handle growing capacity demands. We expect internet to be unavailable during most of this time, but we are conducting maintenance during the time of lowest demand to reduce impact on customers. .

Jan 15, 11:00:00 GMT+0
Completed - Maintenance has completed successfully.

Jan 15, 08:00:01 GMT+0
Identified - Maintenance is now in progress.

Equipment Upgrade (Night of 12/19)

Wed, 20 Dec 2023 05:59:00 +0000

Type: Maintenance

Duration: 2 hours

Affected Components: , ,

Dec 20, 05:59:01 GMT+0
Identified - Maintenance is now in progress.

Dec 20, 07:59:00 GMT+0
Completed - Maintenance has completed successfully.

Dec 20, 05:59:00 GMT+0
Identified - We are scheduling an equipment upgrade at our Arena Rd. tower (Wichita Falls West Rural) for the night of Tuesday, December 19th, starting at 11:59 PM. We will be upgrading and replacing equipment in the shed at the base of the tower to help support future growth of our network. We expect the total outage time to be 2 hours, and it will mostly be isolated to customers on that one tower. We expect our Iowa Park towers to have momentary disconnects as we move cables around between equipment. .

Emergency Maintenance for Lakeside City

Wed, 6 Dec 2023 06:00:00 +0000

Type: Maintenance

Duration: 1 hour

Affected Components:

Dec 6, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Dec 6, 06:00:00 GMT+0
Identified - We will be performing maintenance on the Lakeside City tower tonight at midnight. This maintenance is to resolve a sporadic issue that has been causing 30-45 second blips of connection loss and random times. During this maintenance we will be upgrading the backbone router at the tower. We expect the total outage time to be 1 hour..

Dec 6, 07:00:00 GMT+0
Completed - Maintenance has completed successfully.

Maintenance: Lakeside City and Memorial Stadium Equipment Software Updates

Tue, 28 Nov 2023 06:00:00 +0000

Type: Maintenance

Duration: 1 hour

Affected Components: ,

Nov 28, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Nov 28, 07:00:00 GMT+0
Completed - Maintenance has completed successfully.

Nov 28, 06:00:00 GMT+0
Identified - We are planning for a scheduled maintenance tonight (Late Monday night, early Tuesday morning) to update software on a couple pieces of network equipment. The only sites that will be affected are Lakeside City and Memorial Stadium. We expect the updates to take only a few minutes, but we are allowing 1 hour just in case any issues arise. Service will go down momentarily as the updates are being applied. .

Core Equipment Updates

Wed, 15 Nov 2023 07:00:00 +0000

Type: Maintenance

Duration: 2 hours and 25 minutes

Affected Components: , , , , , ,

Nov 15, 07:00:00 GMT+0
Identified - We are performing updates on core equipment across the network. Maintenance will conclude by 4 am. .

Nov 15, 09:25:05 GMT+0
Completed - Maintenance has completed successfully..

Maintenance Tonight (Monday Night)

Tue, 20 Jun 2023 04:59:00 +0000

Type: Maintenance

Duration: 3 hours

Affected Components: , , , , ,

Jun 20, 04:59:01 GMT+0
Identified - Maintenance is now in progress.

Jun 20, 04:59:00 GMT+0
Identified - We are planning for a scheduled maintenance tonight starting at Midnight. We will be upgrading the software version on equipment across the network, so some areas will experience a temporary loss of connection for a few minutes as the updates roll out. We expect the overall maintenance period to span from Midnight until 3 AM, although each affected customer should only experience a disconnect for a few minutes..

Jun 20, 07:59:00 GMT+0
Completed - Maintenance has completed successfully.

Network Maintenance - Software Updates

Tue, 18 Apr 2023 06:00:00 +0000

Type: Maintenance

Duration: 1 hour

Affected Components: , , , , , ,

Apr 18, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Apr 18, 07:00:00 GMT+0
Completed - Maintenance has completed successfully.

Apr 18, 06:00:00 GMT+0
Identified - We are planning a last-minute software update tonight (very early Tuesday morning) at 1 AM to correct some very isolated throughput issues. We are planning this at 1 AM so as to effect as few customers as possible. We expect the whole process to last 1 hour, during which some parts of the network will lose connection as the equipment undergoes software updates. .

Last Minute Maintenance Tonight at 1 AM. Memorial Stadium Tower.

Wed, 30 Nov 2022 07:00:00 +0000

Type: Maintenance

Duration: 51 minutes

Affected Components: ,

Nov 30, 07:50:52 GMT+0
Completed - Maintenance has completed successfully..

Nov 30, 07:00:00 GMT+0
Identified - This is a continuation of the maintenance from last night to resolve an issue with intermittent connectivity on the Memorial Stadium tower. The maintenance will begin at 1 AM so as to hinder as few customers as possible. During the maintenance, connectivity to the Memorial Stadium area and Lakeside City will be down. We expect it to be relatively quick, but we are allotting 2 hours just in case. .

Equipment Replacement At Stadium Tower

Tue, 29 Nov 2022 07:00:00 +0000

Type: Maintenance

Duration: 1 hour and 20 minutes

Affected Components: ,

Nov 29, 07:00:00 GMT+0
Identified - We will be replacing an important piece of equipment at our tower near Memorial Stadium tonight at 1 AM. The purpose of this maintenance is to fix an intermittent issue we have identified where all connections drop for 10 seconds and come back up. We expect the maintenance to last between 1 hour and 3 hours, and will be done in the middle of the night to reduce the impact on customers. .

Nov 29, 07:14:01 GMT+0
Identified - Maintenance is now in progress..

Nov 29, 08:20:26 GMT+0
Completed - Maintenance has concluded. There will be another 1 AM maintenance this week to fully complete the equipment transition. We will send out another notification before that one happens. .

Holliday Equipment Reboot Tonight at Midnight.

Fri, 18 Nov 2022 06:00:00 +0000

Type: Maintenance

Duration: 20 minutes

Affected Components:

Nov 18, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Nov 18, 06:00:00 GMT+0
Identified - We will be replacing the battery backup that caused the power outage at our Holliday tower several days ago. The swap will be quick, but it will require us to unplug the power to all devices on the tower and move them over to the new device. Total downtime is expected to be 10 or 15 minutes. Maintenance will begin promptly at midnight tonight (Thursday night/Friday morning)..

Nov 18, 06:20:00 GMT+0
Completed - Maintenance has completed successfully.

Emergency Equipment Reboot Tonight (Very Early Wednesday Morning) at 12:00 AM

Wed, 2 Nov 2022 05:00:00 +0000

Type: Maintenance

Duration: 5 hours

Affected Components:

Nov 2, 05:00:01 GMT+0
Identified - Maintenance is now in progress.

Nov 2, 10:00:00 GMT+0
Completed - Maintenance has completed successfully.

Nov 2, 05:00:00 GMT+0
Identified - One of our fiber providers notified us that they will be rebooting some of their core equipment starting at midnight tonight (very early Wednesday morning) to prevent a larger issue from happening. **This will only affect customers on our Holliday network. ** They notified us that the maintenance window will begin at midnight tonight and the maintenance window will end at 5 AM. We do not expect the network to be down for anywhere near that long, but we are relaying the maintenance window as they informed us..

Very Short Maintenance Tonight at 2 AM (Wednesday Night/Thursday Morning)

Thu, 22 Sep 2022 07:00:00 +0000

Type: Maintenance

Duration: 15 minutes

Affected Components: , , , , , ,

Sep 22, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Sep 22, 07:00:00 GMT+0
Identified - We will be replacing some patch cables in our core network. It will consist of unplugging the old ones and plugging in the new ones. Total downtime should be a couple of minutes at most. We aim to start at 2 AM. .

Sep 22, 07:15:00 GMT+0
Completed - Maintenance has completed successfully.

Router Updates Tonight: 2 AM - 5 AM (Early Thursday Morning)

Thu, 8 Sep 2022 07:00:00 +0000

Type: Maintenance

Duration: 3 hours

Affected Components: , , , , ,

Sep 8, 07:00:00 GMT+0
Identified - We will be pushing out updates to all home routers between 2 AM and 5 AM tonight (early Thursday morning). Each individual update will take 5 minutes or less. We expect most customers to be asleep during the updates, but if you are awake, please do not unplug the router during the update. .

Sep 8, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Sep 8, 10:00:00 GMT+0
Completed - Maintenance has completed successfully.

Wichita Falls Network Maintenance 1 AM - 4 AM Wednesday 8/31

Wed, 31 Aug 2022 06:00:00 +0000

Type: Maintenance

Duration: 3 hours

Affected Components: ,

Aug 31, 09:00:00 GMT+0
Completed - Maintenance has completed successfully.

Aug 31, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Aug 31, 06:00:00 GMT+0
Identified - We will be performing network maintenance between 1 AM and 4 AM on the morning of Wednesday, August 31st. We do not expect a full outage during this time, but we do expect intermittent connectivity from time to time during this window as we shift traffic around. .

Iowa Park / Wichita Falls Network Maintenance

Wed, 10 Aug 2022 06:00:00 +0000

Type: Maintenance

Duration: 2 hours

Affected Components: ,

Aug 10, 06:00:00 GMT+0
Identified - We will be working on the core network. There is a possibility of intermittent connectivity between 1 AM and 3 AM. .

Aug 10, 08:00:00 GMT+0
Completed - Maintenance has completed successfully.

Aug 10, 06:00:01 GMT+0
Identified - Maintenance is now in progress.

Holliday Network Maintenance Tonight At 2 AM.

Fri, 22 Jul 2022 07:00:00 +0000

Type: Maintenance

Duration: 1 hour

Affected Components:

Jul 22, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Jul 22, 07:00:00 GMT+0
Identified - We will be transitioning over to a new internet uplink connection at our tower tonight at 2 AM. While there is always the chance of issues, we expect very little service interruption with this transition. The new uplink brings more capacity to our tower to enable us to begin optimizing our tower for faster and more reliable speeds to all customers. .

Jul 22, 08:00:00 GMT+0
Completed - Maintenance has completed successfully.

Equipment Reboot and Upgrade

Fri, 4 Mar 2022 07:56:00 +0000

Type: Maintenance

Duration: 28 minutes

Affected Components: ,

Mar 4, 07:56:00 GMT+0
Identified - We are going to be rebooting and upgrading core equipment. Internet will be down for 20-30 minutes. .

Mar 4, 08:23:39 GMT+0
Completed - Maintenance has completed successfully..

Mar 4, 07:56:01 GMT+0
Identified - Maintenance is now in progress.