Multimax and NTV General Problem - Resolved

[kbasat]

Hello All,
We have experienced a strange malfunction this morning at our NOC (Network Operations Center) that cause some issues.

The problem manifested itself on our server farm at around 6am when some servers have lost connection to storage servers, while others in the same environment was working fine.

By 6:30, engineers were already working on the problem trying to isolate the cause and devise a solution.

Multimax Internet was mostly not affected as redundancy systems help to keep outages to a minimum, there was probably a few 'few minute outages' to Multimax customers between 6am to 10am. By 10am all Multimax systems were brought back up fully.

NTV system was affected more severely as a couple of key servers was affected by this problem. Some servers were fixed while others were rebuilt from backups. NTV system was therefore off for approx 6 hours. Eventually, all NTV servers were also back up and working by 1pm.

Another system that was affected by this problem was our Phone System. Unfortunately, while we are tackling and time-racing in order to bring everything back to normal parameters, our PBX went offline at around 9am. After bringing all other more crucial systems online, PBX was also back up and running around 1pm after approx 4 hours of outage. I like to apologize if any customer has tried to contact us during this time and couldnt get through.

We are still working on all the details in order to find the exact cause of the problem. It was good to see some of the redundancies really worked and helped to keep the problems' reflection in customers to a minimum, we also have noticed that there is still room for improvement and further tweaking and we will be working on those in the upcoming days.

I like to again apologize to all customers who were adversely affected by todays problems and also to those who could not reach us when our Phone System was down and thank once more for your continuous support.

Kemal

[LooseBoots]

I just said on another thread all was working again.The Lan light came on..........then it went off again..............then it went again........................

Can`t keep up with it all