Virgin Media struck dumb by NATIONWIDE DNS outage Virgin Media customers were kicked offline last night, after a DNS blunder from the cable company disrupted its network on Tuesday. It comes after rival BT suffered a similar, widespread technical cockup over the weekend. Virgin Media, which is owned by US telecoms giant Liberty Global, coughed to a "nationwide DNS outage" on …
"All your data are belong to us"
Sorry to be finicky (ha, as if, this is El Reg), to follow the meme correctly, shouldn't that be "All your datum are belong to us."
Ahem. Aaaand back to the story... DNS availability does seem to be Virgin Broadband's major weakness in my experience. Throughput and latency over cable is generally good, but DNS response times and/or availability seems to vary from just about acceptable to utter crap on a day to day basis.
Were they activating their new link to GCHQ this time?
Actually, no, data is actually going to Maryland, and has been doing so for a while. That it breaks UK Data Protection with it apparently doesn't matter to its US owner:
;; QUESTION SECTION:
;virginmedia.com. IN MX
;; ANSWER SECTION:
virginmedia.com. 3220 IN MX 1 aspmx.l.google.com.
virginmedia.com. 3220 IN MX 5 alt1.aspmx.l.google.com.
virginmedia.com. 3220 IN MX 5 alt2.aspmx.l.google.com.
virginmedia.com. 3220 IN MX 10 aspmx2.googlemail.com.
virginmedia.com. 3220 IN MX 10 aspmx3.googlemail.com.
Even when equipped with barge pole, do not touch.
My VM service continued to work last night. No DNS problems here. However, I did get problems last Thursday that were very similar to what was reported for BT at the weekend.
So yes, I'm suspicious. There does seem to be a systematic outbreak of this problem and a failure to state the cause doesn't help.
"...Virgin Media's status pages claim everything is fine..."
That's pretty par for the course with VM.
Sometimes even the call handler will be saying there's nothing wrong, and have you tried switching it off and on again, etc. And later you find out that the whole area has a problem.
Yeah - those pages are about as much use as paraffin wax teapot* - a static page showing Cnut** holding back the waves with an "Everything's fine" speech bubble would be equally accurate.
*It's been pointed out to me often that you could eat a chocolate teapot, thereby providing some good use.
**Preferably mispelled
during a long (>48 hours outage) and after several calls over two days with the 'help' desk, who could only say there was no known issue or resolution time (and kept trying to get me to check my network settings, grrrr), i was finally passed to second level support, who instantly replied that "oh, it's a planned outage for network changes, service will resume at xx:yy" which it did
i) planned, so why didn't they email affected customers in advance?
ii) planned, so why didn't they put it on the status page, phone status etc.?
iii) planned, so why didn't they tell their own help desk people?
iv) planned, in what way?
Yep their status page is awful.
Whenever I have an internet outage, I check the status page from my phone and it usually says something like "Phone - OK, Internet - OK, TV - There are reported problems with TV service in your area". Despite the fact that I don't have TV with them and it's my Internet that's down I can only assume "Internet" and "TV" are linked in some way, and only bother contacting the helpdesk if all three services are listed as OK.
I just love the status pages.
I just love that they offer to send you an email when an issue is resolved.
I just love that it was email that was down, and they offered to send me an email when it was fixed... (I leave the reader to do the facepalm)
(yes, yes, I know, I could have used a different email address if I had one, or if I had push email it should have come through to my phone or I could of chosen to receive an SMS. But where would the Virgin bashing fun be in that)
Here's how I didn't notice the outage, in case anyone's interested.
I run a small Linux server in my loft (I use a Raspberry Pi for its low power consumption, but anything will do).
It runs a DHCP server and a DNS server. Neither is difficult to configure. Superhub is in normal mode, with DHCP switched off.
In the DNS server, I have a config file which redirects all spam, ads or anything else I don't like, such as social media bollocks. My LG TV no longer tries to advertise things to me (still annoyed about that - never buy LG) and nor does my phone, at least when I'm in the house.
Anything in the house has a DNS entry. Anything else gets forwarded to opendns.
Still have to use UKbay to get round the pathetic attempt at blocking piratebay though.
It does vary from distro to distro. You need to set up dhcpd and bind. I use slackware and that basically means installing dhcpd and bind packages, changing /etc/rc.d/rc.dhcpd and /etc/rc.d/rc.bind to be executable, editing the config files, and starting them.
There's probably a bit too much to post here, but this post: http://topchan.info/your-own-adblocking-dns will give you some pointers.
On debian (and therefore probably ubuntu) at least, a local caching DNS server is a simple matter of installing bind9 and editing /etc/bind/named.conf.options. You can put whatever DNS servers you want in the forwarders section like so:
forwarders {
// ISP DNS servers go here
2.3.4.5;
6.7.8.9;
10.11.12.13;
};
Restart bind and you're done. I use OpenNIC DNS servers with Level 3 as a backup.
If you want a simple single subnet DHCP server, just install udhcpd and you're done. ISC dhcpd is a little more involved.
You can combine both in a single piece of software by using the excellent dnsmasq (which has the added bonus of providing DNS names for you local network automatically) although it's harder to set up than the above bind example - but simpler overall.
That would be why I never noticed any DNS problems then.
Definite fail by VM for locking the Superhub DNS away from the users.
I have heard that the reason is so that they don't have to support any user change to the DNS but since the third thing* they ask you to do is factory reset the router I don't see the point.
* First thing - reboot your computer, second thing reboot the router.
Annoyingly there is no way to change the Superhub's DNS settings, so I could only fix the PCs and not my wife's phone or the set-top box.
I spent 40 minutes on hold to find that out nugget of information.
At least "Cable Modem mode" is easy to set up, just not something I felt like doing during an outage.
I've been with VM for BB for years, but over the last couple of years the DNS provided by them has been getting worse and worse.
When I switched to public DNS provides like google or OpenDNS, the broadband now works really fast.
So why cripple you fast broadband with pathetic DNS? Most users will not ever change their DNS, and will just say "My Broadband is shit"
We've been on Virgin for 4+ years and it took 15 seconds to realize their DNS is #epicfail fsck'd.
We use a variety of open DNS, plus known good DNS servers and never ever rely on Virgin's DNS. The fact their router does is immaterial as all of our home hosts have hard coded DNS entries so we can avoid Virgin's DNS fsckery.
It went down on Friday.
http://community.virginmedia.com/t5/Up-to-152Mb/DNS-Issues/td-p/2361435
Also the service is getting worse in general, my area is waiting now almost 2 years for a resegmentation and all I get is usual bullshit about how they are sorry and the work takes a long time to plan.
The Register 
Biting the hand that feeds IT
Copyright. All rights reserved © 1998–2024
