Thursday, February 6, 2014

IPv6 versus IPv4 Performance

Yesterday from a post at the Deploy360 website, I learned of Comcast's IPv4 and IPv6 network speed testing tool:

        http://speedtest.comcast.net/

I did a quick test from my laptop in my office and got some very surprising results. The measured IPv6 performance was better than IPv4 by a gigantic margin. With IPv6, I got 822 Mbps download and 667Mbps download throughput. With IPv4, a mere 99Mbps upload and 18Mbps download!


Something seemed fishy, but I had to run off to other work, so I quickly posted the result to Twitter, planning to look into it later.


This generated quite a bit discussion with numerous folks on twitter and elsewhere. My initial speculation was that we do some rate limiting of IPv4 traffic at the Penn border routers for selected areas of the campus, and perhaps this was throttling the IPv4 performance. My other suspicion was that there was something significantly different in the IPv4 and IPv6 routing paths contributing to the difference. The graphic above does show a round-trip time difference of 63ms for the IPv4 path and 32ms for the IPv6 path, which suggests this. Furthermore, if the TCP window is not scaled properly to keep the pipe filled for this path at 63ms (but was for 32ms), then that would decrease throughput also - but not enough to account by itself for the observed difference.

Patrik Falstrom suspected a DPI device or other middlebox causing the problem. The only problem is that we don't have any such middleboxes (unless you consider an IP border router imposing IP address based rate limits a middlebox). In any case, I was leaning towards the rate limits as the cause myself, until I confirmed that those rate limits weren't being applied to any of the traffic from my office network. The rate limits are primarily targeted at the student residential dormitories - without them, our external links typically get overwhelmed with traffic to/from the dorms (most likely due to file sharing, a very common activity on college campuses). The border routers are configured to apply a token bucket rate policer to each individual IPv4 address within the network prefixes that cover the residential networks. Note that this rate limiting is completely application agnostic.  Also note that this scheme cannot scale to IPv6 (a single IPv6 subnet has more than 18 quintillion addresses!), a problem we're ignoring for the time being :-)

Repeat of the test


This morning, I decided to do another test (same laptop), but more carefully, and along with a packet capture. I also explicitly turned off the wireless interface (hmmmm) to make sure that all tests were using the wired gigabit ethernet interface. This time, I got much more reasonable looking results, both address families in the neighborhood of each other: IPv4 853Mbps down, 547Mbps up, and for IPv6 827Mbps down, 730Mbps up. One other difference I notice is that the roundtrip (ping) times to the destination server are 12ms for both IPv4 and IPv6. This is substantially different from yesterday's test (63 and 32ms respectively) despite the fact that I choose the same destination server at Comcast (Washington, DC).


A packet capture reveals that the destination server at Comcast for IPv4 was 68.87.73.52, and for IPv6 was 2001:558:1010:5:68:87:73:52. Are these the same endpoint? Hard to tell, but the fact that the last 4 fields of the IPv6 address spell out the IPv4 address in decimal might be a hint. The traffic streams use TCP port 5050. A traceroute to the IPv4 destination shows the outbound path takes one of Penn's commercial ISP links (Cogent) to New York and then back to Washington/VA. An IPv6 traceroute shows the outbound path goes out via our Internet2 link, the I2 commercial peering service, then Cogent (New York), Level3 (New York), and then Comcast to DC. So the IPv4 and IPv6 paths are substantially different in the forward direction. Harder to tell the path for the return traffic without the aid of some reverse traceroute tools or similar.

Getting a substantial fraction of a gigabit ethernet is not suprising - that's probably the bottleneck bandwidth along the measured path. My laptop has a gigabit ethernet connection to the building network, which in turn has dual 10 Gigabit Ethernet links to a 100 Gig campus core, and then multiple 10Gig links out to commercial ISPs/Internet2 etc. Most tier-1 ISP links and peerings are typically at least 10Gig.

The bandwidth-delay product on these paths is about 1,464 KB (1000Mbps * 12ms). The Comcast endpoint's receive window exceeds this, but my laptop's is slightly undersized, so I could probably do a bit of host tuning to boost the download numbers a bit more.

So, what's the explanation for the strange results I got yesterday? I wish had a packet capture to investigate, but my leading suspicion is that my laptop's wireless adapter (lower bandwidth, shared medium) was used in the IPv4 test, and the wired connection for the IPv6 one. If I have time later, I'll try to reproduce the issue.

--Shumon Huque



Addendum (February 9th 2014) - On closer inspection of the packet trace, the speed test appears to use multiple TCP streams in parallel, so scaling the window as high as the bw*delay product of the path isn't necessary.

37 comments:

  1. These are really amazing and valuable websites you have shared with us. Thanks for the informative post.
    WordPress development company in Chennai

    ReplyDelete
  2. IPv6 is undoubtedly better than IPv4, but as for me, I don't like the design of IPv6. It is very complicated for me. This is only my opinion.

    ReplyDelete
  3. What a great post! I had pleasant time reading here. If you are interested in reading more articles like this, go to https://essays-writer.net/health-care-research-topics-for-argumentative-essay-best-ideas.html.

    ReplyDelete
  4. SERVPRO of Chaska / Chanhassen Company Profile | About Us at SERVPRO of Chaska / Chanhassen:The professionals at SERVPRO of Chaska / Chanhassen are available 24 hours/7 days a week and will respond quickly to any restoration emergency, whether its water, fire or mold. Call SERVPRO of Chaska / Chanhassen for fast service 24/7, call today - (952) 999-2435 . We proudly serve Chaska, MN, Chanhassen, MN, Waconia, MN, Victoria, MN, Carver, MN, Norwood Young America, MN, Cologne, MN, Chaska, MN, Chanhassen, MN, Waconia, MN, Victoria, MN, Carver, MN, Norwood Young America, MN, Cologne, MN, Chaska, MN and surrounding areas.

    Source: Storm damage restoration Chanhassen

    ReplyDelete
  5. You need to submit an essay soon and you don't know how to start writing it correctly and which topic to choose? Do you have a lot of questions about writing a work essay? I think they personal narrative essay will be able to help you with this

    ReplyDelete
  6. Interesting...if you have Webroot as your security, i doubt very much that a real Webroot would find your site unsafe, so the app on my computer was probably a malicious fake.
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe
    Webroot.com/safe

    ReplyDelete
  7. Welcome to the world's most searched assignment help in the online arena. Value assignment help since the last decade has been helping students to configure their assignments by assisting them in their subject research and drafting contents as per the rubric set by the education institutes.
    online assignment help

    ReplyDelete
  8. Prior to delving into the various components of this instrument, it is exhorted that you first handle what the QuickBooks file doctor tool is. QBFD is basically a straightforward document fix application that is expected to redress issues that clients discover when working with the QuickBooks bookkeeping programming. Just QuickBooks 2016 and later versions have this element consolidated or worked in. To redesign QuickBooks to the latest form, go to the Quickbooks file doctor download page on the Intuit site and follow to the directions. Something else to remember is that this instrument just works with the UK and US variants of QuickBooks, nonetheless, it is viable with all QuickBooks desktop versions for Windows.

    ReplyDelete
  9. Thanks for taking the time to discuss this, I feel strongly that love and read more on this topic. If possible, such as gain knowledge, would you mind updating your blog with additional information? Check fud jigawa cut off mark

    ReplyDelete
  10. installturbotax com the entire process of filing tax returns so smoothly that one can easily do it from the comfort of their home.

    ReplyDelete
  11. quickbooks connection diagnostic tool
    You can use Quickbooks Connection Diagnostic Tool to diagnose several issues caused by corrupt company files and multiple network problems. By using this tool, you will be more productive. It also has a robust inbuilt technology that makes it easy to use.

    ReplyDelete
  12. Once the error has been resolved, reopen quickbooks error 404 as well as the company file.

    ReplyDelete
  13. Thanks for giving the time to discuss this; I am certain that I will enjoy learning more about it. Would you mind updating your blog with more information. Gain more knowledge about quickbooks error 6175

    ReplyDelete
  14. Notice select Discount Codes, admitted, attempted and working. Find basic Promo Codes for your dearest stamps today.
    By: Vat Calculator

    ReplyDelete
  15. quickbooks install diagnostic tool has been recognized as an efficient accounting software package that both business owners and common people make use of to meet up with their accounting needs. Despite being a reliable application, it does face certain types of issues and errors from time to time. To timely resolve them all at bay, Intuit introduced the QuickBooks tool hub that can wisely resolve any kind of commonly faced application-related errors at ease.

    ReplyDelete
  16. If you don’t have any CD then move on to the steps below. Here, you will be assisted through how to installturbotax com on Windows 10 without a CD.

    The first and foremost step for you is to close running programs

    ReplyDelete
  17. Hey friend, it is very well written article, thank you for the valuable and useful information you provide in this post. Keep up the good work! FYI, Pet Care adda
    Credit card processing, wimpy kid books free
    ,science a blessing or curse essay

    ReplyDelete
  18. Nice blog.
    Download Quickbooks Desktop is accounting software with add-ons and QuickBooks Desktop Enterprise industrial versions, similar to an ERP system. Add-ons include integrated QuickBooks, Intuit Payroll, and third-party customer relationship management software such as Sales force and AP automation software programmes.

    ReplyDelete
  19. This is excellent article. I really like your blog. Quickbooks is best accounting software. If you are a Quickbooks user and facing some errors such as Quickbooks error 15243, so here are my blog which will help you to resolve this error.

    ReplyDelete
  20. shopify app development company Our cost-effective pricing policy is super convenient for you to nail the art of selling goods/services.

    ReplyDelete
  21. You've created an excellent blog. I've come to tell you about a website that can assist you with your java homework aid. We provide students with education and experience with java assignment help projects through our website. If anyone requires any information or assistance with their programming efforts, please do not hesitate to ask.

    ReplyDelete
  22. Our professional Assignment Help online experts enhance your knowledge, and you can relax with the help of professionals. However, If you don't have adequate time to finish your assignment within the deadline, hire our homework help services.

    ReplyDelete
  23. I appreciate you finding the time and effort to put this content together. I once again find myself spending way too much time both reading and leaving comments. Thank you for sharing. Also visit download free data processing past questions at www prep ng

    ReplyDelete
  24. Nice post. This post was very interesting. I got many information from this post. Thanks for share this post with us. 룰렛

    ReplyDelete
  25. Assignment Helper offers Best Assignment Help brisbane. Can someone do my assignment for me or help with my assignment? Yes, we are ready to do your academic writings.

    ReplyDelete
  26. You can ask us can someone "do my assignment for me" and we will assign you the best-skilled writer for your work and you will receive high-quality, plagiarism-free writings at a low cost. We are available day and night to assist you. For more details visit our website.

    ReplyDelete
  27. This article was well-written with easy-to-understand words. I am passionate about learning app development in order to become the provider of mobile app development services. Thank you for sharing your articles! Best mobile app development company in Dubai

    ReplyDelete
  28. Homework writing services are not prohibitively expensive, since Malaysiaassignmenthelp.com provides a cheap homework writing service in Malaysia, where you can have your homework prepared by experienced academic writers for a small fee.

    ReplyDelete
  29. With Interactive Canva Presentation, you may engage your audience and add interactivity to your content. Create beautiful visuals & presentations and share them instantly with Slidecast Canva Integration.

    ReplyDelete
  30. Summertime in Phoenix can become very uncomfortable if your AC unit is not working as it should. If your AC goes down, #1-rated Air Conditioning service company in Phoenix is here to help you. Either fill a request online at pricemyac.com or book a service request by calling us.

    ReplyDelete
  31. Hello Everyone, My name is Ava Johnson and I am a technical expert on online streaming videos I have lots of tips and tricks about how to download or convert videos into audio mode. There are lots of Youtube to mp3 converter available over the web but I have information about free converters. For more information visit our website or call us on our toll-free numbers.

    ReplyDelete
  32. Most people depend on the web whenever they need a product or service. You will find a lot of WordPress Development services in the search results of your browser. All of them claim to be the best in business and make tall claims about their quality of service.

    ReplyDelete
  33. The main explanation for olive green being the most adaptable black and yellow varsity jacket mens tone is that it coordinates wonderfully with all shades of pants, and a great many people live in denim. The second explanation for olive green being the most flexible coat tone is that it goes with dark as well as earth tones.

    ReplyDelete