Inefficient routes between sto1.he.net and other hosts in Stockholm

[nordmark]

Hello,

Traffic between  sto1.he.net (supposedly in Stockholm, Sweden) and other hosts in Stockholm seem to take very long routes, bouncing across several European countries before finding its way back to Stockholm. This was not so in 2016, but may have started when sto1 went down (and was temporary relocated to Germany?) a few years ago. This adds delays of several tens of milliseconds to tunnel traffic, which used to be in the order of 2ms.

The supplied traceroute output seems to indicate that only IPv4 out from sto1.he.net takes the expected direct route, whereas IPv4 in and all IPv6 traffic takes inefficient routes through twelve99.net.

Arne

----------------------------------------

IPv4 out from sto1 (using HE Looking Glass)

core1.sto1.he.net> traceroute 81.227.238.47  source 216.218.252.154 numeric
 
Tracing the route to IP node (81.227.238.47) from 1 to 30 hops

  1    49 ms   53 ms   52 ms 213.155.141.253
  2    95 ms   98 ms   95 ms 62.115.123.167
  3    96 ms   93 ms   97 ms 81.228.86.255
  4    94 ms   98 ms   99 ms 81.227.238.47

----------------------------------------

IPv4 into sto1

traceroute to tserv1.sto1.he.net (216.66.80.90), 30 hops max, 60 byte packets
1  gw1-no264.tbcn.telia.com (213.64.65.1)  0.777 ms  0.797 ms  0.852 ms
2  fre-peer4-link.se.telia.net (81.228.87.195)  0.901 ms fre-peer4-link.se.telia.net (81.228.86.27)  0.551 ms fre-peer4-link.se.telia.net (81.228.86.29)  0.868 ms
3  s-b5-link.telia.net (62.115.123.166)  0.738 ms  0.756 ms  0.787 ms
4  s-bb2-link.ip.twelve99.net (62.115.136.110)  23.882 ms s-bb3-link.ip.twelve99.net (62.115.142.216)  32.203 ms  32.238 ms
5  hbg-bb3-link.ip.twelve99.net (80.91.249.8)  31.728 ms  31.382 ms hbg-bb4-link.ip.twelve99.net (62.115.115.58)  23.740 ms
6  ldn-bb1-link.ip.twelve99.net (80.91.249.10)  28.132 ms  26.867 ms ldn-bb4-link.ip.twelve99.net (62.115.122.161)  23.854 ms
7  ldn-b2-link.ip.twelve99.net (62.115.120.239)  23.994 ms  23.951 ms ldn-b2-link.ip.twelve99.net (62.115.122.189)  27.211 ms
8  hurricane-svc072772-ic360371.c.telia.net (62.115.175.190)  27.760 ms  23.743 ms  26.933 ms
9  100ge11-2.core1.lon2.he.net (184.104.195.109)  33.965 ms  30.955 ms  30.169 ms
10  100ge6-2.core1.ams1.he.net (72.52.92.214)  27.648 ms  27.612 ms  24.479 ms
11  100ge8-2.core1.sto1.he.net (184.105.65.126)  24.962 ms  27.181 ms  24.106 ms
12  tserv1.sto1.he.net (216.66.80.90)  24.966 ms  24.012 ms *

----------------------------------------

IPv6 out from sto1 (using HE Looking Glass)

core1.sto1.he.net> traceroute ipv6 2001:2002:51e3:ee2f::1  source 2001:470:0:10f::1 numeric
 
Tracing the route to IPv6 node 2001:2002:51e3:ee2f::1 from 1 to 30 hops

  1    17 ms   23 ms   24 ms 2001:470:0:3aa::1
  2    25 ms   24 ms   25 ms 2001:470:0:168::2
  3    30 ms   31 ms   36 ms 2001:2034:1:6b::1
  4    30 ms   32 ms   36 ms 2001:2034:1:75::1
  5    31 ms   38 ms   35 ms 2001:2034:0:b9::1
  6    31 ms   39 ms   33 ms 2001:2000:3080:11ce::2
  7    *       *       *     ?
  8    62 ms   51 ms   48 ms 2001:2000:4020:14::2
  9    42 ms   50 ms   43 ms 2001:2002:51e3:ee2f::1

----------------------------------------

IPv6 into sto1

traceroute to tserv1.sto1.he.net (2001:470:0:11e::2), 30 hops max, 80 byte packets
1  * * *
2  2001:2000:4020:14::1 (2001:2000:4020:14::1)  2.630 ms  2.801 ms  4.039 ms
3  fre-peer4-v6.se.telia.net (2001:2000:4018:16a::1)  1.320 ms  1.012 ms  1.267 ms
4  * * *
5  s-bb3-v6.ip.twelve99.net (2001:2034:1:c3::1)  22.761 ms s-bb2-v6.ip.twelve99.net (2001:2034:1:c5::1)  22.865 ms  22.985 ms
6  ffm-bb2-v6.ip.twelve99.net (2001:2034:1:6c::1)  21.617 ms  21.250 ms ffm-bb1-v6.ip.twelve99.net (2001:2034:1:6b::1)  23.776 ms
7  ffm-b2-v6.ip.twelve99.net (2001:2034:0:13::1)  27.241 ms  24.923 ms  24.559 ms
8  10gigabitethernet9.switch2.fra1.he.net (2001:470:0:168::1)  22.757 ms  24.242 ms  22.877 ms
9  100ge12-1.core1.sto1.he.net (2001:470:0:3aa::2)  41.352 ms  39.780 ms  39.745 ms
10  tserv1.sto1.he.net (2001:470:0:11e::2)  41.354 ms  39.836 ms  39.838 ms

[tmberg]

Yes. Ive noticed that also. :(

/T

[tmberg]

The delay was superb before the server died.

[tmberg]

Delete/remove twelve99.net.  :D ;D

[broquea]

AS1299 had a route loop in their network that they corrected.

[mrfrenzy]

This problem seems to have returned.
Traffic from the Stockholm tunnel server goes out through Frankfurt even though it is destined for other hosts in Stockholm. There is also quite a bit of packet loss.

Code Select Expand

Host                                                  Loss%   Snt   Last   Avg  Best  Wrst StDev
1. tunnel654326.tunnel.tserv24.sto1.ipv6.he.net        0.9%   978   10.3  15.0   7.6 128.3  17.6
2. 10ge3-3.core1.sto1.he.net                           1.2%   978    5.7  14.3   5.6 140.8  23.4
3. 100ge12-1.core1.fra1.he.net                         2.1%   978   23.2  31.6  22.9 147.1  23.3
4. as1299.gige-g2-9.core1.fra1.he.net                  0.8%   978   23.1  33.3  23.0 155.9  25.2
5. ffm-bb2-v6.ip.twelve99.net                          1.0%   978   60.1  35.6  26.7 154.5  23.3
6. adm-bb4-v6.ip.twelve99.net                          1.1%   978   57.0  36.7  27.0 157.6  24.3
7. adm-b1-v6.ip.twelve99.net                          30.4%   978   27.8  48.0  27.1 233.6  38.0
8. dk-esbj.nordu.net                                   1.5%   978   37.1  43.6  32.7 162.4  24.2
9. dk-bal2.nordu.net                                   1.1%   978   38.6  50.2  38.3 167.1  25.2
10. lnd88-r1.sunet.se                                   1.0%   978   40.5  54.1  40.2 183.9  27.8
11. vaxjo-vxj-r1.sunet.se                               0.6%   978   42.8  55.6  42.4 209.5  27.5
12. jonkoping-jkg-r1.sunet.se                           1.3%   978   44.4  57.1  44.2 196.1  26.8
13. linkoping-lin3-r1.sunet.se                          0.8%   977   46.1  58.2  45.6 166.8  26.3
14. norrkoping-nkg188-r1.sunet.se                       0.9%   977   48.7  60.6  48.3 234.7  27.8
15. stockholm-tug-r1.sunet.se                           1.2%   977   47.1  59.2  46.8 179.1  26.7
16. ping.sunet.se                                       1.0%   977   48.6  59.8  48.4 180.1  26.5