Re: route nyxx-atm.colorado.edu <-> jsimpson-h.gsfc.nasa.gov

Anne M. Hammond (hammond@solarz.Colorado.EDU)
Wed, 4 Aug 1999 08:57:54 -0600

Hi David and Bill,

jsimpson seems to be up, but the route to jsimpson-h
is not activated for either 128.138.188 or 198.11.22.

Thanks for looking into this!

Anne

sol[75]> /usr/local/etc/traceroute jsimpson.gsfc.nasa.gov
traceroute to jsimpson.gsfc.nasa.gov (128.183.253.43), 30 hops max, 40 byte
packets
1 lcd (128.138.188.1) 2 ms 2 ms 2 ms
2 cuatm-gw.Colorado.EDU (128.138.138.10) 2 ms 2 ms 2 ms
3 204.131.62.38 (204.131.62.38) 4 ms 4 ms 4 ms
4 cs-atm0-0-14.dng.vbns.net (204.147.129.185) 118 ms 28 ms 28 ms
5 nisn-vbns-aads.nsn.nasa.gov (128.161.252.1) 45 ms 47 ms 45 ms
6 128.161.1.82 (128.161.1.82) 53 ms 54 ms 53 ms
7 rtr-wan2-ef.gsfc.nasa.gov (192.43.240.34) 59 ms 61 ms 67 ms
8 rtr-900-b28-cf.gsfc.nasa.gov (128.183.251.63) 61 ms 54 ms 57 ms
9 jsimpson.gsfc.nasa.gov (128.183.253.43) 58 ms 63 ms 72 ms

sol[76]> /usr/local/etc/traceroute jsimpson-h.gsfc.nasa.gov
traceroute to jsimpson-h.gsfc.nasa.gov (169.154.161.43), 30 hops max, 40 byte
packets
1 lcd (128.138.188.1) 2 ms 2 ms 2 ms
2 cuatm-gw.Colorado.EDU (128.138.138.10) 2 ms 2 ms 2 ms
3 204.131.62.38 (204.131.62.38) 4 ms 4 ms 4 ms
4 cs-atm0-0-14.dng.vbns.net (204.147.129.185) 95 ms 291 ms 238 ms
5 204.147.128.198 (204.147.128.198) 91 ms 95 ms 95 ms
6 gsfc-chi.nren.nasa.gov (198.10.64.49) 92 ms 91 ms 92 ms
7 192.12.123.42 (192.12.123.42) 59 ms 54 ms 55 ms
8 * * *

nyxx 34% traceroute jsimpson.gsfc.nasa.gov
traceroute to jsimpson.gsfc.nasa.gov (128.183.253.43), 30 hops max, 40 byte
packets
1 198.11.22.25 (198.11.22.25) 2 ms 2 ms 1 ms
2 204.131.62.38 (204.131.62.38) 4 ms 3 ms 3 ms
3 cs-atm0-0-14.dng.vbns.net (204.147.129.185) 28 ms 28 ms 27 ms
4 nisn-vbns-aads.nsn.nasa.gov (128.161.252.1) 29 ms 30 ms 29 ms
5 128.161.1.82 (128.161.1.82) 59 ms (ttl=252!) 58 ms (ttl=252!) 59 ms
(ttl=252!)
6 rtr-wan1-ef.gsfc.nasa.gov (192.43.240.33) 60 ms (ttl=251!) 60 ms
(ttl=251!) 60 ms (ttl=251!)
7 rtr-900-b28-cf.gsfc.nasa.gov (128.183.251.63) 61 ms (ttl=250!) 48 ms 62
ms (ttl=250!)
8 * * *
9 * *

nyxx 32% traceroute jsimpson-h.gsfc.nasa.gov
traceroute to jsimpson-h.gsfc.nasa.gov (169.154.161.43), 30 hops max, 40 byte
packets
1 198.11.22.25 (198.11.22.25) 2 ms 1 ms 1 ms
2 204.131.62.38 (204.131.62.38) 4 ms 12 ms 3 ms
3 cs-atm0-0-14.dng.vbns.net (204.147.129.185) 147 ms 27 ms 28 ms
4 204.147.128.198 (204.147.128.198) 29 ms 29 ms 29 ms
5 gsfc-chi.nren.nasa.gov (198.10.64.49) 44 ms 44 ms 44 ms
6 192.12.123.42 (192.12.123.42) 44 ms 44 ms 45 ms
7 rtr-900-giga-a.gsfc.nasa.gov (169.154.32.3) 44 ms 44 ms 45 ms
8 * * *
9 * * *
10 * * *

On Aug 3, 9:03pm, David A. Guevara wrote:
> Subject: Re: route nyxx-atm.colorado.edu <-> jsimpson-h.gsfc.nasa.gov
> anne --
>
> the next hop (#8) in your traceroute should be jsimpson-h. I am
> unable to connect to jsimpson at this time. perhaps the system
> crashed? I will check again in the morning. if there is a problem
> it looks like it's on the gsfc side. I'll forward your email to bill fink
> and see what he says.
>
> -- david
>
> >Hi David,
> >
> >The route between nyxx-atm.colorado.edu (198.11.22.19) has
> >gone down in the last "few" days (perhaps over the weekend?
> >Below is a traceroute, and some history.
> >
> >hydra-atm1 is down due to a system crash. But these are
> >on the same physical network.
> >
> >Thanks for your yeoman work in the past. I haven't heard
> >any summary of the differences in data rates; although
> >several people have accounts on our machines and had been
> >looking into it.
> >
> >Thanks for taking a look at this.
> >
> >Anne Hammond
> >
> >
> >
> >nyxx 32% traceroute jsimpson-h.gsfc.nasa.gov
> >traceroute to jsimpson-h.gsfc.nasa.gov (169.154.161.43), 30 hops max, 40
byte
> >packets
> > 1 198.11.22.25 (198.11.22.25) 2 ms 1 ms 1 ms
> > 2 204.131.62.38 (204.131.62.38) 4 ms 12 ms 3 ms
> > 3 cs-atm0-0-14.dng.vbns.net (204.147.129.185) 147 ms 27 ms 28 ms
> > 4 204.147.128.198 (204.147.128.198) 29 ms 29 ms 29 ms
> > 5 gsfc-chi.nren.nasa.gov (198.10.64.49) 44 ms 44 ms 44 ms
> > 6 192.12.123.42 (192.12.123.42) 44 ms 44 ms 45 ms
> > 7 rtr-900-giga-a.gsfc.nasa.gov (169.154.32.3) 44 ms 44 ms 45 ms
> > 8 * * *
> > 9 * * *
> >10 * * *
> >11 * * *
> >
> >
> >
> >On Jun 3, 6:59am, David A. Guevara wrote:
> >> Subject: RE: route from hydra-atm1.colorado.edu -> jsimpson-h.gsfc.nasa.go
> >> Ron --
> >>
> >> Looks good to me. Thank you for your help.
> >>
> >> -- david
> >>
> >> At 7:18 PM -0700 1/1/88, Ron Bonica wrote:
> >> >Folks,
> >> >
> >> >We believe that this problem was corrected last night at about 10PM
eastern
> >> >time. Please contact us if you
> >> >have any further problems.
> >> >
> >> > Ron
> >> >
> >> >> -----Original Message-----
> >> >> From: Kevin Thompson [mailto:kthomp@mci.net]
> >> >> Sent: Wednesday, June 02, 1999 9:01 PM
> >> >> To: David A. Guevara; mgates@dast.nlanr.net
> >> >> Cc: vbns-eng@mci.net; dast@nlanr.net; bill@wizard.nasa.atd.net;
> >> >> hammond@solarz.Colorado.EDU; sgrant@psc.edu; ncne@ncne.org
> >> >> Subject: Re: route from hydra-atm1.colorado.edu ->
> >> >> jsimpson-h.gsfc.nasa.gov
> >> >>
> >> >>
> >> >> David, Mark, Anne, and Shirl,
> >> >>
> >> >> We verified the routing problems you reported, and are working to
restore
> >> >> several missing ospf adjacancies correlated to our Denver switches.
> >> >>
> >> >> We'll update you in the morning with our progress.
> >> >>
> >> >> Kevin Thompson
> >> >> vBNS Engineering
> >> >> 703-715-7073
> >> >>
> >> >> At 11:02 AM 6/2/99 -0700, David A. Guevara wrote:
> >> >> >mark --
> >> >> >
> >> >> >the last time this connection was "working" was back in late
> >> >> >february, early march. vbns might be able to provide
> >> >> >some input with regards to the additional router in our path.
> >> >> >I'll cc a copy of this message to their engineering group.
> >> >> >
> >> >> >-- david
> >> >> >
> >> >> >At 10:31 AM -0700 6/2/99, Mark Gates wrote:
> >> >> >>Hi Anne and David,
> >> >> >>
> >> >> >>I've been investigating the route that you seem to be using. It is
very
> >> >> >>peculiar to me. Do you know what dates you started having problems
> >> >> >>between the machines?
> >> >> >>
> >> >> >>I would say the problem is not congestion but routing. The two things
> >> >> >>that looked odd to me are:
> >> >> >>
> >> >> >> 1) The RTO router that is listed on both traceroutes. RTO is Los
> >> >> >>Angeles, and why your packets would be going through there is a
mystery
> >> >> >>to me. They should go directly between Chicago (DNG) and Denver (DNJ)
> >> >> >>routers.
> >> >> >>
> >> >> >> 2) Looking at various round-trip-time and traffic statistics, it
> >>seems
> >> >> >>there was a definite change in the network on May 20th, 8am UTC. The
> >> >> >>round-trip-time between Denver and Chicago-based institutions jumped
> >> >> >>from 20ms to 40ms. There doesn't appear to be any traffic going
> >>directly
> >> >> >>from the Chicago (DNG) router to the Denver (DNJ) router.
> >> >> >>
> >> >> >>I am going to have the NLANR engineering services group look more at
> >> >> >>this and hopefully discover and fix whatever routing is broken in the
> >> >> >>network. Someone from there may contact you directly if they need
more
> >> >> >>information. You may still contact me also.
> >> >> >>
> >> >> >> -mark
> >> >> >>
> >> >> >>
> >> >> >>Anne Hammond wrote:
> >> >> >>>
> >> >> >>> Hi,
> >> >> >>>
> >> >> >>> This message below from David Guevara of NASA NREN
> >> >> >>>
> >> >> >>> Would you be able to help in analyzing this slowdown?
> >> >> >>>
> >> >> >>> Anne M. Hammond Anne.Hammond@Colorado.EDU
> >> >> >>> Network/UNIX Admin 303-492-5578 (FAX -5325)
> >> >> >>> JILA / University of Colorado at Boulder
> >> >> >>> Boulder, CO 80309-0440
> >> >> >>>
> >> >> >>> ----- Begin Included Message -----
> >> >> >>>
> >> >> >>> >From dguevara@mail.arc.nasa.gov Tue Jun 1 08:59:02 1999
> >> >> >>> Mime-Version: 1.0
> >> >> >>> Content-Type: text/plain; charset="us-ascii"
> >> >> >>> Date: Tue, 1 Jun 1999 07:58:54 -0700
> >> >> >>> To: "Anne M. Hammond" <hammond@solarz.Colorado.EDU>
> >> >> >>> From: "David A. Guevara" <dguevara@mail.arc.nasa.gov>
> >> >> >>> Subject: Re: route from hydra-atm1.colorado.edu ->
> >> >> jsimpson-h.gsfc.nasa.gov
> >> >> >>> Cc: bill@wizard.nasa.atd.net, mitchell@jila.Colorado.EDU,
> >> >> >>> litvanyi@spot.Colorado.EDU, hammond@hydra.colorado.edu,
> >> >> >>> brummell@hydra.colorado.edu, dguevara@mail.arc.nasa.gov
> >> >> >>> Content-Length: 1929
> >> >> >>>
> >> >> >>> anne --
> >> >> >>>
> >> >> >>> the route between hydra-atm1 and jsimpson-h is back up. there
seems
> >> >> >>> to be a congestion problem. currently our rtt is running about
104ms
> >> >> >>> (approximately twice the value we had at the beginning of
> >> >> this project).
> >> >> >>> I think the problem lies with vBNS. See below for traceroutes from
> >> >> >>> hydra-atm1 and jsimpson-h:
> >> >> >>>
> >> >> >>> hydra <~>traceroute jsimpson-h.gsfc.nasa.gov
> >> >> >>> traceroute to jsimpson-h.gsfc.nasa.gov (169.154.161.43), 30
> >> >> hops max, 40
> >> >> >>> byte pa
> >> >> >>> ckets
> >> >> >>> 1 198.11.22.25 (198.11.22.25) 1 ms 1 ms 1 ms
> >> >> >>> 2 204.131.62.38 (204.131.62.38) 3 ms 3 ms 3 ms
> >> >>
> >> >> >>> 3 cs-atm0-0-14.rto.vbns.net (204.147.130.117) 33 ms 33 ms 33
ms
> >> >> >>> 4 cs-atm0-0-13.dng.vbns.net (204.147.129.145) 81 ms 204 ms 81
ms
> >> >> >>> 5 204.147.128.198 (204.147.128.198) 82 ms 82 ms 83 ms
> >> >> >>> 6 gsfc-chi.nren.nasa.gov (198.10.64.49) 97 ms 97 ms 97 ms
> >> >> >>> 7 192.12.123.42 (192.12.123.42) 98 ms 98 ms 98 ms
> >> >> >>> 8 rtr-900-giga-a.gsfc.nasa.gov (169.154.32.3) 98 ms 98 ms 98
ms
> >> >> >>> 9 * jsimpson-h.gsfc.nasa.gov (169.154.161.43) 100 ms 100 ms
> >> >> >>>
> >> >> >>> jsimpson% /etc/traceroute hydra-atm1.colorado.edu
> >> >> >>> traceroute to hydra-atm1.colorado.edu (198.11.22.12), 30 hops
> >> >> max, 96 byte
> >> >> >>> packe
> >> >> >>> ts
> >> >> >>> 1 169.154.161.1 (169.154.161.1) 6.397 ms 7.808 ms 5.467 ms
> >> >> (6.0/6.000)
> >> >> >>> 2 rtr-atm-a.gsfc.nasa.gov (169.154.1.1) 8.553 ms 8.924 ms
> >> >> 11.023 ms
> >> >> >>> (8.0/9.
> >> >> >>> 000)
> >> >> >>> 3 192.12.123.41 (192.12.123.41) 9.189 ms 5.739 ms 7.83
> >> >> ms (7.0/7.000)
> >> >> >>> 4 chi-gsfc.nren.nasa.gov (198.10.64.50) 20.339 ms 22.183
> >> >> ms 22.424 ms
> >> >> >>> (22.0
> >> >> >>> /21.333)
> >> >> >>> 5 204.147.128.197 (204.147.128.197) 21.977 ms 23.711 ms
> >>23.756 ms
> >> >> >>> (23.0/22.
> >> >> >>> 333)
> >> >> >>> 6 cs-atm0-0-12.rto.vbns.net (204.147.129.146) 69.767 ms 72.649
ms
> >> >> >>> 69.713 ms
> >> >> >>> (69.0/70.000)
> >> >> >>> 7 cs-atm0-0-14.dnj.vbns.net (204.147.130.118) 99.653 ms
> >>101.246 ms
> >> >> >>>105.729
> >> >> >>> ms (101.0/101.667)
> >> >> >>> 8 204.131.62.37 (204.131.62.37) 103.403 ms 106.348 ms 104.908
ms
> >> >> >>> (104.0/104
> >> >> >>> .333)
> >> >> >>> 9 hydra-atm1.Colorado.EDU (198.11.22.12) 103.892 ms 104.416 ms
> >> >> 107.273
> >> >> >>> ms (
> >> >> >>> 104.0/104.667)
> >> >> >>>
> >> >> >>> ----- End Included Message -----
> >> >> >>
> >> >> >>--
> >> >> >>Mark Gates 139 ACB
> >> >> >>NLANR applications support 217-244-7959
> >> >> >>http://www.ncsa.uiuc.edu/People/mgates mgates@nlanr.net
> >> >> >
> >> >>
> >> >>
> >>
> >>
> >>
> >>-- End of excerpt from David A. Guevara
>
>-- End of excerpt from David A. Guevara