# "i/o timeout" from different monitoring stations

**URL:** <https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442>\
**Category:** Server operators\
**Tags:** monitoring\
**Created:** [October 7, 2019, 9:00am UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442 "2019-10-07T09:00:45Z")\
**Posts on this page:** 11\
**Page:** 3

<div class="post-metadata">

**Author:** ![littlejason99](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/littlejason99/32/242_2.png) [@littlejason99](https://community.ntppool.org/u/littlejason99)\
**Post date:** [January 19, 2020, 5:01pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/41 "2020-01-19T17:01:31Z")

</div>

> [@Dave](#):
>
> What do you make of the outputs shown above? It does seem strange that for a year perfect and then, bang, all over the place, with absolutely no change whatsoever this end, from the middle of this week onwards.

Likely someone at Zayo made a network change that had a negative impact. If the issue doesn’t resolve itself in the next few days you can try contacting Zayo tech support explaining the issue and sending that MTR report so they know which routers are causing issues.

---

<div class="post-metadata">

**Author:** ![Dave](https://avatars.discourse-cdn.com/v4/letter/d/ee7513/32.png) [@Dave](https://community.ntppool.org/u/Dave)\
**Post date:** [January 19, 2020, 6:31pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/42 "2020-01-19T18:31:22Z")

</div>

Thank you elljay and littlejason - very much appreciated.

So I will sit on my hands and wait. Perhaps that was the best move, but after a year never having had this problem, I was concerned - it has always been rock solid. Since early Wednesday until today didn’t strike me as something that was going to go away. Latest Stats - production:

![NTP 19Jan2020-3](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/80981d072501ab2b841b4ba3cf0810d4b9bb560c.png)

And Beta:

 ![NTP 19Jan2020-Beta 3](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/5e280fb87b2f9f3539c9428a23f047a84c769611.png)

I will revert back tomorrow, hopefully to say case closed.

Once again, many thanks,

Dave.

---

<div class="post-metadata">

**Author:** ![ask](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/ask/32/907_2.png) [@ask](https://community.ntppool.org/u/ask)\
**Post date:** [January 19, 2020, 10:10pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/43 "2020-01-19T22:10:06Z")

</div>

> [@Dave](#):
>
> Once again, many thanks,

Thank you for helping test and diagnose! (And of course for having a server in the pool) 🙂

---

<div class="post-metadata">

**Author:** ![Dave](https://avatars.discourse-cdn.com/v4/letter/d/ee7513/32.png) [@Dave](https://community.ntppool.org/u/Dave)\
**Post date:** [January 20, 2020, 3:29pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/44 "2020-01-20T15:29:22Z")

</div>

Still ‘sitting on my hands’ and was about to post that things are resolved. Sever has been in the pool since 10:00 UTC, but will likely drop out in a moment. However, best performance since last Tuesday Wednesday.

Here are the stats, Beta:

![NTP 20Jan2020-Beta 4](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/aef19510f9c782a774405178ebb702a8fa8ff549.png)

And production:

![NTP 20Jan2020-4](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/470bd00877450237ebcf09ba262a1876f13e2305.png)

Back to sitting on my hands, I’ll update if anything remarkable happens, and any advice is of course welcome.

Many thanks,

Dave.

---

<div class="post-metadata">

**Author:** ![elljay](https://avatars.discourse-cdn.com/v4/letter/e/5fc32e/32.png) [@elljay](https://community.ntppool.org/u/elljay)\
**Post date:** [January 21, 2020, 8:46am UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/45 "2020-01-21T08:46:19Z")

</div>

Hi Dave, my advice would be:

- check that your server is working as you expect and that it can be accessed from the internet (Google a “check my ntp” site)
- run mtr to the monitor and if there’s something obvious report it to your ISP to sort out.
- if your score is \>10 ignore it 🙂
- if it’s intermittent and it’s bugging you, I would work out when the checks from the monitor are due (you can watch them come in with the appropriate tcpdump recipe), then fire up mtr around the same time and see if the monitor packets arrive / gets an answer / there’s an obvious drop along the route at that time.

---

<div class="post-metadata">

**Author:** ![Dave](https://avatars.discourse-cdn.com/v4/letter/d/ee7513/32.png) [@Dave](https://community.ntppool.org/u/Dave)\
**Post date:** [January 24, 2020, 1:57pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/46 "2020-01-24T13:57:43Z")

</div>

Thank you elljay - advice much appreciated.

Everything seems to have settled down now - ‘sitting on my hands’ seems to have worked.

Production stats:

![NTP 24Jan2020](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/81e2481961597be355fbb033476813c8a33e891e.png)

Beta stats:

![NTP 24Jan2020 Beta](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/ba23c2175242b4d1cd260301c6564a9aab7acd3d.png)

NTP Server Stats, which nicely shows the active pool time since rebooting (everything):

 ![Stats](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/7359541fa6fa0147bdfcaa12236b18125a52e684.png)

So for me it is case closed.

Many thanks everyone for all the very helpful advice and pointers.

All the best,

Dave.

---

<div class="post-metadata">

**Author:** ![elljay](https://avatars.discourse-cdn.com/v4/letter/e/5fc32e/32.png) [@elljay](https://community.ntppool.org/u/elljay)\
**Post date:** [January 24, 2020, 2:29pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/47 "2020-01-24T14:29:47Z")

</div>

“Internet pipe cleaning complete. Normal service will now resume.” 😀

🍵

---

<div class="post-metadata">

**Author:** ![kenyon](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/kenyon/32/45_2.png) [@kenyon](https://community.ntppool.org/u/kenyon)\
**Post date:** [January 26, 2020, 9:56am UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/48 "2020-01-26T09:56:26Z")

</div>

> [@Dave](#):
>
> Would appear that something is wrong between the UK and US, at [zayo.com](http://zayo.com), am I correct? Or is that normal at that point - the core routers are too busy to acknowledge low priority traffic? Left it running for 2000 packets so far (more that the appended image) and zero loss end to end, if that makes sense?

Right, end-to-end is what matters. Loss at intermediate hops is irrelevant if you have no loss at the endpoint. So your output looks fine to me.

---

<div class="post-metadata">

**Author:** ![umike](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/umike/32/1486_2.png) [@umike](https://community.ntppool.org/u/umike)\
**Post date:** [January 27, 2020, 2:57pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/49 "2020-01-27T14:57:57Z")

</div>

Hi, All!

I want to say: this gap (graph from posts above) looks like traffic route in transit between monitoring and ntp server is changed.  
Permanent offset in many cases arises from delays in asymmetric routing/delay. So, when offset was ± constant and then changes abruptly to some ms and stay, it’s very likely that network routing changes in transit and affect to delays. Check you traceroute to pool and reverse (debug link is posted some posts earlier)  
 ![offset_gap](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/71ea0f4b725a6488ea372a06dcfa9760c8eed5a3.png)

And this is a good news about monitoring changes and development from Ask 🙂

---

<div class="post-metadata">

**Author:** ![littlejason99](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/littlejason99/32/242_2.png) [@littlejason99](https://community.ntppool.org/u/littlejason99)\
**Post date:** [January 27, 2020, 3:17pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/50 "2020-01-27T15:17:34Z")

</div>

Jumps like that can also be when your NTP program decides to choose a different source as its primary.

---

<div class="post-metadata">

**Author:** ![umike](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/umike/32/1486_2.png) [@umike](https://community.ntppool.org/u/umike)\
**Post date:** [January 27, 2020, 3:25pm UTC](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442/51 "2020-01-27T15:25:40Z")

</div>

really there are many reasons. If you run stratum1 server and “do nothing changes” then it looks like change in route delays.

[Previous page](https://community.ntppool.org/t/i-o-timeout-from-different-monitoring-stations/1442.md?page=2)
