# Monitoring station seems to hate my server all of a sudden

**URL:** <https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738>\
**Category:** Server operators\
**Created:** [March 2, 2018, 6:29pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738 "2018-03-02T18:29:23Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![tebeve](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/tebeve/32/102_2.png) [@tebeve](https://community.ntppool.org/u/tebeve)\
**Post date:** [March 2, 2018, 6:29pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/1 "2018-03-02T18:29:23Z")

</div>

So, over the last two days one of our locations NTP server seems to be having issues keeping a connection with the monitoring server. The server has been up for just shy of a year now, and previously there were no issues, and nothing in the setup has changed.

We have thousands of active connections, and the server (GPS - Strat 1) is keeping good time, but I just can’t seem to keep a constant connection to the monitoring station.

![ntp-server-monitoring-graph](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/0d2ec9dffa8397290cd937979dd916b3a1d4735c.png)

[http://www.pool.ntp.org/scores/173.161.33.165/log?limit=75](http://www.pool.ntp.org/scores/173.161.33.165/log?limit=75)

We’re not experiencing any other network anomalies, and traffic is well below our our line’s capacity.

I’ve been chasing my tail on this most of yesterday and today, but keep coming up empty. Just wondering if anyone has any thoughts on avenues to go down that I may have not yet tried.

Thanks in advance.

---

<div class="post-metadata">

**Author:** ![tebeve](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/tebeve/32/102_2.png) [@tebeve](https://community.ntppool.org/u/tebeve)\
**Post date:** [March 5, 2018, 7:03pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/2 "2018-03-05T19:03:51Z")

</div>

So it looked like it was finally going to start behaving again on Sunday… but then the bottom dropped out.

![ntp-server-monitoring-graph-update-01](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/bd1580d3e6614df5b410b01d32b1b3553ff683e3.png)

I’m still not experiencing any other network issues, and when I point other external servers to this one, I’m not seeing any connection drops or issues.

Really scratching my head over here on where to look next?

---

<div class="post-metadata">

**Author:** ![ask](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/ask/32/907_2.png) [@ask](https://community.ntppool.org/u/ask)\
**Post date:** [March 6, 2018, 9:01am UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/3 "2018-03-06T09:01:05Z")

</div>

Hi @tebeve – can you try adding your server to the [beta system](https://manage-beta.grundclock.com/manage)? There’s a bit more information in the log there (and multiple monitors).

---

<div class="post-metadata">

**Author:** ![tebeve](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/tebeve/32/102_2.png) [@tebeve](https://community.ntppool.org/u/tebeve)\
**Post date:** [March 6, 2018, 3:28pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/4 "2018-03-06T15:28:20Z")

</div>

Well, that was interesting… I’m getting error “Could not check NTP status” when I try to add the server. However, my two other servers added in just fine.

This has almost got to be an ISP issue (right?). I’ll try my contact there again.

Thanks @ask , I’ll keep trying to add the server to beta, and keep this updated as findings come in.

---

<div class="post-metadata">

**Author:** ![mnordhoff](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/mnordhoff/32/1470_2.png) [@mnordhoff](https://community.ntppool.org/u/mnordhoff)\
**Post date:** [March 6, 2018, 4:23pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/5 "2018-03-06T16:23:22Z")

</div>

One of my servers, [tick.mattnordhoff.com](http://tick.mattnordhoff.com), is also having trouble – with IPv4.

It’s with [Linode](https://www.linode.com/) in Texas, so it’s actually slightly closer to LA than my other servers.

[http://www.pool.ntp.org/scores/45.79.1.70](http://www.pool.ntp.org/scores/45.79.1.70)  
[http://www.pool.ntp.org/scores/2600:3c00::2:b401](http://www.pool.ntp.org/scores/2600:3c00::2:b401)  
[https://web.beta.grundclock.com/scores/45.79.1.70](https://web.beta.grundclock.com/scores/45.79.1.70)  
[https://web.beta.grundclock.com/scores/2600:3c00::2:b401](https://web.beta.grundclock.com/scores/2600:3c00::2:b401)

---

<div class="post-metadata">

**Author:** ![danimal](https://avatars.discourse-cdn.com/v4/letter/d/bb73d2/32.png) [@danimal](https://community.ntppool.org/u/danimal)\
**Post date:** [March 6, 2018, 4:58pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/6 "2018-03-06T16:58:23Z")

</div>

I am in the same situation. A Linode in Texas, the IPv6 is fine, the IPv4 is tanked. I’ll look at the beta system and report back.

---

<div class="post-metadata">

**Author:** ![danimal](https://avatars.discourse-cdn.com/v4/letter/d/bb73d2/32.png) [@danimal](https://community.ntppool.org/u/danimal)\
**Post date:** [March 6, 2018, 5:02pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/7 "2018-03-06T17:02:04Z")

</div>

Same as @tebeve, “Could not check NTP status” when i try to add it to the beta system.

---

<div class="post-metadata">

**Author:** ![curbynet](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/curbynet/32/147_2.png) [@curbynet](https://community.ntppool.org/u/curbynet)\
**Post date:** [March 6, 2018, 5:09pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/8 "2018-03-06T17:09:45Z")

</div>

Just here to say “me too.” My Dallas Linode is doing ok (score above 10 but seeing more drops than usual), but my server connected through Comcast Business is reported as having all sorts of issues.

Given the heterogenous nature of our affected servers and their myriad paths to the monitoring station, I wonder if it’s a problem with the monitoring station or its ISP.

[http://www.pool.ntp.org/user/curby](http://www.pool.ntp.org/user/curby)

Problems started happening right after midnight on March 1 according to the tracker:

 ![hesdeadjim](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/d072f826a4664956e8cce34b44d5480be8eb036b.png)

---

<div class="post-metadata">

**Author:** ![tebeve](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/tebeve/32/102_2.png) [@tebeve](https://community.ntppool.org/u/tebeve)\
**Post date:** [March 6, 2018, 5:22pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/9 "2018-03-06T17:22:07Z")

</div>

Oh, I guess I forgot to mention that, thanks @curbynet … Comcast Business here as well - West Central IL.

However, my other two servers located in Southeast and Central IA, (both with small ISP, fiber connections to the interwebs) are solid as a rock.

I have a trouble ticket in with Comcast currently, so we’ll see how that goes.

**EDIT:** Also, you’re top graph is how mine started, and just steadily went downhill.

---

<div class="post-metadata">

**Author:** ![curbynet](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/curbynet/32/147_2.png) [@curbynet](https://community.ntppool.org/u/curbynet)\
**Post date:** [March 6, 2018, 5:32pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/10 "2018-03-06T17:32:25Z")

</div>

I updated my first post with a graph that looks further into the past, but you might have to click it since it isn’t served over HTTPS. Both servers were reported as having issues shortly after midnight March 1, but the linode is just less affected.

---

<div class="post-metadata">

**Author:** ![tebeve](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/tebeve/32/102_2.png) [@tebeve](https://community.ntppool.org/u/tebeve)\
**Post date:** [March 6, 2018, 6:01pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/11 "2018-03-06T18:01:38Z")

</div>

> [@curbynet](#):
>
> Problems started happening right after midnight on March 1 according to the tracker:

“1519863696,“2018-03-01 00:21:36”,-5,14,0”

Same here

 ![shouldnthavewornthereduniformtoday](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/bb793b6ebb78a0c8724ec04ea2776a2c451e9f45.png)

---

<div class="post-metadata">

**Author:** ![curbynet](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/curbynet/32/147_2.png) [@curbynet](https://community.ntppool.org/u/curbynet)\
**Post date:** [March 6, 2018, 6:43pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/12 "2018-03-06T18:43:21Z")

</div>

I’ve added one of my servers to the beta site: [https://web.beta.grundclock.com/scores/72.14.181.128](https://web.beta.grundclock.com/scores/72.14.181.128)

---

<div class="post-metadata">

**Author:** ![tebeve](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/tebeve/32/102_2.png) [@tebeve](https://community.ntppool.org/u/tebeve)\
**Post date:** [March 6, 2018, 8:06pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/13 "2018-03-06T20:06:50Z")

</div>

@ask , I finally got the server to actually get picked up by the beta monitors.

[https://web.beta.grundclock.com/scores/173.161.33.165](https://web.beta.grundclock.com/scores/173.161.33.165)

---

<div class="post-metadata">

**Author:** ![tebeve](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/tebeve/32/102_2.png) [@tebeve](https://community.ntppool.org/u/tebeve)\
**Post date:** [March 6, 2018, 9:04pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/15 "2018-03-06T21:04:38Z")

</div>

They’re also trending up on the old system as well tho, soooo. I guess time will tell.

_fingers crossed_

---

<div class="post-metadata">

**Author:** ![cramerd](https://avatars.discourse-cdn.com/v4/letter/c/51bf81/32.png) [@cramerd](https://community.ntppool.org/u/cramerd)\
**Post date:** [March 7, 2018, 1:32pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/16 "2018-03-07T13:32:35Z")

</div>

Hi.  
I noticed the same thing myself with two servers in Ireland. One is an EC2 droplet, and the the other is a server behind a business fibre connection. On looking at the [monthly system metrics](https://status.ntppool.org/#month), it is clear that something happened on the 1st of March which affected enough IPv4 servers to register on the overall graph.

 ![glitchinthematrix](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/5d6d652e8706672d7c6f4e14a5b892ef0a2230f4.png)

---

<div class="post-metadata">

**Author:** ![curbynet](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/curbynet/32/147_2.png) [@curbynet](https://community.ntppool.org/u/curbynet)\
**Post date:** [March 7, 2018, 6:47pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/17 "2018-03-07T18:47:22Z")

</div>

> [@tebeve](#):
>
> I guess time will tell.

Time’s telling us it’s still having issues on the new system. If anyone’s on #ntp on freenode there’s been some talk of it there as well.

EDIT: So people don’t have to check both, I think we’ve identified several affected ISPs:

Linode in Dallas  
Comcast in Illinois  
Comcast in New Mexico  
Centurylink in Colorado  
Two providers in Ireland

Someone in IRC mentioned that this happens occasionally, and the culprit is a routing/networking issue between the monitoring station’s ISP and parts of the Internet. If it’s not already being done, is there an admin who can work with the monitoring station’s ISP to look into that? Thanks!

EDIT 2018-03-08

My Comcast is doing better over the last 36+ hours, my Linode is still seesawing up and down.

[http://www.pool.ntp.org/user/curby](http://www.pool.ntp.org/user/curby)

Curious that Linode Dallas has multiple IP ranges … i wonder if there’s some pattern to certain subnets that are more drastically affected.

By the way, only three replies per topic? Really?

---

<div class="post-metadata">

**Author:** ![mnordhoff](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/mnordhoff/32/1470_2.png) [@mnordhoff](https://community.ntppool.org/u/mnordhoff)\
**Post date:** [March 8, 2018, 6:03pm UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/18 "2018-03-08T18:03:33Z")

</div>

My Dallas Linode’s score is up to 15.4. Last dropped packet was at 05:20.

[http://www.pool.ntp.org/scores/45.79.1.70](http://www.pool.ntp.org/scores/45.79.1.70)

Beta is a different story, but it’s trending upward, more or less.

[https://web.beta.grundclock.com/scores/45.79.1.70](https://web.beta.grundclock.com/scores/45.79.1.70)

---

<div class="post-metadata">

**Author:** ![curbynet](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/curbynet/32/147_2.png) [@curbynet](https://community.ntppool.org/u/curbynet)\
**Post date:** [March 9, 2018, 12:35am UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/19 "2018-03-09T00:35:06Z")

</div>

Ok, more info: the problems seem consistently periodic. Things get better around midnight GMT. This seems consistent over the past four days, even on Wednesday which had a smaller peak.

 ![42%20PM](https://us1.discourse-cdn.com/flex016/uploads/ntppool/original/1X/e7887b60fce92601399d6d6413de65cd8207ce1d.png)

---

<div class="post-metadata">

**Author:** ![studentmain](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/studentmain/32/354_2.png) [@studentmain](https://community.ntppool.org/u/studentmain)\
**Post date:** [March 9, 2018, 6:38am UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/20 "2018-03-09T06:38:55Z")

</div>

Maybe just overload…Me too.

---

<div class="post-metadata">

**Author:** ![ask](https://sea2.discourse-cdn.com/flex016/user_avatar/community.ntppool.org/ask/32/907_2.png) [@ask](https://community.ntppool.org/u/ask)\
**Post date:** [March 9, 2018, 6:46am UTC](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738/21 "2018-03-09T06:46:43Z")

</div>

Hi everyone,

We’ve definitely gotten more emails like this lately, too. Thank you for putting some dates on it and discussing it here. It’s pretty frustrating.

I haven’t had time to dig through the data to try to figure out what the pattern is. Nothing obvious is standing out. We have lost some servers, but it seems to go up and down day by day – [http://www.pool.ntp.org/zone](http://www.pool.ntp.org/zone)

Remember you can do traceroute’s from the Los Angeles network at [https://trace.ntppool.org/traceroute/8.8.8.8](https://trace.ntppool.org/traceroute/8.8.8.8)

Eventually I’ll get to adding a “automatic traceroute” feature and some code that’ll correlate network paths automatically. Some day, there’s a lot on the todo list.

[Next page](https://community.ntppool.org/t/monitoring-station-seems-to-hate-my-server-all-of-a-sudden/738.md?page=2)
