Hello @Wokkocher,
This is just how the wild Internet works, there’s always some packet loss somewhere, sometimes systematically. It does not affect the standing of your server, only the “Active” monitors are relevant for that. That is why there are so many monitors these days, so that some random network (or other) issue somewhere does not affect a server’s score.
See this recent thread where the same thing was discussed recently, and this description about how the scoring works, and what the different types of monitors (Active, Testing, Candidate) mean.