Depending on the quality of the cable and the splitters you used to share a single GPS antenna, you might have signal reflections, due to impedance mismatch, that corrupt the signal from the satellites, even if it’s strong, causing the receiver to either lose sync or taking too long to load the ephemerides tables.
Try having just one S1 server receiving the antenna signal and setup the other Pi boards as S2 servers referring to it and other external S1 servers.
Thanks for the tips. I will watch these more closely.
At the moment I have 3 x RPI4 on a shared antenna, and 1 x RPI3b+ in a separate location with its own antenna, and I see the same issues, so I am sure my current problems are my own mistakes.
Once I get the configs right and some time I will start to log and track your point more closely and see.