| Re: [chrony-users] chronyd.service doesn't have Restart=on-failure? |
[ Thread Index |
Date Index
| More chrony.tuxfamily.org/chrony-users Archives
]
- To: chrony-users@xxxxxxxxxxxxxxxxxxxx
- Subject: Re: [chrony-users] chronyd.service doesn't have Restart=on-failure?
- From: Miroslav Lichvar <mlichvar@xxxxxxxxxx>
- Date: Mon, 11 Jan 2021 18:15:07 +0100
- Authentication-results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=mlichvar@xxxxxxxxxx
- Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1610385312; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=0dpNlwQmkGjKR4P65ROEPBFB7qPNXPy2bc6juwqzZ0E=; b=SrkAbqACqB4adB7EdZlXMt/1VWa4dYpWBSKz0Fg3EkCQn8W3v4Xq7pBdRToSMQfX51U+9B bnknyleVNaMIgMnczDYdkej7bn38mjX24rB2UrAt57TcaKN4kTqu4GgJ9Vqaq4Lcz7yzMp d1alVaTsTivmcM1P16SOyoxnpBExqD0=
On Mon, Jan 11, 2021 at 05:01:42PM +0000, Jamie Gruener wrote:
> I can see is that we were at 88%+ memory usage and mid 50% CPU usage during the period leading up to the failure and immediately afterwards. I do have detailed syslog data, though, and 10 minutes before chronyd died clamav also died due to an error that is related to an out of memory condition. There's some other evidence (consul logs on other boxes) indicating that other instances were having trouble reaching the problem instance. Something was up with the box, obviously.
Ok, that might be a good hint. If the system was running out of
memory, maybe chronyd was stuck waiting for its pages to load from
disk and execute.
> My working theory is that this problem occurred because chronyd lost network connectivity which would be very similar, conceptually, to losing name resolution. It would take more effort to replicate the behavior than I have time for but setting the time server to some IP that's unreachable, and setting maxpoll to the same as minpoll (or perhaps just to 4, regardless of what minpoll is) should be sufficient, I think.
If you have a reproducer, that would help a lot.
> Perhaps some more documentation about making sure that maxpoll is some number larger than minpoll?
There is no such requirement. Setting both minpoll and maxpoll to 4 is
perfectly fine and not expected to trigger any fatal errors, at least
not in normal conditions.
--
Miroslav Lichvar
--
To unsubscribe email chrony-users-request@xxxxxxxxxxxxxxxxxxxx
with "unsubscribe" in the subject.
For help email chrony-users-request@xxxxxxxxxxxxxxxxxxxx
with "help" in the subject.
Trouble? Email listmaster@xxxxxxxxxxxxxxxxxxxx.