2023-08-22T06:12:31  <stacheldrahtje> hi, is the matrix server down atm?
2023-08-22T06:23:06  <microchip_> the bridge has been shut down by Libera
2023-08-22T06:23:37  <acidsys> matrix itself is down
2023-08-22T06:23:39  <acidsys> there's tons of these messages in the kernel log "[Tue Aug 22 06:25:20 2023] systemd-journald[533]: Failed to open system journal: Argument list too long (Dropped 605 similar message(s))"
2023-08-22T06:24:25  <acidsys> it tries to restart itself and then crashes again with "Aug 22 06:23:46 matrix matrix-synapse[32204]: Exception: Error while initialising OIDC provider 'oidc-openSUSE'"
2023-08-22T06:28:32  <acidsys> it complains about not being able to reach id.opensuse.org
2023-08-22T06:28:47  <acidsys> but it works from scar .. maybe something changed in scar's firewall
2023-08-22T06:43:35  <acidsys> but it's only ping that does not work, http works fine and dns lookup via dig as well. so I do not understand why synapse complains "twisted.internet.error.DNSLookupError: DNS lookup failed: no results for hostname lookup: id.opensuse.org."
2023-08-22T06:43:43  <acidsys> I stopped it completely now so it does not try to restart itself forever
2023-08-22T06:44:00  <lcp> even just pinging id.opensuse.org doesn't work from that machine
2023-08-22T06:44:05  <acidsys> seemy previous messages
2023-08-22T06:44:11  <lcp> so it's dns resolution
2023-08-22T06:44:25  <lcp> oh
2023-08-22T06:44:35  <lcp> I read messages before that
2023-08-22T06:44:59  <acidsys> I can resolve the name using dig against both nameservers in resolv.conf so I don't understand why synapse/twisted would not be able to resolv it
2023-08-22T06:46:08  <lcp> welcome to "you can do this one thing an infinite amount of different ways and none of them are quite right"
2023-08-22T06:46:52  <acidsys> :(
2023-08-22T06:47:43  <lcp> also another note, I don't think a whole instance should crash if one of the services can't reach another server
2023-08-22T06:47:54  <lcp> so you can tell this is not going to be done well either way
2023-08-22T06:48:19  <acidsys> heh, I refrained from mocking it about that
2023-08-22T06:50:01  <acidsys> I started it now by putting id.opensuse.org in /etc/hosts ... really ugly
2023-08-22T06:50:41  <acidsys> but there's still lots of these messages "systemd-journald[533]: Failed to open system journal: Argument list too long (Dropped 275 similar message(s))"
2023-08-22T06:52:40  <lcp> hmm
2023-08-22T07:30:09  *** teepee_ is now known as teepee
2023-08-22T10:57:21  *** microchip__ is now known as microchip_
2023-08-22T18:20:27  *** teepee_ is now known as teepee