2024-10-08T01:56:56  <a-865k> forums down again
2024-10-08T01:58:11  <matrix-o-o> <malcolmlewis> max is out of his mind issue again... should be disabled...
2024-10-08T01:58:37  <matrix-o-o> <malcolmlewis> or maybe the auto update...
2024-10-08T01:58:51  <matrix-o-o> <malcolmlewis> hendersj: acidsys ?
2024-10-08T02:26:37  <matrix-o-o> <hendersj> Maxmind is disabled, and because we don't use the docker image, there is no auto-update to the platform from within the forums, but I'm looking at it now.
2024-10-08T02:29:38  <matrix-o-o> <hendersj> I'm not sure what the issue is, though - it may be a result of the changes to disable maxmind, but I don't know for sure.  Will need @acidsys
2024-10-08T02:29:46  <matrix-o-o> <hendersj> +to look into it.
2024-10-08T05:55:17  <matrix-o-o> <bmwiedemann> forums is down since around 01:20 UTC
2024-10-08T05:57:07  <matrix-o-o> <bmwiedemann> discourse-update.service failed once again
2024-10-08T05:58:47  <matrix-o-o> <bmwiedemann> "Gem::LoadError: can't activate webrick-1.8.2, already activated webrick-1.8.1"
2024-10-08T06:09:18  <mdogg> Just an FYI regarding the changes I made to the #openSUSE channel topic:   "Welcome to the openSUSE support channel" replaced "Welcome to #opensuse support" and I replaced http with https://search.opensuse.org/ because it resolves to a secure server.
2024-10-08T06:13:32  <matrix-o-o> <bmwiedemann> The forums problem came from "plugins/discourse-prometheus/plugin.rb:gem "webrick", "1.8.2""
2024-10-08T06:59:37  <acidsys> how did you solve it ?
2024-10-08T07:15:36  <matrix-o-o> <bmwiedemann> https://en.opensuse.org/openSUSE:Post-mortem-20241008
2024-10-08T07:15:46  <matrix-o-o> <bmwiedemann> I hot-patched plugins/discourse-prometheus/plugin.rb to say 1.8.1
2024-10-08T07:20:57  <matrix-o-o> <bmwiedemann> acidsys: maybe we could change the systemd services, so that a failed update-service run does not stop discourse-puma.service ?
2024-10-08T07:22:01  <matrix-o-o> <bmwiedemann> or have a staging system where this runs first and only when that succeeds, deploy the production forums
2024-10-08T07:22:01  <acidsys> ok; I suggest to let marcus know about that issue, upstream main has 1.8.2
2024-10-08T07:22:52  <acidsys> the former one should do in the package and not custom. the latter is possible and thought about by me as well
2024-10-08T09:40:56  <matrix-o-o> <bmwiedemann> darix added some solution via Requires / BuildRequires to the prometheus-plugin package
2024-10-08T10:38:47  <acidsys> perfect
2024-10-08T13:51:53  *** teepee_ is now known as teepee
2024-10-08T15:03:55  <matrix-o-o> <SFaulken> forums.o.o is tossing 503's again
2024-10-08T15:05:15  <matrix-o-o> <SFaulken> and it's back.   momentary glitch I suppose.
2024-10-08T15:54:36  <matrix-o-o> <hendersj> bmwiedemann: discourse-puma automatically runs discourse-update - if it tries to start and update hasn't run (but needs to), then it won't work. I don't know what the potential downside might be to that. But something that I was curious about - if we disabled the maxminddb update in code, why not just remove the maxmind key instead to disable it (IIRC, without the API key, it won't try). If that's what we did, cool.
2024-10-08T16:02:16  <matrix-o-o> <bmwiedemann> SFaulken: I had installed the updates from darix. Those probably needed a quick restart.
2024-10-08T19:07:49  <jshand> opensuse tumbleweed update has been released, has firstyear fallen over again?
2024-10-08T19:15:58  <jshand> don't worry firstyear, false alarm, just came through now
2024-10-08T20:26:14  *** teepee_ is now known as teepee