2025-05-05T02:17:04  *** Koffee_ is now known as Koffee
2025-05-05T17:42:42  <matrix-o-o> <hendersj> Out of curiosity, is search broken on the ML archives?  I'm searching for common terms on the factory ML using the web interface, and getting 0 results.
2025-05-05T17:45:15  <acidsys> indeed, solr seems stuck starting
2025-05-05T17:53:58  <acidsys> it seems we got an update to Java / OpenJDK 24, as 23 was dropped due to being EOL. I could not figure out why it does not start with 24 yet, so I installed OpenJDK 21 (which is LTS) for now, with which it started again
2025-05-05T17:54:46  <acidsys> (means search works again now)
2025-05-05T17:55:00  <matrix-o-o> <hendersj> Cool, thanks for the quick fix. :)
2025-05-05T17:56:22  <acidsys> aha I just found https://issues.apache.org/jira/browse/SOLR-17641; so for now I shall make our solr package require a JRE =< 24
2025-05-05T19:35:14  <cboltz> trying to accept a mail in the moderation queue tells me
2025-05-05T19:35:16  <cboltz>     Mailman REST API not available. Please start Mailman core.
2025-05-05T19:35:32  <cboltz> known issue?
2025-05-05T19:38:01  <acidsys> nope, above was an issue with solr which I resolved
2025-05-05T19:39:22  <cboltz> I'd like to check what's going on, but ssh doesn't accept my key :-/
2025-05-05T19:41:59  <acidsys> crameleon@mailman3:/home/crameleon> sudo systemctl restart kanidm-unixd
2025-05-05T19:42:01  <acidsys> sudo: you do not exist in the passwd database
2025-05-05T19:42:03  <acidsys> fun
2025-05-05T19:42:31  <cboltz> salt mailman3.infra.opensuse.org cmd.run 'systemctl status kanidm-unixd.service'   says
2025-05-05T19:42:42  <cboltz>     May 05 19:41:39 mailman3 kanidm_unixd[1626]: 2bbc87f0-e168-4541-9c00-3edc13e97fc2 ERROR    ?? ? [error]: sqlite execute error: SqliteFailure(Error { code: DiskFull, extended_code: 13 }, Some("database or disk is full")) db_path=Some("/var/cache/kanidm-unixd/kanidm.cache.db")
2025-05-05T19:42:58  <acidsys> right I already commented about that in -alerts the other day
2025-05-05T19:44:06  <cboltz> df -h (via salt) confirms that / is really full (100%, only the root-reserved space is left)
2025-05-05T19:45:02  <acidsys> yes
2025-05-05T19:45:03  <cboltz> right, logs growing more than expected (until logrotation)
2025-05-05T19:45:48  <cboltz> do we have bigger logs than (let's say) two weeks ago, or are there other files that also fill up the / partition?
2025-05-05T19:53:06  <acidsys> I did not feel like investigating mailman3.i.o.o myself yet, else I would have investigated those days ago
2025-05-05T21:44:00  *** teepee_ is now known as teepee