2024-01-18T02:30:57  *** teepee_ is now known as teepee
2024-01-18T05:23:10  <SFaulken> did somebody break forums.o.o again?
2024-01-18T10:31:19  <matrix-o-o> <Lubos Kocman> I mean we tend to use AI on slides with geeko-like graphics
2024-01-18T10:31:52  <matrix-o-o> <Lubos Kocman> that I can take, as it's convenient to use, midnight you don't have to bug a suse branding team and wait for weeks :-)
2024-01-18T10:32:27  <matrix-o-o> <Lubos Kocman> but aside from that I try to stay away ... yes yes I did use it for last opensuse quiz :D but it required a lot of manual correction
2024-01-18T10:33:54  <matrix-o-o> <bmwiedemann> AI: finally some automated, fast, convincing liars
2024-01-18T10:34:22  <matrix-o-o> <Lubos Kocman> Yes, I can confirm that :-)
2024-01-18T10:34:31  <matrix-o-o> <bmwiedemann> I forgot eloquent
2024-01-18T11:14:08  *** teepee_ is now known as teepee
2024-01-18T11:55:41  <matrix-o-o> <lcp#0> I find images coming from AI rather ugly and soulless
2024-01-18T12:48:59  <malcolmlewis> cboltz, acidsys as SFaulken indicated, Forums are down...
2024-01-18T12:53:10  <acidsys> hi malcolmlewis, checking
2024-01-18T12:53:40  <malcolmlewis> acidsys, thanks :)
2024-01-18T12:55:37  <acidsys> back
2024-01-18T12:56:00  <malcolmlewis> acidsys, thanks :)
2024-01-18T12:56:14  <malcolmlewis> what went foobar?
2024-01-18T12:57:27  <acidsys> disk was full: https://monitor.opensuse.org/grafana/d/rYdddlPWk/node-metrics?orgId=1&var-DS_PROMETHEUS=default&var-job=nodes&var-node=discourse01.infra.opensuse.org&var-diskdevices=%5Ba-z%5D%2B%7Cnvme%5B0-9%5D%2Bn%5B0-9%5D%2B%7Cmmcblk%5B0-9%5D%2B&viewPanel=152&from=1705578590138&to=1705582606519 (did not finish deploying new alerts yet ..)
2024-01-18T12:58:25  <malcolmlewis> acidsys, oh dear... is the sidekq service running ok?
2024-01-18T12:58:47  <acidsys> sidekiq seems happy
2024-01-18T13:00:15  <malcolmlewis> acidsys, excellent :)
2024-01-18T13:07:09  <matrix-o-o> <Emma [it/its] ⚡️> okay hold up
2024-01-18T13:07:09  <matrix-o-o> <Emma [it/its] ⚡️> what is the scale of this disk usage lol
2024-01-18T13:07:09  <matrix-o-o> <Emma [it/its] ⚡️> like, how big is / in this instance
2024-01-18T13:10:39  <acidsys> here is a graph with sizes instead of percent :) https://monitor.opensuse.org/grafana/d/rYdddlPWk/node-metrics?orgId=1&var-DS_PROMETHEUS=default&var-job=nodes&var-node=discourse01.infra.opensuse.org&var-diskdevices=%5Ba-z%5D%2B%7Cnvme%5B0-9%5D%2Bn%5B0-9%5D%2B%7Cmmcblk%5B0-9%5D%2B&from=1705578590138&to=1705582606519&viewPanel=43
2024-01-18T13:11:29  <acidsys> disk is about 20GB
2024-01-18T13:11:58  <matrix-o-o> <Emma [it/its] ⚡️> oh 20GB, i was thinking 500gb+ lol
2024-01-18T13:14:30  <matrix-o-o> <lcp#0> we usually have very small disk for different services
2024-01-18T13:14:30  <acidsys> wonder if discourse/puma can be configured to log to the journal instead of to disk .. would avoid error prone logrotate tuning
2024-01-18T13:14:42  <matrix-o-o> <lcp#0> I believe so
2024-01-18T13:14:55  <matrix-o-o> <lcp#0> that's how calendar is set up
2024-01-18T13:15:06  <acidsys> neat
2024-01-18T13:15:11  <matrix-o-o> <lcp#0> that being said, I didn't set it up
2024-01-18T13:15:19  <matrix-o-o> <lcp#0> that is now the default afaict
2024-01-18T13:17:27  <acidsys> puma.rb has: stdout_redirect "#{APP_ROOT}/log/puma.log", "#{APP_ROOT}/log/puma.err.log" .. maybe I just need to comment that out?
2024-01-18T13:18:24  <acidsys> hmm nvm seems to only affect puma.log and not production.log
2024-01-18T13:23:06  <acidsys> ah commenting this out plus RAILS_LOG_TO_STDOUT=1 seems to do the trick
2024-01-18T13:32:39  <acidsys> https://gitlab.infra.opensuse.org/infra/salt/-/merge_requests/1338
2024-01-18T14:20:10  *** teepee_ is now known as teepee
2024-01-18T19:48:52  <acidsys> gitlab slow? " Your merge request is almost ready!" and "
2024-01-18T19:49:24  <acidsys> my definition of "almost" begs to differ
2024-01-18T20:25:20  *** teepee_ is now known as teepee