2020-04-09T00:38:00  -heroes-bot- PROBLEM: MySQL WSREP recv on galera3.infra.opensuse.org - CRIT wsrep_local_recv_queue_avg = 3.170730 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=galera3.infra.opensuse.org&service=MySQL%20WSREP%20recv
2020-04-09T02:48:10  *** okurz_ is now known as okurz
2020-04-09T04:44:08  -heroes-bot- PROBLEM: PSQL locks on mirrordb2.infra.opensuse.org - POSTGRES_LOCKS CRITICAL: DB postgres total locks: 349 * total waiting locks: 170 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb2.infra.opensuse.org&service=PSQL%20locks
2020-04-09T04:46:55  -heroes-bot- PROBLEM: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS CRITICAL: DB postgres total waiting locks: 1 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks
2020-04-09T04:54:08  -heroes-bot- RECOVERY: PSQL locks on mirrordb2.infra.opensuse.org - POSTGRES_LOCKS OK: DB postgres total=1 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb2.infra.opensuse.org&service=PSQL%20locks
2020-04-09T04:56:55  -heroes-bot- RECOVERY: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS OK: DB postgres total=16 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks
2020-04-09T06:54:54  -heroes-bot- PROBLEM: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS CRITICAL: DB postgres total locks: 52 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks
2020-04-09T11:57:27  <klein> Hey there, just an update on our Salt pipelines... as you know they are a mess
2020-04-09T11:57:46  <klein> and, as they are now, we cannot run inside a simple docker instane
2020-04-09T11:57:50  <klein> *instance
2020-04-09T11:58:14  <klein> so, what I am going to do is simplify the tests making them run only the linter and the deploy
2020-04-09T11:58:45  <klein> we are already working in the internal suse EnfInfra salt code and make the tests better (they are the same mess as we have here) is one of the goals
2020-04-09T11:58:57  <klein> I hope that I can make them work today
2020-04-09T12:10:25  <lcp> klein: thank you for all of the work!
2020-04-09T12:43:26  <klein> don't thank yet... the first version of the new pipeline will be ugly as hell :-)
2020-04-09T13:02:20  <klein> ok, pipeline working https://gitlab.infra.opensuse.org/infra/salt/-/jobs/7653
2020-04-09T13:02:34  <klein> now some things....
2020-04-09T13:03:21  <klein> (1) It is ugly, I am installing salt-lint during runtime, I need to make my OBS work to build a custom container with all included, that will make the whole processo go from 2min to less than 1
2020-04-09T13:04:15  <klein> (2) I am not failing the pipeline if the linter finds something he doesn't like, I think we need to talk more about that and decide how it should be
2020-04-09T13:05:29  <klein> (3) we are not making any functional tests, only then linter, but, the old functional tests never got any of the errors I did in the past, so, I think they were useless anyway, but we need to implement something, I am hoping that we can get the new Salt3000 soon on openSUSE and SUSE, so we can write better tests for everything
2020-04-09T13:05:46  <klein> I really would like to see cboltz opinion on this
2020-04-09T13:06:04  <klein> lcp: with this concerns, should I enable the pipeline as it is so at least people can work?
2020-04-09T13:08:04  <klein> ls
2020-04-09T13:08:18  <klein> ops, this "ls" was not meant to be here heheh)
2020-04-09T13:09:39  <lcp> klein: yes, those seem like something we have to figure overtime anyway
2020-04-09T13:16:07  <klein> yes... well... since cboltz is not here now, I added him as reviewer on my PR https://gitlab.infra.opensuse.org/infra/salt/-/merge_requests/362
2020-04-09T13:16:38  <klein> I know that he will find at least 500+ errors / opportunities for improvement... and I like it :-)
2020-04-09T15:12:28  <klein> exit
2020-04-09T17:34:16  <cboltz> klein, lcp - how do you like https://gitlab.infra.opensuse.org/infra/salt/-/merge_requests/363 ? ;-)
2020-04-09T17:35:39  <cboltz> (and thanks for setting up a CI runner, klein!)
2020-04-09T18:12:06  <lcp> looks fine to me
2020-04-09T18:14:39  <cboltz> :-)
2020-04-09T18:15:54  <cboltz> (feel free to click the +1 in gitlab ;-)
2020-04-09T18:16:18  <cboltz> I'll give klein a chance to comment on it, and if he doesn't object until tomorrow, I'll merge it
2020-04-09T18:16:49  <cboltz> and then ask everybody to rebase the pending merge requests to make the pipeline green
2020-04-09T18:18:00  <cboltz> as a sidenote - I enjoyed reading the IRC log from today afternoon in more than one way ;-)
2020-04-09T20:40:06  -heroes-bot- PROBLEM: HAProxy on provo-proxy1.infra.opensuse.org - HAPROXY CRITICAL - Active service debuginfod is DOWN on debuginfod proxy ! ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=provo-proxy1.infra.opensuse.org&service=HAProxy