2020-03-14T02:53:02  -heroes-bot- PROBLEM: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS CRITICAL: DB postgres total locks: 59 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks
2020-03-14T03:01:21  -heroes-bot- PROBLEM: PostgreSQL standby on mirrordb1.infra.opensuse.org - POSTGRES_HOT_STANDBY_DELAY CRITICAL: DB mb_opensuse2 (host:mirrordb2) 33652848 and 0 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PostgreSQL%20standby
2020-03-14T03:11:21  -heroes-bot- RECOVERY: PostgreSQL standby on mirrordb1.infra.opensuse.org - POSTGRES_HOT_STANDBY_DELAY OK: DB mb_opensuse2 (host:mirrordb2) 768944 and 0 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PostgreSQL%20standby
2020-03-14T04:33:02  -heroes-bot- RECOVERY: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS OK: DB postgres total=38 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks
2020-03-14T16:21:52  -heroes-bot- PROBLEM: MySQL WSREP recv on galera3.infra.opensuse.org - CRIT wsrep_local_recv_queue_avg = 1.009226 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=galera3.infra.opensuse.org&service=MySQL%20WSREP%20recv
2020-03-14T17:53:02  -heroes-bot- PROBLEM: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS CRITICAL: DB postgres total locks: 77 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks
2020-03-14T18:28:01  <lcp> kl_eisbaer: looked through the stuff that exists for pgsql multi-master setups, synchronous isn't currently an option by the looks of it
2020-03-14T18:28:32  <lcp> bdr1 was a thing, it's not anymore, it was dropped in december entirely
2020-03-14T18:29:15  <lcp> bdr2 is sold as support licenses, and bdr3 is gonna be open source, but now really a thing yet
2020-03-14T18:29:41  <lcp> the best bet at this moment is async multi-master with bucardo, and that's about it
2020-03-14T18:51:00  <Eighth_Doctor> LCP: iirc, I think we use a multimaster setup of some kind for Fedora's Koji pgsql server
2020-03-14T18:51:16  <Eighth_Doctor> I don't know exactly what setup is used there, but you can look in their Ansible playbook to find out
2020-03-14T18:52:21  <lcp> Conan Kudo: unmaintained bdr1
2020-03-14T18:52:40  <Eighth_Doctor> :(
2020-03-14T18:52:57  <lcp> with pgsql9.4
2020-03-14T18:53:02  <lcp> also unmaintained
2020-03-14T18:54:38  <lcp> Conan Kudo: get 2ndQuadrant to release bdr3 open source already
2020-03-14T18:59:21  <Eighth_Doctor> I don't know anybody at 2ndQ
2020-03-14T18:59:26  <Eighth_Doctor> only percona :(
2020-03-14T19:02:09  <lcp> well then
2020-03-14T19:23:22  -heroes-bot- PROBLEM: MySQL WSREP recv on galera2.infra.opensuse.org - CRIT wsrep_local_recv_queue_avg = 5.006304 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=galera2.infra.opensuse.org&service=MySQL%20WSREP%20recv
2020-03-14T19:33:02  -heroes-bot- RECOVERY: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS OK: DB postgres total=40 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks
2020-03-14T19:57:02  -heroes-bot- PROBLEM: PSQL locks on mirrordb1.infra.opensuse.org - POSTGRES_LOCKS CRITICAL: DB postgres total locks: 50 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PSQL%20locks