2018-11-13T00:08:26  *** lcp has quit IRC
2018-11-13T00:09:50  *** cboltz has quit IRC
2018-11-13T00:11:59  *** lcp has joined #opensuse-admin
2018-11-13T00:44:58  *** boombatower has joined #opensuse-admin
2018-11-13T01:31:54  *** boombatower has quit IRC
2018-11-13T02:21:26  *** Son_Goku has joined #opensuse-admin
2018-11-13T02:56:57  *** boombatower has joined #opensuse-admin
2018-11-13T03:37:30  *** okurz has quit IRC
2018-11-13T03:40:41  *** okurz has joined #opensuse-admin
2018-11-13T04:03:59  *** boombatower has quit IRC
2018-11-13T04:51:18  *** foursixnine has quit IRC
2018-11-13T05:02:55  *** foursixnine has joined #opensuse-admin
2018-11-13T05:26:27  *** Son_Goku has quit IRC
2018-11-13T06:05:00  *** Fraser_Bell has joined #opensuse-admin
2018-11-13T07:08:27  *** asmorodskyi has joined #opensuse-admin
2018-11-13T07:09:21  *** tampakrap has quit IRC
2018-11-13T07:10:34  *** tampakrap has joined #opensuse-admin
2018-11-13T07:26:01  *** ldevulder_ has joined #opensuse-admin
2018-11-13T07:29:11  *** ldevulder has quit IRC
2018-11-13T07:51:00  *** ldevulder_ is now known as ldevulder
2018-11-13T08:40:10  *** lcp has quit IRC
2018-11-13T08:48:26  *** dakechi has joined #opensuse-admin
2018-11-13T08:52:24  *** matthias_bgg has joined #opensuse-admin
2018-11-13T09:20:55  *** Fraser_Bell has left #opensuse-admin
2018-11-13T09:24:46  <heroes-bot> PROBLEM: SSL cert status2 on status2.opensuse.org - CRITICAL - Certificate status.opensuse.org expired on Sat 13 Oct 2018 09:10:13 AM GMT +0000. ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=status2.opensuse.org&service=SSL%20cert%20status2
2018-11-13T10:13:31  <heroes-bot> PROBLEM: PerfData on monitor.infra.opensuse.org - CRITICAL: Found files older than 2880 minutes /var/lib/pnp4nagios/perfdata//proc_Rsyslog_Process.xml was last modified on Thu Jun 21 09:42:54 2018 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=monitor.infra.opensuse.org&service=PerfData
2018-11-13T10:59:33  <heroes-bot> RECOVERY: SSH on elsa.infra.opensuse.org - SSH OK - OpenSSH_7.6 (protocol 2.0) ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=elsa.infra.opensuse.org&service=SSH
2018-11-13T11:14:04  *** Son_Goku has joined #opensuse-admin
2018-11-13T11:16:57  *** lcp has joined #opensuse-admin
2018-11-13T11:52:46  *** cboltz has joined #opensuse-admin
2018-11-13T12:03:27  *** lcp has quit IRC
2018-11-13T12:18:35  *** JulienLau has joined #opensuse-admin
2018-11-13T13:02:16  *** matthias_bgg has quit IRC
2018-11-13T13:02:43  *** matthias_bgg has joined #opensuse-admin
2018-11-13T13:13:23  *** boombatower has joined #opensuse-admin
2018-11-13T14:20:42  <cboltz> tampakrap: regarding the empty mb_opensuse2.dump.custom on olaf - on admin-auto I see the explanation:
2018-11-13T14:20:48  <cboltz> pg_dump: [archiver (db)] connection to database "mb_opensuse2" failed: fe_sendauth: no password supplied
2018-11-13T14:21:31  <tampakrap> I fixed that yesterday
2018-11-13T14:21:41  * tampakrap checks
2018-11-13T14:21:54  <tampakrap> apparently I didn't
2018-11-13T14:21:56  <tampakrap> :/
2018-11-13T14:23:17  <tampakrap> that's weird, the password is there
2018-11-13T14:27:06  <cboltz> the mail looks like pg_dump tries to read it from stdin
2018-11-13T14:27:49  <tampakrap> no it reads it from ~mirrorbrain/.pgpass
2018-11-13T14:27:58  <tampakrap> I fixed it, it was a typo on the hostname
2018-11-13T14:28:02  <tampakrap> but now there is a new issue
2018-11-13T14:28:08  <tampakrap> pg_dump: server version: 11.1; pg_dump version: 9.6.10
2018-11-13T14:28:10  <tampakrap> pg_dump: aborting because of server version mismatch
2018-11-13T14:43:30  *** Son_Goku has quit IRC
2018-11-13T14:51:20  *** Son_Goku has joined #opensuse-admin
2018-11-13T15:37:55  *** Son_Goku has quit IRC
2018-11-13T16:06:55  *** Son_Goku has joined #opensuse-admin
2018-11-13T16:09:57  <heroes-bot> PROBLEM: PostgreSQL standby on mirrordb1.infra.opensuse.org - POSTGRES_HOT_STANDBY_DELAY CRITICAL: DB mb_opensuse2 (host:mirrordb2) 7955648 and 1 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PostgreSQL%20standby
2018-11-13T16:11:06  <heroes-bot> PROBLEM: keepalived on elsa.infra.opensuse.org - Became master: 0 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=elsa.infra.opensuse.org&service=keepalived
2018-11-13T16:19:57  <heroes-bot> RECOVERY: PostgreSQL standby on mirrordb1.infra.opensuse.org - POSTGRES_HOT_STANDBY_DELAY OK: DB mb_opensuse2 (host:mirrordb2) 400320 and 0 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PostgreSQL%20standby
2018-11-13T16:25:50  <heroes-bot> PROBLEM: SSH on olaf.infra.opensuse.org - SSH CRITICAL - OpenSSH_7.6 (protocol 2.0) version mismatch, expected OpenSSH_7.2 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=olaf.infra.opensuse.org&service=SSH
2018-11-13T16:30:32  *** mcaj has quit IRC
2018-11-13T16:32:36  *** Son_Goku has quit IRC
2018-11-13T16:39:54  <tampakrap> cboltz: olaf upgraded to leap 15 and postgresql client 11, dump running now
2018-11-13T16:40:32  <cboltz> :-)
2018-11-13T16:41:01  <cboltz> that also explains why the monitoring complains about the wrong ssh protocol version ;-)
2018-11-13T16:45:52  <heroes-bot> RECOVERY: SSH on olaf.infra.opensuse.org - SSH OK - OpenSSH_7.6 (protocol 2.0) ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=olaf.infra.opensuse.org&service=SSH
2018-11-13T17:10:56  *** JulienLau has quit IRC
2018-11-13T17:15:04  *** matthias_bgg has quit IRC
2018-11-13T17:54:46  *** dakechi has quit IRC
2018-11-13T20:40:16  *** matthias_bgg has joined #opensuse-admin
2018-11-13T20:46:36  *** matthias_bgg has quit IRC
2018-11-13T20:53:57  <heroes-bot> PROBLEM: PostgreSQL standby on mirrordb1.infra.opensuse.org - POSTGRES_HOT_STANDBY_DELAY CRITICAL: DB mb_opensuse2 (host:mirrordb2) 3144656 and 0 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PostgreSQL%20standby
2018-11-13T21:00:01  <heroes-bot> PROBLEM: Root Partition on localhost - DISK CRITICAL - free space: / 2097 MB (10% inode=73%): ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=localhost&service=Root%20Partition
2018-11-13T21:03:57  <heroes-bot> RECOVERY: PostgreSQL standby on mirrordb1.infra.opensuse.org - POSTGRES_HOT_STANDBY_DELAY OK: DB mb_opensuse2 (host:mirrordb2) 802928 and 0 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mirrordb1.infra.opensuse.org&service=PostgreSQL%20standby
2018-11-13T21:16:06  *** matthias_bgg has joined #opensuse-admin
2018-11-13T21:25:06  *** foursixnine has quit IRC
2018-11-13T21:44:01  *** foursixnine has joined #opensuse-admin
2018-11-13T21:50:03  *** matthias_bgg has quit IRC
2018-11-13T22:19:38  *** malcolmlewis has quit IRC
2018-11-13T23:06:15  *** Fraser_Bell has joined #opensuse-admin
2018-11-13T23:18:08  *** foursixnine has quit IRC
2018-11-13T23:34:10  *** cboltz has quit IRC