2018-01-05T00:08:54 *** ldevulder has quit IRC 2018-01-05T00:18:46 *** ldevulder has joined #opensuse-admin 2018-01-05T00:36:02 *** malcolmlewis has quit IRC 2018-01-05T00:36:22 *** malcolmlewis has joined #opensuse-admin 2018-01-05T00:36:22 *** malcolmlewis has joined #opensuse-admin 2018-01-05T01:17:39 *** nicolasbock has joined #opensuse-admin 2018-01-05T01:25:14 *** fvogt has quit IRC 2018-01-05T02:04:49 *** plinnell has quit IRC 2018-01-05T02:10:00 *** plinnell has joined #opensuse-admin 2018-01-05T03:14:31 *** nicolasbock has quit IRC 2018-01-05T03:38:39 *** okurz has quit IRC 2018-01-05T03:39:28 *** okurz has joined #opensuse-admin 2018-01-05T03:49:17 *** Son_Goku has joined #opensuse-admin 2018-01-05T04:13:59 *** Fraser_Bell has joined #opensuse-admin 2018-01-05T04:13:59 *** Fraser_Bell has joined #opensuse-admin 2018-01-05T04:15:47 *** Son_Goku has quit IRC 2018-01-05T04:28:11 PROBLEM: Hosts syslog on monitor.infra.opensuse.org - CRITICAL: Found files older than 600 minutes /var/log/opensuse/hosts//wikisearch.log was last modified on Wed Jan 3 18:24:51 2018 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=monitor.infra.opensuse.org&service=Hosts%20syslog 2018-01-05T04:28:35 *** Son_Goku has joined #opensuse-admin 2018-01-05T05:01:27 *** plinnell has quit IRC 2018-01-05T05:04:28 *** plinnell has joined #opensuse-admin 2018-01-05T05:04:28 *** plinnell has joined #opensuse-admin 2018-01-05T05:51:46 *** Son_Goku has quit IRC 2018-01-05T06:16:45 *** Fraser_Bell has quit IRC 2018-01-05T06:18:46 *** tigerfoot has joined #opensuse-admin 2018-01-05T07:22:41 *** tigerfoot has quit IRC 2018-01-05T07:54:53 *** tigerfoot has joined #opensuse-admin 2018-01-05T07:58:27 *** asmorodskyi has joined #opensuse-admin 2018-01-05T08:03:28 *** BManojlovic has quit IRC 2018-01-05T09:32:11 *** sven15 has joined #opensuse-admin 2018-01-05T09:33:28 Can someone take a perticular attention to mirror synchronisation today with meltdown/spectre patches available now on download.o.o, otherwise the load on primary will increase dramastically ... Actually there no mirrors handling for example http://download.opensuse.org/update/leap/42.3/oss/x86_64/kernel-default-4.4.104-39.1.x86_64.rpm.mirrorlist 2018-01-05T09:45:45 *** cboltz has joined #opensuse-admin 2018-01-05T09:50:30 okurz: here? 2018-01-05T09:50:45 tampakrap: yes 2018-01-05T09:51:28 hi, what's your issue with progress.o.o? 2018-01-05T09:54:43 *** cboltz has quit IRC 2018-01-05T09:59:14 tampakrap: I wonder if it wouldn't be easier if I could be an admin of progress.opensuse.org itself to 1) understand what the current instance of redmine running there is capable of, 2) to help SUSE QA (and therefore also myself) doing some non-intrusive changes and 3) at best update and extend with plugins, e.g. for a proper AND/OR query of tickets, of course only after discussing with others and not interfere. WDYT? 2018-01-05T10:00:53 okurz: the current instance is old and we want to update it to leap and recent redmine either way, how about to help me on this instead? 2018-01-05T10:01:19 tampakrap: sure, that could work 2018-01-05T10:01:44 do you already have access to the heroes openvpn? 2018-01-05T10:03:02 I don't think so 2018-01-05T10:03:26 I guess asmorodskyi has already and can also help me with that but I assume you need a key or something by me first? 2018-01-05T10:03:51 I have acess to ariel over ssh. Is that the same network? 2018-01-05T10:04:02 yes I need your gpg key 2018-01-05T10:04:05 no it's different 2018-01-05T10:06:20 the id is 2048R/6BD5CC2D 2018-01-05T10:06:59 better give me the fingerprint 2018-01-05T10:07:01 it's on gpg -K 2018-01-05T10:07:51 if you can trust the IRC channel: AED8 8A50 A2BA 7D3D A254 D33D 10F1 D536 6BD5 CC2D 2018-01-05T10:09:11 if that fingerprint matches a key with trusted sigs then it's fine 2018-01-05T10:29:13 okurz: do you remember still your freeipa password? 2018-01-05T10:29:26 it is the same you used to gitlab.opensuse.org some time ago 2018-01-05T10:29:57 don't try to access gitlab.o.o now, it is behind vpn :) 2018-01-05T10:32:07 tampakrap: I do remember 2018-01-05T10:32:22 okay 2018-01-05T10:37:08 I am logged in. I can try anything else after a playground visit with my daughter :) 2018-01-05T10:40:34 okurz: okay, you have mail 2018-01-05T11:35:05 *** nicolasbock has joined #opensuse-admin 2018-01-05T11:49:34 *** cthugha has joined #opensuse-admin 2018-01-05T11:52:57 *** ldevulder has quit IRC 2018-01-05T12:13:01 *** cboltz has joined #opensuse-admin 2018-01-05T12:14:16 *** fvogt has joined #opensuse-admin 2018-01-05T13:11:53 *** cthugha is now known as ldevulder 2018-01-05T13:17:31 *** Son_Goku has joined #opensuse-admin 2018-01-05T13:35:45 *** cboltz has quit IRC 2018-01-05T13:36:47 *** cboltz has joined #opensuse-admin 2018-01-05T13:36:48 *** cboltz has joined #opensuse-admin 2018-01-05T14:51:50 *** nicolasbock has quit IRC 2018-01-05T15:25:11 *** ChrisBr has quit IRC 2018-01-05T15:28:18 *** ChrisBr has joined #opensuse-admin 2018-01-05T15:34:42 *** malcolmlewis has quit IRC 2018-01-05T15:35:01 *** malcolmlewis has joined #opensuse-admin 2018-01-05T15:35:01 *** malcolmlewis has joined #opensuse-admin 2018-01-05T15:52:39 *** asmorodskyi has quit IRC 2018-01-05T16:08:35 *** sven15 has quit IRC 2018-01-05T16:27:54 *** va3vna has joined #opensuse-admin 2018-01-05T16:31:53 *** asmorodskyi has joined #opensuse-admin 2018-01-05T16:43:09 *** tigerfoot has quit IRC 2018-01-05T16:56:35 *** asmorodskyi has quit IRC 2018-01-05T17:08:49 PROBLEM: memcached data stored on riesling.infra.opensuse.org - MEMCACHE CRITICAL: bytes is 256164370 200000000 - memcached 1.4.33 on 127.0.0.1:11211, up 16 days 21 hours ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=riesling.infra.opensuse.org&service=memcached%20data%20stored 2018-01-05T17:20:56 PROBLEM: HTTP rsync.o.o on widehat.opensuse.org - CRITICAL - Socket timeout after 10 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=widehat.opensuse.org&service=HTTP%20rsync.o.o 2018-01-05T18:00:47 RECOVERY: HTTP rsync.o.o on widehat.opensuse.org - HTTP OK: HTTP/1.1 200 OK - 1217 bytes in 0.331 second response time ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=widehat.opensuse.org&service=HTTP%20rsync.o.o 2018-01-05T18:26:57 PROBLEM: HTTP rsync.o.o on widehat.opensuse.org - CRITICAL - Socket timeout after 10 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=widehat.opensuse.org&service=HTTP%20rsync.o.o 2018-01-05T19:40:12 PROBLEM: HTTP on conference.infra.opensuse.org - HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 922 bytes in 6.022 second response time ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=conference.infra.opensuse.org&service=HTTP 2018-01-05T19:45:43 PROBLEM: HTTP progress on redmine.infra.opensuse.org - HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 968 bytes in 6.021 second response time ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=redmine.infra.opensuse.org&service=HTTP%20progress 2018-01-05T19:49:45 tampakrap: ^^^^^^^^^^^ - can you please check what's wrong? 2018-01-05T19:50:07 looks like MySQL is down once more :-( 2018-01-05T20:00:03 PROBLEM: HAProxy on mufasa.infra.opensuse.org - HAPROXY CRITICAL - Active service narwal4 is DOWN on static proxy ! Active service riesling is DOWN on riesling proxy ! ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=mufasa.infra.opensuse.org&service=HAProxy 2018-01-05T20:03:01 PROBLEM: HAProxy on elsa.infra.opensuse.org - HAPROXY CRITICAL - Active service redmine is DOWN on redmine proxy ! Active service galera2 is DOWN on galera proxy ! ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=elsa.infra.opensuse.org&service=HAProxy 2018-01-05T20:03:02 PROBLEM: HAProxy on anna.infra.opensuse.org - HAPROXY CRITICAL - Active service redmine is DOWN on redmine proxy ! Active service galera2 is DOWN on galera proxy ! ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=anna.infra.opensuse.org&service=HAProxy 2018-01-05T20:16:57 *** dddh_ has joined #opensuse-admin 2018-01-05T20:16:57 *** dddh_ has joined #opensuse-admin 2018-01-05T20:17:31 *** dddh has quit IRC 2018-01-05T20:45:55 *** Son_Goku has quit IRC 2018-01-05T21:56:24 *** va3vna has quit IRC 2018-01-05T22:27:26 *** plinnell has quit IRC 2018-01-05T22:46:26 *** plinnell has joined #opensuse-admin 2018-01-05T22:49:25 *** dddh_ is now known as dddh 2018-01-05T23:34:38 cboltz, is all this mysql? 2018-01-05T23:36:46 yes 2018-01-05T23:37:12 luckily the wikis still use another mysql cluster, so the impact isn't too big 2018-01-05T23:37:28 ("only" progress.o.o, connect.o.o and events.o.o) 2018-01-05T23:41:57 are those servers? 2018-01-05T23:43:47 cboltz, ive noticed no updates on TW all day, is this related? 2018-01-05T23:44:04 no, completely unrelated 2018-01-05T23:44:14 ok 2018-01-05T23:44:37 the "o.o" in the services I mentioned is short for "opensuse.org" 2018-01-05T23:44:48 ahh hah ok 2018-01-05T23:44:50 now things make more sense, right? ;-) 2018-01-05T23:45:01 yup lol 2018-01-05T23:50:37 *** spyonthewall has quit IRC 2018-01-05T23:52:41 *** spyonthewall has joined #opensuse-admin