2018-04-25T00:05:31 *** Son_Goku has joined #opensuse-admin 2018-04-25T02:08:03 *** cthugha has joined #opensuse-admin 2018-04-25T02:11:13 *** ldevulder has quit IRC 2018-04-25T02:18:57 *** okurz has quit IRC 2018-04-25T02:19:10 *** okurz_ has joined #opensuse-admin 2018-04-25T02:19:18 *** okurz_ is now known as okurz 2018-04-25T02:32:40 *** nicolasbock has quit IRC 2018-04-25T03:10:02 *** Son_Goku has quit IRC 2018-04-25T03:31:00 *** lcp has quit IRC 2018-04-25T04:01:50 *** lcp has joined #opensuse-admin 2018-04-25T04:45:35 *** plinnell has quit IRC 2018-04-25T07:11:51 *** ancorgs has joined #opensuse-admin 2018-04-25T07:13:42 *** cthugha has quit IRC 2018-04-25T07:14:37 *** cthugha has joined #opensuse-admin 2018-04-25T07:15:15 *** deneb_alpha has joined #opensuse-admin 2018-04-25T07:15:16 *** deneb_alpha has joined #opensuse-admin 2018-04-25T07:18:38 *** cthugha is now known as ldevulder 2018-04-25T07:25:00 *** mcaj has joined #opensuse-admin 2018-04-25T07:45:38 *** matthias_bgg has joined #opensuse-admin 2018-04-25T08:19:55 PROBLEM: SSH on rpmlint.infra.opensuse.org - SSH CRITICAL - OpenSSH_7.2 (protocol 2.0) version mismatch, expected OpenSSH_6.6.1 ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=rpmlint.infra.opensuse.org&service=SSH 2018-04-25T08:54:39 *** Son_Goku has joined #opensuse-admin 2018-04-25T08:56:59 *** asmorodskyi has quit IRC 2018-04-25T09:03:41 *** asmorodskyi has joined #opensuse-admin 2018-04-25T09:07:33 *** ancor has joined #opensuse-admin 2018-04-25T09:08:09 *** ancorgs has quit IRC 2018-04-25T09:13:22 *** sven15 has joined #opensuse-admin 2018-04-25T09:14:22 *** ancor is now known as ancorgs 2018-04-25T09:17:04 *** Son_Goku has quit IRC 2018-04-25T09:34:17 *** awafaa has quit IRC 2018-04-25T09:34:36 *** awafaa has joined #opensuse-admin 2018-04-25T10:09:29 *** cboltz has joined #opensuse-admin 2018-04-25T10:09:29 *** cboltz has joined #opensuse-admin 2018-04-25T10:09:49 *** asmorodskyi has quit IRC 2018-04-25T10:10:26 *** Son_Goku has joined #opensuse-admin 2018-04-25T10:14:13 *** asmorodskyi has joined #opensuse-admin 2018-04-25T10:33:29 *** nicolasbock has joined #opensuse-admin 2018-04-25T10:54:51 *** matthias_bgg has quit IRC 2018-04-25T11:00:10 cboltz: I think the problem in the tests is that the strings are unicode and it thinks that the dict is invalid 2018-04-25T11:00:31 I'm trying to figure out a way to reproduce it now, but no luck so far 2018-04-25T11:02:07 I wouldn't be surprised if the unicode is "normal" - it's just that you usually don't see them dumped out 2018-04-25T11:02:42 the error message about the double "mysqldump" key is quite clear, so I'd really start with fixing mysql-formula 2018-04-25T11:03:47 maybe I also have an idea why it broke *now* - there was a salt maintenance update in the last days 2018-04-25T11:05:27 *** sven15 has quit IRC 2018-04-25T11:16:39 *** asmorodskyi has quit IRC 2018-04-25T11:18:36 *** sven15 has joined #opensuse-admin 2018-04-25T11:20:34 *** asmorodskyi has joined #opensuse-admin 2018-04-25T11:23:37 *** matthias_bgg has joined #opensuse-admin 2018-04-25T11:37:49 *** lcp has quit IRC 2018-04-25T11:40:42 tampakrap: I can reproduce it with a test VM - installing the latest python2-salt, salt and salt-minion from the maintenance update breaks it 2018-04-25T11:41:49 (that test VM has the "mysql" role) 2018-04-25T11:43:23 *** lcp has joined #opensuse-admin 2018-04-25T11:47:20 ... and fixing mysql-formula indeed fixes it 2018-04-25T11:47:43 I have even better news - upstream mysql-formula is already fixed, so please update our copy with latest upstream 2018-04-25T11:51:51 *** deneb_alpha has quit IRC 2018-04-25T12:02:30 PROBLEM: HTTP rsync.o.o on widehat.opensuse.org - CRITICAL - Socket timeout after 10 seconds ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=widehat.opensuse.org&service=HTTP%20rsync.o.o 2018-04-25T12:12:22 RECOVERY: HTTP rsync.o.o on widehat.opensuse.org - HTTP OK: HTTP/1.1 200 OK - 1217 bytes in 0.021 second response time ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=widehat.opensuse.org&service=HTTP%20rsync.o.o 2018-04-25T12:18:02 *** lcp has quit IRC 2018-04-25T12:22:33 *** cboltz has quit IRC 2018-04-25T12:48:28 *** asmorodskyi has quit IRC 2018-04-25T12:53:06 *** asmorodskyi has joined #opensuse-admin 2018-04-25T12:58:28 *** tigerfoot has joined #opensuse-admin 2018-04-25T13:00:04 *** plinnell has joined #opensuse-admin 2018-04-25T13:11:29 *** matthias_bgg has quit IRC 2018-04-25T13:13:29 *** sven15 has quit IRC 2018-04-25T13:29:40 *** matthias_bgg has joined #opensuse-admin 2018-04-25T13:30:08 *** matthias_bgg has joined #opensuse-admin 2018-04-25T13:39:45 *** deneb_alpha has joined #opensuse-admin 2018-04-25T13:39:56 *** deneb_alpha has joined #opensuse-admin 2018-04-25T14:16:22 *** Son_Goku has quit IRC 2018-04-25T15:01:09 *** asmorodskyi has quit IRC 2018-04-25T15:01:16 *** aboe[m] has quit IRC 2018-04-25T15:01:19 *** okurz has quit IRC 2018-04-25T15:01:24 *** ChrisWi has quit IRC 2018-04-25T15:01:25 *** seha has quit IRC 2018-04-25T15:01:25 *** ChrisBr has quit IRC 2018-04-25T15:01:47 *** ChrisWi has joined #opensuse-admin 2018-04-25T15:01:47 *** seha has joined #opensuse-admin 2018-04-25T15:01:47 *** ChrisBr has joined #opensuse-admin 2018-04-25T15:02:46 *** asmorodskyi has joined #opensuse-admin 2018-04-25T15:03:17 *** aboe[m] has joined #opensuse-admin 2018-04-25T15:03:33 *** asmorodskyi has quit IRC 2018-04-25T15:04:06 *** okurz has joined #opensuse-admin 2018-04-25T15:05:11 *** aboe[m] has quit IRC 2018-04-25T15:05:40 *** okurz[m] has quit IRC 2018-04-25T15:07:37 *** asmorodskyi has joined #opensuse-admin 2018-04-25T15:10:51 *** mcaj has quit IRC 2018-04-25T15:33:42 *** eyevan has joined #opensuse-admin 2018-04-25T15:33:42 *** duncanmv has joined #opensuse-admin 2018-04-25T15:34:02 duncanmv, hello :-) 2018-04-25T15:34:06 hello 2018-04-25T16:08:04 *** _miska_ has joined #opensuse-admin 2018-04-25T16:08:56 *** spyonthewall_ has joined #opensuse-admin 2018-04-25T16:09:43 *** plusky_ has joined #opensuse-admin 2018-04-25T16:10:23 *** spyonthewall has quit IRC 2018-04-25T16:10:23 *** |miska| has quit IRC 2018-04-25T16:10:24 *** plusky has quit IRC 2018-04-25T16:10:25 *** _miska_ is now known as |miska| 2018-04-25T16:10:25 *** |miska| has joined #opensuse-admin 2018-04-25T16:10:25 *** plusky_ is now known as plusky 2018-04-25T16:10:25 *** plusky has joined #opensuse-admin 2018-04-25T16:20:17 *** aboe[m] has joined #opensuse-admin 2018-04-25T16:28:01 *** cboltz has joined #opensuse-admin 2018-04-25T16:28:01 *** cboltz has joined #opensuse-admin 2018-04-25T16:37:48 *** fvogt has joined #opensuse-admin 2018-04-25T16:44:22 *** Szamanx0 has joined #opensuse-admin 2018-04-25T16:45:20 PROBLEM: NRPE on sarabi.infra.opensuse.org - connect to address 192.168.47.15 port 5666: Connection refused ; See https://monitor.opensuse.org/icinga/cgi-bin/extinfo.cgi?type=2&host=sarabi.infra.opensuse.org&service=NRPE 2018-04-25T16:52:51 *** matthias_bgg has quit IRC 2018-04-25T17:02:01 *** heroes-bot has joined #opensuse-admin 2018-04-25T17:14:31 *** okurz[m] has joined #opensuse-admin 2018-04-25T18:29:24 tampakrap: I just looked at the updated mysql-formula, and it looks like salt is right about an unclosed "if" (I counted 14 "if" and 13 "endif" in mysql/server.sls) 2018-04-25T18:44:26 Hi cboltz 2018-04-25T18:44:35 hi 2018-04-25T18:45:08 i believe your intentions were to get me in contact with tampakrap 2018-04-25T18:46:17 right 2018-04-25T18:52:37 well we are having a serious time zone problem lol 2018-04-25T19:02:32 where (location / time zone) do you live? 2018-04-25T19:03:40 PST 2018-04-25T19:05:14 sounds like USA, Mexico or Canada 2018-04-25T19:06:05 indeed, that makes things a bit difficult - basically tampakrap leaves the office when you get up 2018-04-25T19:07:07 (tampakrap and I are in CET / CEST timezone - the difference is that I'm mostly active in the evening, which somewhat matches US office hours) 2018-04-25T19:36:55 *** Fraser_Bell has joined #opensuse-admin 2018-04-25T20:00:28 *** Fraser_Bell has quit IRC 2018-04-25T20:09:49 *** fvogt has quit IRC 2018-04-25T20:15:42 *** fvogt has joined #opensuse-admin 2018-04-25T20:34:34 *** fvogt has quit IRC 2018-04-25T20:35:56 *** dmacvicar[m] has joined #opensuse-admin 2018-04-25T20:48:39 wadadli: got time now for a short chat? 2018-04-25T20:49:11 cboltz: apart from the mysql formula, the rsyslog and sssd formulas are showing errors that I really can't reproduce 2018-04-25T20:49:17 neither in production nor in my test machine 2018-04-25T20:49:23 I'm totally stuck on this one :/ 2018-04-25T20:50:32 see the comment I just added to !194 - please update mysql-formula once more 2018-04-25T20:51:00 I set up a vm that has a file.managed which is quite close to the one in the rsyslog formula 2018-04-25T20:51:06 and passed a context key in pillars 2018-04-25T20:51:20 (we replaced one mysql-formula bug with another one ;-) 2018-04-25T20:51:20 don't you have access to update formulas? 2018-04-25T20:51:22 I wouldn't be too surprised if the mysql-formula breakage also triggers the other errors 2018-04-25T20:51:22 tampakrap: I am here sir. 2018-04-25T20:52:23 okay I'll update the formula 2018-04-25T20:52:28 wadadli: let's talk on a pm 2018-04-25T20:52:45 tampakrap: I think I have the needed permissions, but I'm just to lazy right now, and actually I should work on packaging the latest PostfixAdmin to get it into Leap 15 instead of hunting salt bugs ;-) 2018-04-25T20:53:11 no worries, I'll do it 2018-04-25T20:57:48 cboltz: https://gitlab.infra.opensuse.org/tampakrap/salt/-/jobs/2750 it's better but still we get errors 2018-04-25T20:58:41 could it be possible that the last error on profile/wiki/docroot could cause the others? 2018-04-25T20:59:57 it says data: {{ data }} 2018-04-25T21:00:05 I will try data: "{{ data }}" 2018-04-25T21:00:19 actually no, it's not a good idea 2018-04-25T21:00:24 {{ data }} is a dict 2018-04-25T21:01:29 I'm curious to see what happens if we remove the mysql role completely 2018-04-25T21:02:16 now that it's fixed, it shouldn't change anything ;-) 2018-04-25T21:03:02 for the wiki - I wonder if changing the quoting style in in pillar/role/wiki.sls from '...' to "..." would change anything 2018-04-25T21:03:18 it would be strange[tm], but maybe worth a test 2018-04-25T21:03:25 * cboltz will push a test branch 2018-04-25T21:04:49 the mysql role calls the profile.wiki.docroot 2018-04-25T21:04:55 I'll remove that include to see what happens 2018-04-25T21:07:18 *** deneb_alpha has quit IRC 2018-04-25T21:08:12 your fix didn't work https://gitlab.infra.opensuse.org/infra/salt/-/jobs/2751 2018-04-25T21:08:43 actually I'd be surprised if it would have worked ;-) but it was worth a try 2018-04-25T21:17:12 cboltz: https://gitlab.infra.opensuse.org/tampakrap/salt/-/jobs/2754 so if I comment out profile.wiki.docroot, the other two errors persist 2018-04-25T21:17:21 so we have proof that they are irrelevant to each other 2018-04-25T21:17:47 now the big question is why it happens only there and not on the test or the production systems... 2018-04-25T21:22:11 the other way round would be worse ;-) but it's still strange 2018-04-25T21:23:15 it sucks a lot, it breaks automated deployments 2018-04-25T21:23:31 it seems the problem happens if a text contains a : like 'ldaps://...' for sssd and also in two of the texts for the wiki 2018-04-25T21:23:46 obviously a : inside a text with quotes around should not trigger this 2018-04-25T21:23:58 but it is quoted 2018-04-25T21:25:14 yes, that's why it's strange[tm] 2018-04-25T21:27:19 I see two possible ways to continue, and maybe you should follow both ways: 2018-04-25T21:27:41 a) find out what is different between the automated tests and the production systems 2018-04-25T21:27:59 b) ask on #salt - maybe it's a bug in salt 2018-04-25T21:30:30 oh, and c) open a bugreport on boo because this is obviously a regression in the 42.3 maintenance update (CC me please) 2018-04-25T21:31:17 I am trying to figure out the bug first, then I can open the bug 2018-04-25T21:31:28 I don't have a reproducer right now which sucks a lot 2018-04-25T21:31:38 my test system is really close to the CI system 2018-04-25T21:31:49 using salt-call --local, no running master/minion 2018-04-25T21:32:07 the file.managed is quite identical to the one at the formula 2018-04-25T21:32:16 maybe I could try using the formula directly and see what happens 2018-04-25T21:32:37 indeed, that would give us a much smaller testcase 2018-04-25T21:33:22 and/or give one of the SUSE salt maintainers access to gitlab so that they can "play" themself ;-) 2018-04-25T21:39:08 http://paste.opensuse.org/62644253 this should be able to reproduce it right? 2018-04-25T21:40:11 in theory yes 2018-04-25T21:40:40 if it doesn't, move the content of config: to a variable or pillar so that you can use config: {{ the_config }} 2018-04-25T21:42:35 no luck 2018-04-25T21:42:46 I tried also to load the rsyslog formula 2018-04-25T21:43:11 no pillars are needed, the defaults from the formula are supposed to do the job because they include a salt://... path by default 2018-04-25T21:43:14 and it works fine :/ 2018-04-25T21:43:46 maybe the indirection via pillar is needed to break the quoting? 2018-04-25T21:44:06 it's not, in my MR I removed the pillar 2018-04-25T21:44:56 I'll try it though 2018-04-25T21:45:36 ah no wait, we still have it in the syslog role 2018-04-25T21:45:40 I'll remove that role 2018-04-25T21:50:02 and now it passed 2018-04-25T21:50:50 and reproduced in my test vm as well 2018-04-25T21:53:26 so re-add syslog to get the failure back 2018-04-25T21:53:50 and then remove the other roles and make sure it still fails 2018-04-25T21:55:25 I have reproducer 2018-04-25T21:55:29 now I can file the bug 2018-04-25T21:55:46 :-) 2018-04-25T21:55:56 *** duncanmv has quit IRC 2018-04-25T21:56:23 http://paste.opensuse.org/9085099 2018-04-25T21:57:18 OR 2018-04-25T21:57:19 https://github.com/saltstack/salt/issues/46929 2018-04-25T21:57:29 this seems to be our issue 2018-04-25T21:58:11 and there is a fix already https://github.com/saltstack/salt/pull/47104/files 2018-04-25T21:59:58 and guess what, the fix works 2018-04-25T22:00:10 nice :-) 2018-04-25T22:00:35 sounds like you should open a bug on boo with all that and ask for another maintenance update 2018-04-25T22:01:01 I can submit an SR directly 2018-04-25T22:01:13 even better :-) 2018-04-25T22:01:25 my question is now if this solves all the issues we have there 2018-04-25T22:01:59 *** ancorgs has quit IRC 2018-04-25T22:03:18 good question 2018-04-25T22:03:41 the bugreport looks like it's about loading yaml files 2018-04-25T22:03:53 so I'll try tomorrow to patch this file inside the CI and see what happens 2018-04-25T22:03:53 but we've also seen the issue with the wiki pillar 2018-04-25T22:04:40 so _if_ the pillar handling is separate (for whatever reason), it will also need a fix 2018-04-25T22:04:59 yeah 2018-04-25T22:05:11 I'll continue tomorrow 2018-04-25T22:05:27 thanks for the precious help 2018-04-25T22:05:29 gn8 2018-04-25T22:05:56 you are welcome, it was a funny (and sometimes funny[tm] hunt ;-) 2018-04-25T22:06:09 good night! 2018-04-25T22:45:25 *** IonutVan_ has quit IRC 2018-04-25T22:56:07 *** IonutVan_ has joined #opensuse-admin 2018-04-25T23:22:26 *** cboltz_ has joined #opensuse-admin 2018-04-25T23:22:26 *** cboltz_ has joined #opensuse-admin 2018-04-25T23:22:57 *** cboltz has quit IRC 2018-04-25T23:27:27 *** cboltz_ has quit IRC