2020-11-18T03:52:54  *** okurz_ is now known as okurz
2020-11-18T12:20:00  <lkocman> Hello team, we did agree to keep using current symlink for GA as well right? https://en.opensuse.org/Portal:15.2/Retrospective#Action_item_66
2020-11-18T12:20:15  <lkocman> I'm asking since I'm now working on https://github.com/openSUSE/software-o-o/pull/908 (15.3 setup for software-o-o)
2020-11-18T12:20:44  <lkocman> and I'd like to know whether to use just the -Current symlink even for GA or whether to do some if/else for stable/unstable
2020-11-18T12:21:45  <lkocman> bmwiedemann, could you have a look? I just want to make sure we're not surprised on GA day and have to struggle with symlinks again
2020-11-18T14:05:16  <okurz> lkocman: I vaguely remember something like these symlinks have been discussed by lnussel and me in some openSUSE release process progress ticket :)
2020-11-18T18:50:56  <kl_eisbaer> but it's time for me to shut down now. calling people and asking for their contact history for 8h is not really relaxing
2020-11-18T18:51:21  <kl_eisbaer> especially as it looks like the machine come back one after the other.
2020-11-18T19:12:32  <bmwiedemann> ChrisWi: many opensuse services are back
2020-11-18T19:13:15  <pjessen> any database issues still ?
2020-11-18T19:14:14  <bmwiedemann> seems so. forums and wiki affected.
2020-11-18T19:18:09  <pjessen> mailman too
2020-11-18T19:20:38  <lethliel_> AFAIK the database issues are already known and someone is working on it
2020-11-18T19:20:57  <Eighth_Doctor> lethliel_: seems like everything is fine except OBS
2020-11-18T19:21:14  <Eighth_Doctor> Mailman and Pagure are online and working
2020-11-18T19:21:49  <lethliel_> I wouldn't say erverything
2020-11-18T19:21:55  <cboltz> just checked   systemctl --failed   on all VMs - there are a few failures left
2020-11-18T19:23:41  <pjessen> Eighth_Doctor: mailman too?  I don't seem to be able to start it
2020-11-18T19:23:55  <Eighth_Doctor> pjessen: lists.opensuse.org are up
2020-11-18T19:24:07  <pjessen> Eighth_Doctor: yep, but mailman isn't :-)
2020-11-18T19:24:23  <Eighth_Doctor> ohhh
2020-11-18T19:24:30  <pjessen> can't start it, and can't decipher the errors either :-)
2020-11-18T19:24:31  <Eighth_Doctor> the mailer itself is down?
2020-11-18T19:24:39  <pjessen> yup, the master process
2020-11-18T19:26:12  <Eighth_Doctor> well, looks like my VPN access is working again
2020-11-18T19:26:31  <Eighth_Doctor> I was able to sync the salt repo from g.i.o.o to c.o.o
2020-11-18T19:30:07  <Eighth_Doctor> pjessen: unfortunately, I think only you and LCP have access to mailman3.i.o.o
2020-11-18T19:31:22  <pjessen> Eighth_Doctor: oh.  it's the usually setup I though, everyone has access
2020-11-18T19:32:08  <Eighth_Doctor> pjessen: I got a password prompt when trying to ssh in as root
2020-11-18T19:32:12  <Eighth_Doctor> unless there's another user I should use?
2020-11-18T19:32:28  <cboltz> ideally a sudo group ;-)
2020-11-18T19:33:11  <pjessen> Eighth_Doctor: yeah dont use root, use your own userid, then sudo
2020-11-18T19:33:19  <Eighth_Doctor> sounds good
2020-11-18T19:33:22  <Eighth_Doctor> lemme try that
2020-11-18T19:34:07  <Eighth_Doctor> pjessen: `pharaoh_atem is not in the sudoers file.  This incident will be reported.`
2020-11-18T19:34:18  <pjessen> oh dear
2020-11-18T19:34:36  <cboltz> Eighth_Doctor: do you want that fixed? ;-)
2020-11-18T19:34:46  <pjessen> pay the man
2020-11-18T19:34:51  <Eighth_Doctor> haha
2020-11-18T19:35:19  <Eighth_Doctor> apparently LCP knows why it broke
2020-11-18T19:35:28  <pjessen> oh cool
2020-11-18T19:35:38  <Eighth_Doctor> so he can fix it :)
2020-11-18T19:36:58  <pjessen> i see him, he's just logged in
2020-11-18T19:37:23  <Eighth_Doctor> excellent
2020-11-18T19:37:29  <cboltz> Eighth_Doctor: you should be able to sudo now/soon
2020-11-18T19:37:30  <Eighth_Doctor> I'm going to pop out of mm3.i.o.o
2020-11-18T19:37:37  <Eighth_Doctor> nothing I can do there anyway
2020-11-18T19:37:52  <pjessen> ditto
2020-11-18T19:39:01  <pjessen> wow, he's got it running
2020-11-18T19:39:02  <cboltz>  /var/lib/mailman/logs/mailmansuite.log has lots of
2020-11-18T19:39:05  <cboltz> ERROR 2020-11-18 14:01:11,506 20019 hyperkitty.lib.utils Failed to update the fulltext index: Unable to get write lock on /var/lib/mailman_webui/xapian_index: already locked
2020-11-18T19:39:25  <cboltz> probably not related to the power outage, but we should get it fixed nevertheless ;-)
2020-11-18T19:40:35  <pjessen> i have not even looked at /var/lib/mailman/logs yet, only /var/log/mailman/
2020-11-18T19:41:37  <cboltz> ah, so mailman3 has two log locations? nice...
2020-11-18T19:42:33  <pjessen> got to keep the enemy on his toes .....
2020-11-18T19:42:34  <M_discord_984663> I did a restart of the matrix vm, and suddenly half the disk is reclaimed
2020-11-18T19:42:34  <M_discord_984663> oh my god
2020-11-18T19:42:53  <cboltz> FYI: I had to manually start postfix on mx* because of
2020-11-18T19:42:56  <cboltz>     Nov 18 18:49:09 mx1 postfix/master[1949]: fatal: /etc/postfix/master.cf: line 1: bad hostname or network address: mx1.infra.opensuse.org:smtp
2020-11-18T23:55:27  *** ryan_ is now known as Romulus
2020-11-18T23:55:43  <Romulus> https://build.opensuse.org login doesn't work
2020-11-18T23:55:47  <Romulus> also reset page gives a 503
2020-11-18T23:56:45  <Romulus> 503: https://idp-portal.suse.com/univention/self-service/#page=passwordreset