2020-08-27T02:10:53 *** okurz_ is now known as okurz 2020-08-27T04:54:59 pjessen: yesterday I tried without success to get inside opensuse network. Today I have a full morning in the datacenter to deal with SUSE vpn work, and after that I will try again 2020-08-27T06:18:40 pjessen: that script fixed the database, no kidding 2020-08-27T06:18:48 it imports with none encoding issues 2020-08-27T06:19:26 https://gist.github.com/gschlager/bad57293004c0bfcddba <- this 2020-08-27T06:49:05 klein: sounds good, thanks 2020-08-27T06:49:21 lcp: wow. nice surprise :-) 2020-08-27T07:58:05 ok... pjessen "Thu Aug 27 07:57:17 2020 us=560255 195.135.221.27:41638 VERIFY ERROR: depth=0, error=CRL has expired: CN=..." 2020-08-27T07:58:29 I already saw this hapening once... just need to recreate the crl... will try to remember how and things will be back 2020-08-27T08:06:23 problem.... to recreate the CRL I need the CA passprhase, and I have no idea where to find it 2020-08-27T08:24:49 nevermind, forgot that we have a pass for opensuse, found it, vpn should work now, can someone else test it? 2020-08-27T08:25:55 thanks to kbabioch and darix for remembering me that we have the `pass` for opensuse.... Sorry for the delay in solving this guys. 2020-08-27T08:58:35 *** ldevulder_ is now known as ldevulder 2020-08-27T09:06:48 klein: looks good, thanks for fixing it. The CRL is a royal PITA, I used to run into the same when we used our own CA. 2020-08-27T09:22:33 I need to find a way to automate this, salt + encrypted pillar should be easy... but to be honest I am having a little problem of lack of free time for anything :-( 2020-08-27T10:38:48 klein: maybe we should look at using letsencrypt for openvpn certs, dunno. 2020-08-27T11:13:48 cboltz: you are right, looking at the db, those very old encoding issues are recoverable 2020-08-27T11:14:09 cboltz: all of that stuff is latin1 encoded 2020-08-27T11:14:42 right, the question is "just" how much time you want to invest to get it fixed ;-) 2020-08-27T11:14:48 this actually means that the database issue isn't a database issue, but vb4 upgrade issue that happened at some point when somebody upgraded to a newer version of vb 2020-08-27T11:15:23 I ain't fixing that, there is no way 2020-08-27T11:16:03 it could even be a server or PHP upgrade issue - IIRC the default charset changed (don't remember in which release exactly) 2020-08-27T11:16:15 that's true 2020-08-27T11:16:28 so if vb doesn't specify the connection charset, it gets the (changed) default 2020-08-27T11:18:01 I bet there was somebody that wrote a script that fixed that for any mysql database 2020-08-27T11:18:23 but since I will be going out soon, I won't start looking yet 2020-08-27T11:19:50 I mean, I guess we are lucky it is latin1 and utf8, since the character sequences that change there are impossible in the other case 2020-08-27T11:20:17 or at the very least, very unlikely 2020-08-27T11:20:56 it also would make sense if it was php update, because that would explain the garbage with openSUSE News on wordpress 2020-08-27T11:21:25 (I did manual sed for that one though, because it was considerably smaller than the forums) 2020-08-27T11:22:39 cboltz: if it was updated on the same date, I think I can find what date it was with news.o.o 2020-08-27T11:31:24 lcp: I have diverted opensuse-test to test@lists.o.o on mailman3.infra 2020-08-27T11:35:39 lcp: I tried to subscribe, but got a 403 - CSRF vereification failed. 2020-08-27T11:36:14 I guess because I am accessing mailman3.infra 2020-08-27T12:01:13 pjessen: you can replace the domain with lists.o.o (for example https://lists.opensuse.org/archives/ ) - we have some haproxy rules in place to route the mailman3 locations to mailman.infra.o.o 2020-08-27T13:07:24 pjessen: lI replied to your test email, but it got rejected. It is waiting "moderator approval". It doesn't consider me as subscribed, yet I'm getting that list email. 2020-08-27T13:25:02 robin_listas: yeah, you are probably not subscribed on the mm3 installation 2020-08-27T13:25:59 That will happen to everybody, so a subscriber migration process will be needed, IMHO 2020-08-27T13:26:29 robin_listas: of course, it's on the todo list 2020-08-27T13:26:54 It is weird, because as I get the email, it thinks I'm subscribed somewhere. 2020-08-27T13:28:13 there are now two list servers, I'm sure you got what sent by mlmmj first, but when you replied it was sent to mailman3 2020-08-27T13:28:33 did you get my third test mail ? 2020-08-27T13:43:20 No, I don't see a third one (filtering on subject contains "test") 2020-08-27T13:58:07 good, that's because you're not subscribed. 2020-08-27T16:07:24 Thanks I got my issue sorted :) 2020-08-27T16:27:01 pjessen, robin_listas: I can quickly migrate y'all 2020-08-27T16:27:08 on opensuse-test 2020-08-27T16:43:53 * lcp uploaded an image: Screenshot from 2020-08-27 18-43-38.png (75KiB) < https://matrix.org/_matrix/media/r0/download/opensuse.org/uMSQOpOihjNUwUMFQAwzFrax/Screenshot from 2020-08-27 18-43-38.png > 2020-08-27T16:58:10 migrated the subscriptions over 2020-08-27T17:02:11 and I approved your earlier emails https://lists.opensuse.org/archives/list/test@lists.opensuse.org/ 2020-08-27T18:05:41 nice - I got reproducible rsync errors on provo-mirror for /repositories, always with the same file: https://paste.opensuse.org/36832245 2020-08-27T18:06:28 this seems to be compression-related - I now started rsync without --compress, which successfully transferred the offending file, and is still running 2020-08-27T18:18:40 cboltz: very weird. 2020-08-27T18:27:22 lcp: thanks, I see now that pending post. 2020-08-27T19:16:19 pjessen: not only weird, IMHO it qualifies as bug -> https://bugzilla.opensuse.org/show_bug.cgi?id=1175854 filed 2020-08-27T19:22:53 pjessen: I tried using `test-join@lists.opensuse.org` and mx returned me the email :/ 2020-08-27T19:24:40 oh, I guess that's what emailing test@lists.opensuse.org does too 2020-08-27T19:44:41 cboltz: the vb -> discourse script outputs a file with a mapping of post ids in vb to topic ids in discourse, do you think we should set up redirect rules based on that? 2020-08-27T19:45:49 since there are a few hundred thousand redirects, just loading that into nginx is gonna be a nightmare 2020-08-27T19:46:14 I'm a fan of not breaking known URLs (so that google/$whatever search results don't break) ;-) 2020-08-27T19:46:29 and I also understand that this will result in a quite long list of redirects ;-) 2020-08-27T19:46:59 I can put that into a perspective if I find that file somewhere 2020-08-27T19:47:50 well, it's too big for matrix. so I can't 2020-08-27T19:48:21 I guess the wc -l output is good enough ;-) 2020-08-27T19:48:22 it's 2.9MB, so it shouldn't be too big. but matrix is picky 2020-08-27T19:48:50 143031 2020-08-27T19:49:12 wow, that will indeed be a long list of redirects ;-) 2020-08-27T19:49:18 just as an idea: 2020-08-27T19:49:28 the current URLs are like https://forums.opensuse.org/showthread.php/520360-Multimedia-Guide-for-openSUSE-Tumbleweed 2020-08-27T19:49:51 so maybe we could write our own "showthread.php" to do the redirects? 2020-08-27T19:50:07 good idea 2020-08-27T19:50:17 keep in mind we only have the number at the front 2020-08-27T19:50:24 so in this case just https://forums.opensuse.org/showthread.php/520360 2020-08-27T19:50:40 we can fix that with a clever regex, but yeah 2020-08-27T19:51:05 right, it could ignore the pretty url part and just look at the number 2020-08-27T19:51:42 we also only have a number for discourse, but in its case it's https://forums.opensuse.org/t/520360 2020-08-27T19:52:05 (the numbers are different, I'm just using it as an example) 2020-08-27T19:52:21 too bad, I already hoped for "same number" ;-) 2020-08-27T19:53:23 * lcp sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/NsoNTEgtZRJlRFjxiefJnmQC/message.txt > 2020-08-27T19:53:40 I need to change the format so it doesn't prefix the XXX and YYY 2020-08-27T19:53:47 but that's easy enough to do 2020-08-27T19:54:00 yeah, the numbers are different 2020-08-27T19:55:06 is the mapping from old and new numbers "random", or is there a pattern (like "$old_number - 42")? 2020-08-27T19:55:24 well, it's hard to tell 2020-08-27T19:55:33 I could compare the first and the last, give me a sec 2020-08-27T19:57:02 no by a long shot 2020-08-27T19:58:30 would have been too easy ;-) 2020-08-27T19:58:41 it would 2020-08-27T19:59:19 nevertheless, can you upload the file somewhere? I'm curious if I can find a pattern ;-) 2020-08-27T20:02:23 hm, any ideas where 2020-08-27T20:02:43 firefox send is dead, and it's too big for paste >:T 2020-08-27T20:02:56 scp it to forums.i.o.o:/dev/shm/ or something like that ;-) 2020-08-27T20:03:20 do I even have perms there 2020-08-27T20:04:03 in /dev/shm/ - for sure, it's world-writeable ;-) - but you can pick any VM you like 2020-08-27T20:05:37 right, my ssh key on forum.i.o.o is on root and not on my account 2020-08-27T20:05:46 that makes it easier to not worry about permissions 2020-08-27T20:05:57 ;-) 2020-08-27T20:06:05 it should be under /dev/shm/vb_map.csv 2020-08-27T20:06:56 keep in mind this is subject to change, because we will be reimporting and god knows how that looks for ids in discourse 2020-08-27T20:08:03 yes, I expected that 2020-08-27T20:08:21 nice, dropping XXX and YYY reduces the file size to 2.0 MB 2020-08-27T20:09:25 it's a small modification in the script tbh 2020-08-27T20:09:57 as you can see here https://github.com/discourse/discourse/blob/master/script/import_scripts/vbulletin.rb#L877-L883 2020-08-27T20:11:09 I can even generate nginx config right away 2020-08-27T20:11:19 but I don't think that's the point 2020-08-27T20:11:46 yeah, that nginx config file would be quite big ;-) 2020-08-27T20:12:47 ok, so I throw some AI on the file 2020-08-27T20:12:59 well, if LibreOffice Calc qualifies as such ;-) 2020-08-27T20:13:56 the only pattern I see is that the offset increases - I guess the post ID table on vb was shared with the SUSE forum, which means some IDs were not available for the openSUSE forums 2020-08-27T20:15:01 there are cases where the offset is the same for 10 or 20 postings, but in other cases the offset changes for each posting 2020-08-27T20:15:30 so in the end, we'll really have to do a lookup of old ID -> new ID 2020-08-27T20:16:48 I suspect those are deleted threads, but I don't have that much insight 2020-08-27T20:16:49 with 140k IDs, I wonder if we should have the whole map in the code (which would mean a 3 MB PHP script), or if a database table would make more sense 2020-08-27T20:17:10 deleted threads might also be an explanation 2020-08-27T20:18:26 I agree with the start, that the forums started as SUSE thing and were split 2020-08-27T20:18:57 in case of discourse, I think the first 197 or whatever posts are reserved for some other stuff 2020-08-27T20:19:34 that, or you simply didn't reset the auto_increment after your first tests ;-) 2020-08-27T20:20:33 no, I reset the db every time 2020-08-27T20:20:41 that's actually part of migration steps 2020-08-27T20:21:01 ok, then we need a different explanation ;-) 2020-08-27T20:35:53 completely different topic: 2020-08-27T20:36:04 I found a bug in the mailman3 "requires approval" mails 2020-08-27T20:36:39 the mail comes with a link to https://lists.opensuse.org/admin/lists/test.lists.opensuse.org/held_messages which goes 404 (in mailman3 layout) 2020-08-27T20:37:05 the correct link would be https://lists.opensuse.org/manage/lists/test.lists.opensuse.org/held_messages - note /admin/ vs. /manage/ 2020-08-27T20:37:46 /admin/ is what I know from mailman 2, therefore I guess upstream forget to update the mail template when switching to /manage/ 2020-08-27T21:17:44 that's a thing 2020-08-27T21:18:02 I wonder if mailman has access to that django stuff, that might be hard to implement 2020-08-27T21:35:17 cboltz: I cannot find anything in the current code, it seems to me that should not be a thing since https://gitlab.com/mailman/mailman/-/commit/dbde6231ec897379ed38ed4cd015b8ab20ed5fa1 2020-08-27T21:37:19 maybe mailman just needs a restart or something 2020-08-27T21:39:06 hmm, that commit was 4 years ago, I'm not sure if restarting mailman will help a lot ;-) 2020-08-27T21:52:23 why not >:D 2020-08-27T21:53:21 not too related, but let me quote from #apparmor nevertheless: 2020-08-27T21:53:35 it's been on my todo list for eight or nine years, I'm sure I'll get around to it right quick :)