00:44:24 | | Gereon6200 quits [Quit: Ping timeout (120 seconds)] |
00:49:22 | | Gereon6200 (Gereon) joins |
01:11:24 | | qwertyasdfuiopghjkl quits [Client Quit] |
01:12:16 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
01:32:20 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
01:33:57 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
04:39:53 | | pabs quits [Quit: Don't rest until all the world is paved in moss and greenery.] |
04:49:41 | | pabs (pabs) joins |
05:29:24 | <yzqzss|m> | pokechu22:... (full message at <https://matrix.hackint.org/_matrix/media/v3/download/hackint.org/ebxqNUttPcLaewKgPyIHFSLg>) |
05:31:51 | <pokechu22> | yzqzss|m: 117,232/50 is 2344.64; my number there is request based, not rev based, for xmlrevisions. Increasing the chunk size is something that's probably worth doing, but I know for some wikis even doing 50 is slow (they take a while to respond) |
05:32:43 | | pabs quits [Ping timeout: 252 seconds] |
05:33:01 | <pokechu22> | oh, which is probably what https://github.com/mediawiki-client-tools/mediawiki-scraper/commit/20691b56c5ffdd7919d8df9e503d24c719fe4f3d fixes |
05:34:43 | <pokechu22> | I wonder why it was initially implemented with arvnamespace - it doesn't seem super useful. Same with the .desc files; they seem redundant (unless they can be used when importing images into another wiki?) |
05:40:36 | <pokechu22> | There's also the prop=revisions path where the 'rvlimit': 50 line is commented out - that completely breaks that path normally. It mostly works when it's uncommented but the continue line doesn't work properly on all wikis (I have wanted to look into that but haven't had time) |
06:19:59 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
06:24:05 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
06:39:16 | | Gereon6200 quits [Ping timeout: 252 seconds] |
06:56:40 | | pabs (pabs) joins |
07:10:04 | | Sluggs quits [Ping timeout: 252 seconds] |
07:27:07 | | Sluggs joins |
07:27:07 | | Sluggs quits [Excess Flood] |
07:29:38 | | Sluggs joins |
07:33:23 | <Nemo_bis> | Someone would like a new dump of http://scubapedia.ca/index.php/Accueil |
08:54:54 | | hitgrr8 joins |
10:35:49 | | Sluggs quits [Ping timeout: 265 seconds] |
10:41:15 | | Sluggs joins |
10:41:16 | | Sluggs quits [Excess Flood] |
10:43:15 | | Sluggs joins |
11:14:11 | | balrog quits [Client Quit] |
11:40:03 | | balrog (balrog) joins |
13:25:52 | <yzqzss|m> | pokechu22: |
13:25:52 | <yzqzss|m> | > the process where it gets the page list *isn't* affected properly by delay. |
13:25:52 | <yzqzss|m> | I fixed the issue: <https://github.com/mediawiki-client-tools/mediawiki-scraper/pull/137> |
13:26:15 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
13:26:47 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
13:29:32 | <yzqzss|m> | Maybe it can be backported to wikiteam. But I'm not familiar with py2. |
15:01:42 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
16:21:05 | <michaelblob_> | https://archive.org/details/wiki-theiphonewikicom_w-20230322 |
16:31:23 | <pokechu22> | yzqzss|m: Yes, that's the workaround I came up with more or less (except I didn't reset it afterwards and used it as the only delay). It should work fine. (I think I actually patched mwclient's raw_call but that would do the same thing) |
16:53:10 | <pokechu22> | michaelblob_, pabs: Looks like https://www.theiphonewiki.com/ just now went offline, so good thing we saved it |
16:57:01 | <pokechu22> | and I'm currently downloading scubapedia.ca - should finish soon, but it'll be a little while before I upload it |
17:47:39 | <michaelblob_> | pokechu22: hm theiphonewiki.com is still up for me |
17:48:12 | <pokechu22> | Yeah, looks like it's back up now, but only just now, if you look at the archivebot log |
17:48:15 | <michaelblob_> | also https://archive.org/details/wiki-scubapediaca-20230323 |
17:48:23 | <michaelblob_> | ah ok |
18:09:35 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
18:27:18 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
18:33:12 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
19:09:33 | | HackMii quits [Remote host closed the connection] |
19:09:55 | | HackMii (hacktheplanet) joins |
21:46:46 | | Iki1 quits [Ping timeout: 252 seconds] |
22:47:12 | | hitgrr8 quits [Client Quit] |
23:42:49 | | qwertyasdfuiopghjkl quits [Client Quit] |
23:53:05 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |