00:44:24Gereon6200 quits [Quit: Ping timeout (120 seconds)]
00:49:22Gereon6200 (Gereon) joins
01:11:24qwertyasdfuiopghjkl quits [Client Quit]
01:12:16qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
01:32:20qwertyasdfuiopghjkl quits [Remote host closed the connection]
01:33:57qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
04:39:53pabs quits [Quit: Don't rest until all the world is paved in moss and greenery.]
04:49:41pabs (pabs) joins
05:29:24<yzqzss|m>pokechu22:... (full message at <https://matrix.hackint.org/_matrix/media/v3/download/hackint.org/ebxqNUttPcLaewKgPyIHFSLg>)
05:31:51<pokechu22>yzqzss|m: 117,232/50 is 2344.64; my number there is request based, not rev based, for xmlrevisions. Increasing the chunk size is something that's probably worth doing, but I know for some wikis even doing 50 is slow (they take a while to respond)
05:32:43pabs quits [Ping timeout: 252 seconds]
05:33:01<pokechu22>oh, which is probably what https://github.com/mediawiki-client-tools/mediawiki-scraper/commit/20691b56c5ffdd7919d8df9e503d24c719fe4f3d fixes
05:34:43<pokechu22>I wonder why it was initially implemented with arvnamespace - it doesn't seem super useful. Same with the .desc files; they seem redundant (unless they can be used when importing images into another wiki?)
05:40:36<pokechu22>There's also the prop=revisions path where the 'rvlimit': 50 line is commented out - that completely breaks that path normally. It mostly works when it's uncommented but the continue line doesn't work properly on all wikis (I have wanted to look into that but haven't had time)
06:19:59qwertyasdfuiopghjkl quits [Remote host closed the connection]
06:24:05qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
06:39:16Gereon6200 quits [Ping timeout: 252 seconds]
06:56:40pabs (pabs) joins
07:10:04Sluggs quits [Ping timeout: 252 seconds]
07:27:07Sluggs joins
07:27:07Sluggs quits [Excess Flood]
07:29:38Sluggs joins
07:33:23<Nemo_bis>Someone would like a new dump of http://scubapedia.ca/index.php/Accueil
08:54:54hitgrr8 joins
10:35:49Sluggs quits [Ping timeout: 265 seconds]
10:41:15Sluggs joins
10:41:16Sluggs quits [Excess Flood]
10:43:15Sluggs joins
11:14:11balrog quits [Client Quit]
11:40:03balrog (balrog) joins
13:25:52<yzqzss|m>pokechu22:
13:25:52<yzqzss|m>> the process where it gets the page list *isn't* affected properly by delay.
13:25:52<yzqzss|m>I fixed the issue: <https://github.com/mediawiki-client-tools/mediawiki-scraper/pull/137>
13:26:15qwertyasdfuiopghjkl quits [Remote host closed the connection]
13:26:47qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
13:29:32<yzqzss|m>Maybe it can be backported to wikiteam. But I'm not familiar with py2.
15:01:42qwertyasdfuiopghjkl quits [Remote host closed the connection]
16:21:05<michaelblob_>https://archive.org/details/wiki-theiphonewikicom_w-20230322
16:31:23<pokechu22>yzqzss|m: Yes, that's the workaround I came up with more or less (except I didn't reset it afterwards and used it as the only delay). It should work fine. (I think I actually patched mwclient's raw_call but that would do the same thing)
16:53:10<pokechu22>michaelblob_, pabs: Looks like https://www.theiphonewiki.com/ just now went offline, so good thing we saved it
16:57:01<pokechu22>and I'm currently downloading scubapedia.ca - should finish soon, but it'll be a little while before I upload it
17:47:39<michaelblob_>pokechu22: hm theiphonewiki.com is still up for me
17:48:12<pokechu22>Yeah, looks like it's back up now, but only just now, if you look at the archivebot log
17:48:15<michaelblob_>also https://archive.org/details/wiki-scubapediaca-20230323
17:48:23<michaelblob_>ah ok
18:09:35qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
18:27:18qwertyasdfuiopghjkl quits [Remote host closed the connection]
18:33:12qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
19:09:33HackMii quits [Remote host closed the connection]
19:09:55HackMii (hacktheplanet) joins
21:46:46Iki1 quits [Ping timeout: 252 seconds]
22:47:12hitgrr8 quits [Client Quit]
23:42:49qwertyasdfuiopghjkl quits [Client Quit]
23:53:05qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins