00:34:56 | <yzqzss> | :( f**k ai bots |
02:06:01 | <pokechu22> | Another wikifarm: https://subdomainfinder.c99.nl/scans/2025-04-02/mywikis.net |
03:12:22 | | Webuser616321 joins |
03:14:08 | <Webuser616321> | Hi there. I am looking to archive a wiki that I fear might go offline soon seeing as the site is struggling to load. Requests take 60-90 seconds to complete. The dump tool times out after only 30 seconds and I was unable to find a parameter changing that. |
03:26:28 | <pokechu22> | Webuser616321: hmm, that should be configurable, though you might need to change code for it |
03:29:22 | <Webuser616321> | I have the tool installed via pip right now. Guess I need to run it from source then. Thank you for the advice. |
03:30:44 | <pokechu22> | Yeah, looks like you'd need to run it from source, and it looks like the timeouts are hardcoded in various locations, e.g. https://github.com/saveweb/wikiteam3/blob/v4-main/wikiteam3/dumpgenerator/api/page_titles.py#L70 and https://github.com/saveweb/wikiteam3/blob/v4-main/wikiteam3/dumpgenerator/dump/page/xmlexport/page_xml_export.py#L95 and |
03:30:46 | <pokechu22> | https://github.com/saveweb/wikiteam3/blob/v4-main/wikiteam3/dumpgenerator/dump/image/image.py#L499 |
03:32:41 | <pokechu22> | I'm going to be away for a bit but hopefully that's a starting point for you. Any timeouts that occur should point to the line for the request in the stack trace so they shouldn't be too hard to find, and you *should* be able to resume the existing download once you change the timeout |
03:33:13 | <pokechu22> | I haven't used the tool on its own in a while though (I mainly use #wikibot, but that's not suitable for something that'd require a change like this) |
03:33:22 | <Webuser616321> | Thank you again for pointing me to the exact lines. That's very helpful! |
03:34:03 | <Webuser616321> | I read that I could request here for someone to set up wikibot for a wiki that could use a backup. |
03:41:35 | <Webuser616321> | Since it might take a while until I can get around and play with the source code I would like to try requesting archival of https://stargatewiki.de/ |
03:41:35 | <Webuser616321> | The wiki is a very comprehensive German wiki about the TV series Stargate spanning knowledge over all the different installments. The site is barely responsive anymore and I see wikia/fandom versions starting over to collect information. Because I fear the hoster might have lost interest in the project since the series does not exactly have a clear |
03:41:35 | <Webuser616321> | future for a good while now, I would like to request it to be archived using the wikibot. Thank you for your consideration. |
03:42:36 | | Webuser616321 quits [Client Quit] |
04:49:52 | <pabs> | this wiki blocks wikibot: https://wiki.mhut.org/start |
04:59:25 | <yzqzss> | I realized I haven't focus on wikiteam project for a long time |
09:37:42 | | Webuser221865 joins |
09:38:09 | | Webuser221865 leaves |