02:57:59 | | davispuh quits [Ping timeout: 260 seconds] |
03:34:40 | <triplecamera|m> | No, glyphwiki.org is not MediaWiki. |
03:34:40 | <triplecamera|m> | https://en.glyphwiki.org/wiki/GlyphWiki:About |
03:34:40 | <triplecamera|m> | > The system is written from scratch in Perl. |
06:23:46 | | DogsRNice quits [Read error: Connection reset by peer] |
06:38:49 | | andrew9 (andrew) joins |
06:39:39 | | andrew quits [Ping timeout: 260 seconds] |
06:39:39 | | andrew9 is now known as andrew |
07:22:39 | <pokechu22> | https://wiki.godvillegame.com/ seems to be problematic with e.g. requests.exceptions.ChunkedEncodingError: ('Connection broken: IncompleteRead(7639 bytes read, 2601 more expected)', IncompleteRead(7639 bytes read, 2601 more expected)) which persists at the same point in history on retries |
09:40:26 | | Barto quits [Quit: WeeChat 4.7.0] |
09:42:52 | | Barto (Barto) joins |
12:34:45 | | davispuh joins |
15:52:44 | <@arkiver> | triplecamera|m: thanks! stuff like glyphwiki.org is not supported and will likely not be supported in this Warrior project |
18:05:04 | | Matthww quits [Ping timeout: 260 seconds] |
19:28:35 | | archiveDrill joins |
19:42:19 | | DogsRNice joins |
19:43:09 | | DogsRNice_ joins |
19:43:14 | | DogsRNice_ quits [Client Quit] |
19:47:09 | | DogsRNice quits [Ping timeout: 260 seconds] |
19:50:41 | | DogsRNice joins |
21:37:30 | | archiveDrill quits [Quit: The Lounge - https://thelounge.chat] |
21:39:57 | | archiveDrill joins |
23:44:39 | | Webuser741785 joins |
23:46:20 | <Webuser741785> | Hello! I have always wanted to have an offline copy of the Superpower Wiki. Ideally I'd love to have a .zim file of it so that i could view it in Kiwix, but however the process works will be what I adapt to. I hope I could get some help here with this endeavor. It's for archival purposes as well as offline creation and inspiration. |
23:47:12 | <pokechu22> | Webuser741785: are you referring to https://powerlisting.fandom.com/wiki/Superpower_Wiki or a different wiki? |
23:47:29 | <Webuser741785> | Yes, that's exactly the one! |
23:48:22 | <pokechu22> | I'm not super familiar with zim - this project generates a mediawiki xml dump file and a compressed file containing all of the images. I think that's the same as the exports for wikipedia.org so there's probably a tool to convert it, but I'm not 100% sure of the details |
23:49:14 | <pokechu22> | I'll start a new dump; there's some older ones at https://archive.org/search?query=originalurl%3A%28%2Apowerlisting.fandom.com%2A%29 and the new one should appear there too when it finishes |
23:49:44 | <Webuser741785> | Well I was out looking for a .zim file simply because it's everything packed all into one file and it's the type of format that is recognized by the Kiwix offline reader, but I'm not too familiar with xml, but however it works I'm open to learning about it and where I can plug that in for offline viewing. |
23:50:54 | <Webuser741785> | Oh, thanks! That's honestly why I decided to try out this chat here, because the one I found on the Internet Archive is from 2020, so I thought I might be able to get something more up-to-date potentially. |
23:50:59 | <pokechu22> | Based on the size of the wiki, it'll probably be at least a day for it to download completely, potentially multiple days |
23:51:46 | <Webuser741785> | I'm willing to take that on if need be. Do you have any idea what the storage size would be in order to house it? |
23:52:20 | <pokechu22> | I've already started it in #wikibot. Based on the 2020 version it's probably only going to be a couple of gigabytes |
23:52:40 | <Webuser741785> | Okay, that's not bad at all |
23:53:21 | <Webuser741785> | Compared to the offline version of the entirety of Wikipedia which was 109GB, I'm happy with a couple of gigs to deal with. |
23:54:28 | <Webuser741785> | So how will this work exactly? After a day or a few days the full download will be on the Internet Archive page that has the 2020 saved version, at which point I could just begin downloading the result? |
23:55:22 | <pokechu22> | Yeah, it should appear on https://archive.org/search?query=originalurl%3A%28%2Apowerlisting.fandom.com%2A%29 as a new item, which you can then download. You can also watch the progress on https://wikibot.digitaldragon.dev/ ([arvcontinue]: 20101206165137|13405 means it's currently looking at page revisions from 2010, and it goes forward in time progressively) |
23:57:20 | <pokechu22> | https://powerlisting.fandom.com/vi/wiki/Main_Page should also appear there much sooner, since it's much smaller |
23:58:02 | <Webuser741785> | Oh that's so neat! I can't thank you enough for helping me with this, because I had absolutely no idea where to start with this kind of thing. I was considering HTTrack to attempt the copy, but I don't know what the results of that would have been for something of this size. |