HomeSearchPrevious dayNext day

00:09:05<systwi>michaelblob: Thanks! I'm surprised the whole thing is only 7MB.
00:20:07monika (boom) joins
01:06:42kdqep (kdqep) joins
02:21:50nepeat quits [Client Quit]
02:27:17AnotherIki joins
02:30:57Iki1 quits [Ping timeout: 245 seconds]
02:35:14nepeat (nepeat) joins
03:58:26michaelblob quits [Ping timeout: 265 seconds]
04:52:15michaelblob (michaelblob) joins
05:39:30AnotherIki quits [Remote host closed the connection]
05:39:30kdqep quits [Client Quit]
05:39:40AnotherIki joins
06:30:32qwertyasdfuiopghjkl quits [Remote host closed the connection]
08:12:52DiscantX joins
08:23:35Discant joins
08:23:47DiscantX quits [Ping timeout: 265 seconds]
09:33:52Matthww quits [Ping timeout: 245 seconds]
09:34:58Matthww joins
10:16:18UnderMybrella joins
10:17:13UnderMybrella quits [Read error: Connection reset by peer]
12:16:16Discant quits [Ping timeout: 265 seconds]
13:45:36AnotherIki quits [Remote host closed the connection]
13:45:46AnotherIki joins
14:37:37Matthww quits [Ping timeout: 245 seconds]
14:58:06Matthww joins
17:10:37kdqep (kdqep) joins
18:42:27kdqep quits [Ping timeout: 265 seconds]
19:49:46AnotherIki quits [Remote host closed the connection]
19:49:56AnotherIki joins
19:56:55Guest334 joins
19:57:17<Guest334>How would one acess a archived verson of a wiki
19:57:30<Guest334>Aslo, how would I get my wiki archived?
19:58:11<@JAA>The output by WikiTeam tooling is an XML dump that can be imported into MediaWiki again. It's otherwise tricky to make any use of them.
19:58:52<@JAA>If you post the URL here, someone can get it dumped. :-)
19:59:02<Guest334>DO wikis have to be Creative Commons toi be dumped?
19:59:13<Guest334>The wiki in requestion is all rights reserved
20:00:55<@JAA>In short, no, we don't care what the copyright situation is. (The details are complicated, but basically, there are fair use exceptions for archivists and libraries in many jurisdictions.)
20:01:22<Guest334>Ah, it is this wiki: https://taerel.com/wiki/index.php?from=&to=&namespace=3000&title=Special%3AAllPages
20:01:35<Guest334>Aslo, would you be able to get it onto WikiApiry?
20:01:37<@JAA>It could happen that the dump becomes unavailable though if the copyright holder complains to the Internet Archive about it being distributed.
20:01:45<Guest334>Oh, k
20:02:29<Guest334>Aslo, thank you for making the Internet Archive
20:02:31<@JAA>(So if you care, I'd recommend downloading it and keeping a copy for yourself once the dump is available.)
20:02:43<@JAA>We are not the Internet Archive. We're just a bunch of nerds on IRC. :-)
20:02:50<Guest334>That is a good idea
20:03:06<Guest334>Do you have Discord?
20:03:10<@JAA>We happen to upload almost all our work to IA, but otherwise there's no relation.
20:03:22<@JAA>No: https://wiki.archiveteam.org/index.php?title=User:JustAnotherArchivist/Discord
20:03:57<Guest334>I don't mind using IRC time to time, but well, tbh maybe I need to find more intersing IRC channels
20:04:46<Guest334>I do hate the fact Discord could ban me due to using stuff to reskin my client
20:05:52<Guest334>How would I acess the dump once it happens?
20:09:51<@JAA>It should show up on this search then: https://archive.org/search.php?query=%22taerel.com%22&sin=
20:09:55<Guest334>And do you store dumps of wikis stand alone as well? (so, I could download just my wiki)
20:10:45<@JAA>Not entirely sure what you mean. Each dump of a wiki produces separate, independent output.
20:11:07<Guest334>Ah, that is good, saves me haivng to download a hudge file full of dumps
20:11:17<Guest334>And them having to tease out my own wiki#
20:11:20<@JAA>Usually two files, one 'wikidump' and one 'history.xml'.
20:11:45<Guest334>What is history.xml? And what is wikidump?
20:13:53<@JAA>I think wikidump is the whole thing and history is only the page edits (without images etc.), but not 100% sure.
20:14:29<Guest334>My wiki won't be too big for you :)
20:14:40<Guest334>Its only about 755 pages of lore
20:23:35<Guest334>BRB joining on hexchat
20:24:33Eytirth joins
20:24:43<Eytirth>Back
20:24:49Guest334 quits [Remote host closed the connection]
20:24:59<@JAA>:-)
20:25:13<Eytirth>Sorry, wanted to join on Hexchat
20:25:41<@JAA>Yes, much better than the web chat thingy.
20:26:37<Eytirth>I use that when I am not sure if I want top idle for a while
20:29:13<Eytirth>How are the saved wikis backed up? What meseres does IA have to make sure wiki dumps are not deleted?
20:29:21<Eytirth>*Deleted by a hacker
20:38:11<@JAA>We don't really have insight into what IA does internally to protect their systems. What's publicly known is that they have a complete mirror of all data in a separate location (a few kilometre from the primary). That's more about physical security though (e.g. drive failures but also if something caught fire).
20:39:00<@JAA>Running an analysis now on how big the wikiteam collection is (minus Wikimedia Commons) because I'm curious.
20:41:25<Eytirth>Seems pretty easy to ruin if something happened to the area
20:41:39<@JAA>Yep
20:41:52<Eytirth>I really hope they have backed up far away as well
20:41:58<@JAA>The problem, as usual, is $$$$.
20:42:10<@JAA>Or really more like $$$$$$$$$ since that's the order of magnitude we'd be talking about.
20:42:21<Eytirth>It seems one big problem away from loosing all their data
20:42:50<@JAA>They started mirroring parts of it to Canada a few years ago. No update on the status of that in a long while though as far as I've seen.
20:43:05Eytirth nods
20:43:13<Eytirth>I hope they are still doing t6hat
20:44:43<@JAA>Meh, my collection size script is broken. Might fix that later.
20:49:56<Eytirth>I am worried the IA won't be around in 5 years
20:51:55<Eytirth>Oh, was my wiki backed up?
20:51:59<Eytirth>*archived
20:52:33<Eytirth>JAA, can someone ping me once it is archived please?#
20:54:10<@JAA>Oh yeah, that might go missing in the middle of the discussion.
20:54:25<@JAA>TheTechRobo: Can you dump https://taerel.com/ please and ping Eytirth when it's on IA?
20:54:33<Eytirth>Do you want me to DM you a reminder?
20:56:18<@JAA>Nah, just mention it in here again if it isn't done within a few days.
21:04:52<TheTechRobo>Eytirth, JAA: Both wikis listed there ("Finished pages" and "Unfinished pages")?
21:05:05<Eytirth>tech234a, just finished
21:06:27<TheTechRobo><Guest334> I do hate the fact Discord could ban me due to using stuff to reskin my client
21:06:55<Eytirth>The unfinished pages wiki probably gets archived with the miraheze wikis and that wiki is only page templates + finished but not moved pages + half done pages, that wiki is just a place where pages are made, they are moved to the finished wiki after each 50,000 words are done
21:07:03<TheTechRobo>Discord's awful. Only reason I still have it is because friends. It's also convenient, being able to scrape it. (#discard for that)
21:07:14<TheTechRobo>Eytirth: I'll archive both, just to be on the safe side. :-)
21:07:20<Eytirth>Oh k
21:08:19<Eytirth>TheTechRobo, I only really have it as well, the wiki discord is there
21:08:41<Eytirth>And for a few other wiki related things, you don;'t really need to archive the unfinished wiki really
21:09:03<TheTechRobo>Eytirth: feel free to send me random server invites in #discard and I'll archive them eventually
21:09:12Eytirth nods
21:09:28<TheTechRobo>Why is Miraheze so SLOW
21:12:16<TheTechRobo>How do you set the dumpgenerator.py timeout?
21:12:44<TheTechRobo>Oh nevermind, it's working now... kind of... maybe.
21:13:19<Eytirth>IDK why Miraheze is slow, but it is annoying
21:14:09<@JAA>All the more reason to archive anything located there.
21:14:23<TheTechRobo>...And of course the finished pages wiki (not sure about the unfinished one becaUSE MIRAHEZE IS SO SLOW) doesn't have a Main_Page which is causing dumpgenerator to wait ages.
21:14:58<Eytirth>The main page is on a custom page
21:15:14<TheTechRobo>Yeah, I see that.
21:15:23<TheTechRobo>But for some reason dumpgenerator doesn't.
21:15:32<TheTechRobo>Yay. In attempt 4, XML for "Main_Page" is wrong. Waiting 80 seconds and reloading...
21:15:51<Eytirth>Thinking about it, miraheze should be archived as well, wiki farms do tend to vanished
21:16:15<Eytirth>Should I move it back to main_page for now?
21:17:08<TheTechRobo>No, it's fine. Just going to slow down the crawl for another few minutes.
21:21:04<Eytirth>I rember MWzip vanishing, was that arcived?
21:24:14<TheTechRobo>https://taerel.com/wiki/index.php/Taerel_New_Pages is broken.
21:24:28<TheTechRobo>Nevermind. It _was_ broken for a second.
21:29:17michaelblob quits [Ping timeout: 245 seconds]
21:40:27qwertyasdfuiopghjkl joins
21:46:14<Eytirth>Any progess?
21:48:21Discant joins
21:57:21Eytirth1 joins
22:00:31Iki1 joins
22:00:31qwertyasdfuiopghjkl quits [Ping timeout: 298 seconds]
22:00:31Eytirth quits [Ping timeout: 298 seconds]
22:00:31AnotherIki quits [Ping timeout: 286 seconds]
22:00:32mr_archive quits [Ping timeout: 298 seconds]
22:00:32Iki1 quits [Remote host closed the connection]
22:00:40Iki1 joins
22:00:42mr_archive joins
22:37:17<TheTechRobo>Eytirth1: the unfinished one and a potentially incomplete dump of the finished pages one are finished
22:37:31<TheTechRobo>I'm waiting for another, even less complete dump of the finished pages one to complete, then I'll upload to IA
22:40:58<Eytirth1>TheTechRobo, I hopwe to obtain a fully complate dump
22:41:18<TheTechRobo>Eytirth1: The problem is how broken the "finished pages" one is.
22:41:24<Eytirth1>How do I fix?
22:41:39<Eytirth1>That is the most inpoant dump, so I will need to fix it asap
22:41:43<TheTechRobo>For the API grab, dumpgenerator complains about bad XML.
22:41:58<TheTechRobo>For the index.php grab, it seemed to finish successfully, but I'm not sure if it got all the pages.
22:42:13<Eytirth1>No idea how to fix that... I could give you a dump of my own if the old one is not complate
22:42:38<TheTechRobo>Yeah, the index.php one didn't get anything.
22:42:48<TheTechRobo><Eytirth1> No idea how to fix that... I could give you a dump of my own if the old one is not complate
22:43:04<Eytirth1>I know how to get a dump from the back end
22:43:09<TheTechRobo>That would be nice.
22:43:55<TheTechRobo>We might also have to archive it with ArchiveBot to make sure we get a complete grab.
22:44:07<TheTechRobo>I'm not sure why everything is so broken.
22:44:59<TheTechRobo>It appears that the api.php export won't get revisions, because for some reason when dumpgenerator tries to get revisions, the "XML is wrong".
22:46:09<TheTechRobo>I'm using warcprox to try to figure out what it means by that.
22:46:45<Eytirth1>https://mega.nz/file/bwsAWIKa#kusWzvtoRgav7Za67Jpepmfix0Zj2irDDV_3_OzRWNw
22:46:48<Eytirth1>Here is a dump
22:51:16<Eytirth1>TheTechRobo, ^
22:51:46<TheTechRobo>What about images...?
22:52:51<Eytirth1>No images on the site besides a few that are eslewhere (on DeviantArt)
22:57:00<TheTechRobo>(Non-MEGA link: https://transfer.archivete.am/Vpal2/Taerel6June2022.xml.zst)
22:57:51<Eytirth1>Pleease ping me once it is on the archive and visable
23:01:52<TheTechRobo>Eytirth1: Do you want me to add your dump to the IA item?
23:02:03<Eytirth1>Yes, I guess
23:02:54<Eytirth1>The other dumps you made won't need to go on besides the Unfinisjed wiki on
23:03:26<Eytirth1>As those incomplete dumps would be no use to someone wanting to restore the wiki
23:03:56tzt (tzt) joins
23:05:05eroc1990 quits [Quit: Ping timeout (120 seconds)]
23:06:04eroc1990 (eroc1990) joins
23:11:14qwertyasdfuiopghjkl joins
23:11:25qwertyasdfuiopghjkl quits [Remote host closed the connection]
23:12:10qwertyasdfuiopghjkl joins
23:23:00<Eytirth1>TheTechRobo, ^
23:23:10<TheTechRobo>Eytirth1: yeah, I saw
23:23:23<TheTechRobo>Unfinished pages: https://archive.org/details/wiki-quyraness.miraheze.org
23:23:48<Eytirth1>You did a really good job
23:24:06<TheTechRobo>Still waiting on the finished pages' incomplete grab. (I know an incomplete grab isn't that helpful, but who knows.)
23:24:13<TheTechRobo>Eytirth1: Nah, it's as simple as running a few scripts.
23:24:43<Eytirth1>Well, I have that full dump so you won't need the grab for the xml dump
23:25:10<Eytirth1>You could use the full dump I had on Mega to use for the object
23:28:11<TheTechRobo>Again, I know, but I'm a data-hoarder and it's only a few more megabytes.
23:28:17<TheTechRobo>It might also have some extra metadata.
23:40:03monika quits [Ping timeout: 265 seconds]
23:40:13kdqep (kdqep) joins
23:41:17eroc1990 quits [Client Quit]
23:43:26jodizzle quits [Ping timeout: 265 seconds]
23:44:53kdqep quits [Ping timeout: 265 seconds]
23:49:04monika (boom) joins

HomeSearchPrevious dayNext day