00:17:03 | | Terbium quits [Quit: No Ping reply in 180 seconds.] |
00:17:03 | | qwertyasdfuiopghjkl quits [Client Quit] |
00:18:06 | | Terbium joins |
00:35:25 | <michaelblob> | again from first batch: https://archive.org/details/wiki-wikitglnetru |
00:35:28 | <michaelblob> | starting the second batch |
00:37:13 | <pokechu22> | Did everything in the first batch download successfully? |
00:37:55 | <pokechu22> | or were there ones where things didn't download properly that'll need to be revisited later with modified tools? |
00:57:47 | <michaelblob> | there were a couple ones that borked due to various issues, i'll list the APIs and the error i ran into |
00:57:58 | <michaelblob> | http://wiki.mephist.ru/api.php invalid continuation byte |
00:58:08 | <michaelblob> | https://neolurk.org/w/api.php needs login |
00:58:41 | <michaelblob> | http://wiki.risk.ru/api.php API encounters internal server error |
00:58:51 | <michaelblob> | https://wiki.tsu.ru/wiki/api.php unable to get local issuer certificate |
00:59:06 | <michaelblob> | https://traditio.wiki/w/api.php list index out of range when scanning namespaces |
00:59:22 | <michaelblob> | https://memoteka.com/api.php No </mediawiki> tag found |
00:59:45 | <michaelblob> | the rest are either uploaded, uploading, or still running |
00:59:49 | <pokechu22> | Huh, that's a fairly wide set of errors, don't think I've seen most of those |
01:00:12 | <michaelblob> | yeah not sure if tool modification is gonna solve most of these |
01:00:27 | <pokechu22> | I did run into issues with punycode before but it looks like none of those were punycode |
01:00:44 | <michaelblob> | on an unrelated note, https://wiki.nashtransport.ru/api.php is currently uploading and the wikidump is 70gb ;-; |
01:01:21 | <pokechu22> | https://wiki.nashtransport.ru/wiki/%D0%A1%D0%BB%D1%83%D0%B6%D0%B5%D0%B1%D0%BD%D0%B0%D1%8F:MediaStatistics says 69GB of files, wow |
01:01:57 | <michaelblob> | it'll be done in a minute or so but it's taken me 90 min to get here haha |
01:02:20 | <pokechu22> | Nothing really compares to https://retrocdn.net/Special:MediaStatistics though (1.65 TB)... well, I guess commons is bigger (https://commons.wikimedia.org/wiki/Special:MediaStatistics gives 389 TB), but that's reasonable |
01:02:56 | <michaelblob> | my goodness, i'm gonna have to reprovision some systems to handle that kind of size |
01:03:05 | <michaelblob> | (if we ever need to dump that) |
01:03:18 | <pokechu22> | Yeah, probably not a good idea to dump that one directly |
01:04:25 | <pokechu22> | My uploads tend to take a fair bit longer, but I'm using the web uploader instead of the script and my upload speed in general is probably worse than yours |
01:06:44 | <michaelblob> | i have symmetrical 1gig fiber :P |
01:06:49 | <michaelblob> | probably helps a bit |
01:19:53 | | Iki1 joins |
01:23:43 | | Iki quits [Ping timeout: 252 seconds] |
03:19:33 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
03:27:47 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
03:28:08 | | qwertyasdfuiopghjkl31 (qwertyasdfuiopghjkl) joins |
03:29:42 | | qwertyasdfuiopghjkl31 is now known as qwertyasdfuiopghjkl |
03:55:18 | | Iki1 quits [Read error: Connection reset by peer] |
04:02:52 | <michaelblob> | https://archive.org/details/wiki-wikinashtransportru-20230314 |
04:47:18 | <michaelblob> | second batch completed: https://archive.org/details/wiki-xn__80aab4a4dkz https://archive.org/details/wiki-transhumanistru https://archive.org/details/wiki-institutemoney_moneypedia https://archive.org/details/wiki-cryptopediaone_w https://archive.org/details/wiki-vedopediawitches_empirecom_w-20230316 https://archive.org/details/wiki-oecumenewiki https://archive.org/details/wiki-wikigeologyscienceru https://archive.org/details/wiki-stellaryonline |
04:47:18 | <michaelblob> | https://archive.org/details/wiki-smallstepsru_w |
04:47:54 | <michaelblob> | https://archive.org/details/wiki-wiki_kenigru https://archive.org/details/wiki-sovietpriborru https://archive.org/details/wiki-armostationmirahezeorg_w https://archive.org/details/wiki-transformersmirahezeorg_w-20230316 https://archive.org/details/wiki-rusminecrafttrollpastamirahezeorg_w https://archive.org/details/wiki-rumonstergirlencyclopediamirahezeorg_w https://archive.org/details/wiki-wikiborealisdayzcom https://archive.org/details/wiki-pola |
04:47:54 | <michaelblob> | ndcuberumirahezeorg_w https://archive.org/details/wiki-vanillapiecemirahezeorg_w |
04:48:20 | <michaelblob> | https://archive.org/details/wiki-younarodmirahezeorg_w https://archive.org/details/wiki-wildterra2mirahezeorg_w https://archive.org/details/wiki-mariaworldmirahezeorg_w-20230316 https://archive.org/details/wiki-we22mirahezeorg_w https://archive.org/details/wiki-sc2blizzwikiru |
04:48:34 | <michaelblob> | the following borked: |
04:48:41 | <michaelblob> | https://mari-lab.ru/api.php unable to get local issuer certificate |
04:48:47 | <michaelblob> | http://kopypaste.wikidot.com/ not MediaWiki? |
04:48:51 | <michaelblob> | https://www.physbook.ru/api.php API error |
04:48:55 | <michaelblob> | https://hubshield.miraheze.org/w/api.php needs login |
05:01:09 | <michaelblob> | from first batch: https://archive.org/details/wiki-wikiiroyarru |
05:01:18 | <michaelblob> | still running http://wiki-sibiriada.ru/api.php and https://wiki.ippk.ru/api.php |
05:51:26 | | michaelblob_ (michaelblob) joins |
05:53:46 | | michaelblob quits [Ping timeout: 252 seconds] |
09:16:39 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
09:47:48 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
09:57:12 | | hitgrr8 joins |
11:52:07 | | Iki joins |
14:36:48 | | Iki1 joins |
14:37:35 | | Iki quits [Remote host closed the connection] |
14:37:36 | | qwertyasdfuiopghjkl quits [Client Quit] |
14:38:08 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
14:46:38 | | qwertyasdfuiopghjkl quits [Client Quit] |
15:04:12 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
15:45:34 | | Kuatrero quits [Ping timeout: 252 seconds] |
15:45:58 | | Bedivere joins |
19:51:10 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
20:06:02 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
22:15:11 | | Bedivere quits [Read error: Connection reset by peer] |
22:19:37 | | Bedivere joins |
22:20:13 | | Bedivere quits [Read error: Connection reset by peer] |
22:20:57 | | Bedivere joins |
23:08:40 | | hitgrr8 quits [Client Quit] |