HomeSearchPrevious dayNext day

00:00:55dm4v quits [Read error: Connection reset by peer]
00:01:10dm4v joins
00:01:12dm4v quits [Changing host]
00:01:12dm4v (dm4v) joins
00:17:42Ruthalas5 (Ruthalas) joins
00:19:44Ruthalas quits [Ping timeout: 244 seconds]
00:19:45Ruthalas5 is now known as Ruthalas
00:37:22BlueMaxima joins
01:01:08<tech234a>arkiver: there’s a sitemap https://play.google.com/robots.txt
01:01:16<tech234a>CC Ryz
01:02:45dm4v quits [Read error: Connection reset by peer]
01:04:32dm4v joins
01:04:34dm4v quits [Changing host]
01:04:34dm4v (dm4v) joins
01:06:08<tech234a>Apple also has one for their App Store: https://apps.apple.com/robots.txt
01:06:24pcr joins
01:06:53<tech234a>Also for iTunes: https://itunes.apple.com/robots.txt
01:22:26bitbit (bitbit) joins
01:24:42<bitbit>Somebody2: what kind of work did you do on past censuses? seems like it's only a matter of running the script Jake mentioned?
01:44:39<Somebody2>I wrote some of the scripts, and did a bunch of processing on the output before posting it to those items.
01:45:33<Somebody2>then had bwn upload them for me
01:45:56<Somebody2>and I have (somewhere) various additional details that IA staff requested I not post
01:46:11<bitbit>oh I see. the script I saw only had `ia search all:1 --itemlist` then it uploads
01:46:50<Somebody2>bitbit: yeah, there's more if you want to do it; see https://wiki.archiveteam.org/index.php/Internet_Archive_Census
01:55:56lennier1 quits [Ping timeout: 250 seconds]
01:57:08lennier1 (lennier1) joins
02:06:03<bitbit>Somebody2: my processing is somewhat different than this
02:06:49<bitbit>by the way, as I'm through reading make_census_data_v2.jq, I realized there are some items which have directories instead of files. do you perhaps know of an identifier like this?
02:06:58<bitbit>reading through*
02:24:49Megame quits [Client Quit]
03:06:27Ryz quits [Remote host closed the connection]
03:09:00Ryz (Ryz) joins
03:37:04qw3rty__ joins
03:40:48qw3rty_ quits [Ping timeout: 250 seconds]
03:49:56HP_Archivist (HP_Archivist) joins
03:53:07Barto quits [Ping timeout: 244 seconds]
04:03:09Barto (Barto) joins
04:31:21HP_Archivist quits [Ping timeout: 244 seconds]
05:08:33wickedplayer494 quits [Ping timeout: 244 seconds]
05:12:06wickedplayer494 joins
05:24:47<Doranwen>some more concern about fanfiction.net is being raised - people saying the mods are suspiciously silent and no longer monitoring the site or responding to emails
05:27:09<Doranwen>it may just be more of that tumblr post from a few months ago rattling around and causing alarm
05:36:56AntiLiberal quits [Ping timeout: 250 seconds]
05:57:19ragu__ joins
06:00:20ragu_ quits [Ping timeout: 250 seconds]
06:00:43ragu_ joins
06:02:17ragu__ quits [Ping timeout: 244 seconds]
06:02:46ragu__ joins
06:05:58ragu_ quits [Ping timeout: 250 seconds]
06:09:52wickedplayer494 quits [Ping timeout: 250 seconds]
06:36:23pabs quits [Ping timeout: 244 seconds]
06:40:22pabs (pabs) joins
06:41:58wickedplayer494 joins
07:27:41Matthww81 joins
07:28:34Matthww8 quits [Ping timeout: 244 seconds]
07:28:34Matthww81 is now known as Matthww8
07:31:08ragu_ joins
07:34:46ragu__ quits [Ping timeout: 244 seconds]
07:40:50ragu__ joins
07:44:04ragu_ quits [Ping timeout: 244 seconds]
07:44:16ragu_ joins
07:46:39ragu__ quits [Ping timeout: 244 seconds]
07:55:25Matthww86 joins
07:57:13Matthww8 quits [Ping timeout: 252 seconds]
07:57:13Matthww86 is now known as Matthww8
07:58:48knecht420 quits [Quit: The Lounge - https://thelounge.chat]
07:59:07knecht420 (knecht420) joins
08:35:04jamesatjaminit (jamesatjaminit) joins
09:02:49ragu_ quits [Client Quit]
10:19:50qwertyasdfuiopghjkl joins
10:33:46BlueMaxima quits [Remote host closed the connection]
10:34:01BlueMaxima joins
10:35:05HackMii quits [Ping timeout: 258 seconds]
10:36:42wolfin quits [Read error: Connection reset by peer]
10:37:07wolfin (wolfin) joins
10:37:54HackMii (hacktheplanet) joins
10:59:46aphitex22 quits [Ping timeout: 250 seconds]
11:07:24aphitex22 joins
11:10:18Megame (Megame) joins
11:26:25qwertyasdfuiopghjkl11 joins
11:29:20qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
11:29:23qwertyasdfuiopghjkl11 is now known as qwertyasdfuiopghjkl
12:07:28bitbit quits [Ping timeout: 252 seconds]
12:15:59qwertyasdfuiopghjkl quits [Remote host closed the connection]
12:25:21qw3rty_ joins
12:25:22apache2 joins
12:26:24qw3rty__ quits [Read error: Connection reset by peer]
12:26:24apache2_ quits [Remote host closed the connection]
12:26:24voltagex quits [Quit: ZNC 1.7.2+deb3 - https://znc.in]
12:26:24xit quits [Quit: Ping timeout (120 seconds)]
12:26:24m0nika quits [Quit: Ping timeout (120 seconds)]
12:26:24xit joins
12:26:24jamesatjaminit quits [Client Quit]
12:26:24m0nika (m0nika) joins
12:26:37voltagex_ joins
12:26:37jamesatjaminit (jamesatjaminit) joins
12:49:56lennier1 quits [Ping timeout: 244 seconds]
12:52:40lennier1 (lennier1) joins
14:15:04lennier1 quits [Ping timeout: 252 seconds]
14:17:52lennier1 (lennier1) joins
14:45:33knecht420 quits [Read error: Connection reset by peer]
14:45:35knecht4203 (knecht420) joins
15:05:07Arcorann quits [Ping timeout: 252 seconds]
15:14:24BlueMaxima quits [Client Quit]
15:44:18NF885 (NF885) joins
16:08:20NF885 quits [Ping timeout: 244 seconds]
16:50:56OrIdow6 (OrIdow6) joins
16:50:56@ChanServ sets mode: +o OrIdow6
17:05:44HP_Archivist (HP_Archivist) joins
17:40:45qw3rty_ quits [Read error: Connection reset by peer]
17:40:54qw3rty joins
18:06:22<grawity>tbh I've been worried about ff.net for a good few years already (though ... was assuming it's large enough that Someone Else was already grabbing it)
18:07:03<grawity>(iirc there was some thing a few years back about them deleting a lot of posts deliberately...)
18:45:43<@JAA>There are several dumps of it in various places, yeah, but no proper archive (i.e. WARC, WBM) as far as I know. I've been meaning to get that going but was occupied with other things.
18:51:44<grawity>hmm
18:52:30<grawity>well, the fanfics are what's important, can live without the ad-ridden original website
19:03:42<AK>How big is FF.net? Is it too big for AB?
19:11:12<@JAA>Doesn't work in AB due to JS.
19:11:29<@JAA>Also, annoying rate limits.
19:20:26<grawity>the m. variant is JS-free, at least when switching chapters
19:20:41<grawity>fictionpress is under the same management?
19:31:28rsn joins
19:35:26rsn_ quits [Ping timeout: 250 seconds]
19:40:48rsn_ joins
19:43:25rsn quits [Ping timeout: 252 seconds]
19:55:55AntiLiberal joins
20:02:54AntiLiberal quits [Ping timeout: 244 seconds]
20:04:47rsn joins
20:06:02spirit quits [Client Quit]
20:07:04rsn_ quits [Ping timeout: 250 seconds]
21:29:34britmob256 quits [Ping timeout: 252 seconds]
21:31:33Matthww84 joins
21:32:52Matthww8 quits [Ping timeout: 252 seconds]
21:32:52Matthww84 is now known as Matthww8
22:13:52phiresky5 joins
22:14:25britmob joins
22:14:54phiresky quits [Ping timeout: 250 seconds]
22:14:54phiresky5 is now known as phiresky
22:23:39<Frogging101>Fandom sucks.
22:26:51<wizards_>definitely
22:29:06<Doranwen>lol
22:43:01britmob256 joins
23:08:12Atom quits [Ping timeout: 250 seconds]
23:18:54Arcorann (Arcorann) joins
23:48:22sec^nd (second) joins
23:50:44sec^nd quits [Remote host closed the connection]
23:51:05sec^nd (second) joins
23:51:41sec^nd quits [Remote host closed the connection]
23:51:59sec^nd (second) joins
23:59:46HP_Archivist quits [Ping timeout: 250 seconds]

HomeSearchPrevious dayNext day