00:32:08wickedplayer494 quits [Ping timeout: 276 seconds]
00:32:44wickedplayer494 joins
00:34:11nicolas17 quits [Ping timeout: 260 seconds]
00:37:18hexa- quits [Quit: WeeChat 4.6.3]
00:39:19hexa_ (hexa-) joins
00:45:13katia is now known as BouncerServ
00:55:11Juest quits [Ping timeout: 260 seconds]
00:58:18Sidpatchy6 (Sidpatchy) joins
01:00:44Sidpatchy quits [Ping timeout: 276 seconds]
01:00:45Sidpatchy6 is now known as Sidpatchy
01:02:12nicolas17 joins
01:03:56cultpony quits [Ping timeout: 260 seconds]
01:09:34cultpony (cultpony) joins
01:24:55Juest (Juest) joins
01:36:41Wohlstand quits [Quit: Wohlstand]
01:40:06lemuria quits [Ping timeout: 260 seconds]
02:19:32cuphead2527480 quits [Client Quit]
02:27:54Island joins
02:55:59etnguyen03 quits [Remote host closed the connection]
03:23:01TastyWiener95 (TastyWiener95) joins
03:27:08TastyWiener95 quits [Client Quit]
04:33:19<nicolas17>archiving Apple's API docs (ahead of tomorrow's release which will update docs!) would mean downloading ~27.9GiB
04:33:24<nicolas17>plus images, which I didn't look into yet
04:33:44<nicolas17>it's highly compressible (HTML and JSON) so the final warc should be much smaller
04:34:11<nicolas17>but also has dupes, because for browsing to work I need to save the ?language=objc variant for every URL even though 99% of them have identical content, and annoyingly archivebot doesn't dedupe
04:35:30<nicolas17>do I just throw it into AB anyway?
04:37:37<nicolas17>also: does SPN execute javascript? if so, I could SPN a single page to grab all the page requisites
04:43:12khaoohs quits [Read error: Connection reset by peer]
04:43:30khaoohs joins
04:48:31pabs quits [Ping timeout: 260 seconds]
04:50:16hackbug quits [Ping timeout: 260 seconds]
04:52:04hackbug (hackbug) joins
04:54:36lemuria (lemuria) joins
04:59:45<BlankEclair>> [09/06/2025 14:37] <nicolas17> also: does SPN execute javascript? if so, I could SPN a single page to grab all the page requisites
04:59:48<BlankEclair>it does, no?
05:08:13<nicolas17>looking at linked resources like images and sample code... ooofff there's some huge files here
05:22:57<nicolas17>sample code is 17.3GiB, and it seems very few of those URLs are already archived (but checking all of them via cdx is taking forever)
05:29:03pabs (pabs) joins
05:30:28<pokechu22>nicolas17: SPN does execute javascript, but it does have a timeout so it's not really reliable for it IMO
05:30:51<pokechu22>if you've already generated a list, it'd be better to AB it, and doing ~27GB for that seems reasonable
06:55:32TastyWiener95 (TastyWiener95) joins
07:10:14<Dango360>pokechu22, nicolas17: using wayback-machine-spn-scripts with the request option to "js_behavior_timeout=30" should be enough time (30 secs)
07:10:23Guest58 joins
07:31:01Island quits [Read error: Connection reset by peer]
07:48:02Wohlstand (Wohlstand) joins
08:03:08Wohlstand1 (Wohlstand) joins
08:04:31Wohlstand quits [Ping timeout: 260 seconds]
08:04:31Wohlstand1 is now known as Wohlstand
08:47:58Dada joins
09:11:47Guest58 quits [Client Quit]
09:53:38kedihacker quits [Remote host closed the connection]
09:54:11kedihacker (kedihacker) joins
09:55:36kedihacker quits [Remote host closed the connection]
09:56:38kedihacker (kedihacker) joins
10:19:55Guest58 joins
10:21:34<h2ibot>Bear edited Data compression algorithms and tools (+756, /* General purpose compression */ bzip2recover): https://wiki.archiveteam.org/?diff=55994&oldid=53379
10:24:35<h2ibot>Bear edited Data compression algorithms and tools (-4, /* Bzip2 */ Can be more than two.): https://wiki.archiveteam.org/?diff=55995&oldid=55994
10:46:02BouncerServ is now known as katia
11:00:04Bleo182600722719623455 quits [Quit: The Lounge - https://thelounge.chat]
11:02:45Bleo1826007227196234552 joins
11:08:09Guest58_ joins
11:10:36Guest58 quits [Ping timeout: 260 seconds]
11:46:41warpfood joins
11:53:04warpfood leaves
12:13:11nine quits [Quit: See ya!]
12:13:25nine joins
12:13:25nine quits [Changing host]
12:13:25nine (nine) joins
12:35:48cuphead2527480 (Cuphead2527480) joins
13:39:19nine quits [Client Quit]
13:39:31nine joins
13:39:31nine quits [Changing host]
13:39:31nine (nine) joins
13:46:55Wohlstand quits [Quit: Wohlstand]
13:53:53Wohlstand (Wohlstand) joins
14:01:31TheEnbyperor_ quits [Ping timeout: 260 seconds]
14:02:02TheEnbyperor quits [Ping timeout: 276 seconds]
14:03:22TheEnbyperor joins
14:08:01TheEnbyperor_ (TheEnbyperor) joins
14:49:18<h2ibot>Dango360 edited Data compression algorithms and tools (+93, /* External links */ add "Matt Mahoney's Large…): https://wiki.archiveteam.org/?diff=55996&oldid=55995
14:50:02BornOn420 quits [Remote host closed the connection]
14:50:34BornOn420 (BornOn420) joins
14:57:03wickedplayer494 quits [Remote host closed the connection]
15:03:24wickedplayer494 joins
15:06:25wickedplayer494 quits [Remote host closed the connection]
15:37:32grill (grill) joins
15:44:39wickedplayer494 joins
15:55:32cuphead2527480 quits [Quit: Connection closed for inactivity]
15:58:11grill quits [Ping timeout: 260 seconds]
15:59:47grill (grill) joins
16:47:11anonymoususer852 quits [Ping timeout: 260 seconds]
17:06:04anonymoususer852 (anonymoususer852) joins
17:15:39<h2ibot>HadeanEon edited Deaths in 2025 (+1339, BOT - Updating page: {{saved}} (131),…): https://wiki.archiveteam.org/?diff=55997&oldid=55990
17:15:40<h2ibot>HadeanEon edited Deaths in 2025/list (+92, BOT - Updating list): https://wiki.archiveteam.org/?diff=55998&oldid=55991
17:21:35grill quits [Ping timeout: 276 seconds]
17:28:36anonymoususer852 quits [Ping timeout: 260 seconds]
17:44:32kansei- (kansei) joins
17:44:39kansei quits [Read error: Connection reset by peer]
17:51:34grill (grill) joins
17:55:26kansei- quits [Ping timeout: 260 seconds]
18:00:41chunkynutz6 quits [Ping timeout: 260 seconds]
18:05:08grill quits [Ping timeout: 276 seconds]
18:06:43grill (grill) joins
18:14:28kansei (kansei) joins
18:20:56dabs joins
18:24:44kansei quits [Client Quit]
18:28:44chunkynutz6 joins
18:30:46kansei (kansei) joins
18:36:51kansei quits [Ping timeout: 260 seconds]
18:37:16kansei (kansei) joins
19:50:11etnguyen03 (etnguyen03) joins
19:56:46grill quits [Ping timeout: 260 seconds]
19:57:41Island joins
20:08:06cuphead2527480 (Cuphead2527480) joins
20:16:54Larsenv quits [Read error: Connection reset by peer]
20:17:18Larsenv (Larsenv) joins
20:20:04Larsenv quits [Client Quit]
20:20:53Larsenv (Larsenv) joins
20:23:49Webuser154540 joins
20:24:12Webuser154540 quits [Client Quit]
21:31:45etnguyen03 quits [Client Quit]
21:32:03etnguyen03 (etnguyen03) joins
21:58:26<h2ibot>PaulWise edited Anubis (+25, got.high5.nl): https://wiki.archiveteam.org/?diff=55999&oldid=55993
21:58:27<h2ibot>PaulWise edited Anubis (-1, typo): https://wiki.archiveteam.org/?diff=56000&oldid=55999
22:18:57Wohlstand quits [Quit: Wohlstand]
22:19:29<h2ibot>PaulWise edited Anubis (+317, add Anubis Bypass WebExtension): https://wiki.archiveteam.org/?diff=56001&oldid=56000
22:23:30<h2ibot>PaulWise edited Anubis (+384, add anubis-bypass issue with cookie blocking…): https://wiki.archiveteam.org/?diff=56002&oldid=56001
22:36:36Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
22:37:07Shjosan (Shjosan) joins
22:37:45Dada quits [Remote host closed the connection]
22:44:33<h2ibot>PaulWise edited Data compression algorithms and tools (+81, link #justsolve wiki): https://wiki.archiveteam.org/?diff=56003&oldid=55996
22:47:51cuphead2527480 quits [Client Quit]
22:52:28flotwig quits [Quit: ZNC - http://znc.in]
22:56:31flotwig joins
22:56:45graham9 joins
23:09:17flotwig quits [Client Quit]
23:10:14flotwig joins
23:10:29flotwig quits [Client Quit]
23:11:33flotwig joins
23:11:49flotwig quits [Client Quit]
23:14:27flotwig joins
23:15:43flotwig quits [Client Quit]
23:18:00flotwig joins
23:43:47pabs quits [Ping timeout: 276 seconds]
23:46:01Radzig quits [Ping timeout: 260 seconds]
23:49:50ericgallager quits [Quit: This computer has gone to sleep]