00:13:11Arcorann (Arcorann) joins
00:15:45bonga quits [Ping timeout: 252 seconds]
00:28:26bonga joins
00:52:50DiscantX quits [Ping timeout: 265 seconds]
00:55:10BlueMaxima quits [Read error: Connection reset by peer]
01:03:17dm4v_ joins
01:04:26dm4v quits [Ping timeout: 265 seconds]
01:04:26dm4v_ is now known as dm4v
01:04:27dm4v quits [Changing host]
01:04:27dm4v (dm4v) joins
01:21:42wickedplayer494 quits [Ping timeout: 265 seconds]
01:22:02wickedplayer494 joins
01:26:37qwertyasdfuiopghjkl quits [Remote host closed the connection]
01:30:29qwertyasdfuiopghjkl joins
01:50:13Lord_Nightmare quits [Quit: ZNC - http://znc.in]
01:53:15lunik1 quits [Ping timeout: 265 seconds]
01:54:03Lord_Nightmare (Lord_Nightmare) joins
02:35:37tbc1887 (tbc1887) joins
02:43:49Ruthalas quits [Quit: END OF LINE]
02:44:10Ruthalas (Ruthalas) joins
02:50:39tzt (tzt) joins
02:53:07tbc1887 quits [Client Quit]
05:00:15@arkiver quits [Remote host closed the connection]
05:00:38arkiver (arkiver) joins
05:00:38@ChanServ sets mode: +o arkiver
05:51:29DiscantX joins
05:57:00Jake quits [Quit: Leaving for a bit!]
05:58:06Jake (Jake) joins
06:59:17sonick (sonick) joins
07:34:47tbc1887 (tbc1887) joins
08:03:13bonga quits [Remote host closed the connection]
08:04:49bonga joins
10:14:44@arkiver quits [Remote host closed the connection]
10:15:06arkiver (arkiver) joins
10:15:06@ChanServ sets mode: +o arkiver
10:22:43Terbium quits [Quit: http://quassel-irc.org - Chat comfortably. Anywhere.]
10:23:09Terbium joins
10:24:45spirit joins
10:31:19tbc1887 quits [Client Quit]
12:21:16HP_Archivist (HP_Archivist) joins
13:05:32monoxane4 (monoxane) joins
13:07:30Stiletto quits [Ping timeout: 265 seconds]
14:41:16DiscantX quits [Ping timeout: 265 seconds]
14:49:40qwertyasdfuiopghjkl quits [Remote host closed the connection]
14:50:48Arcorann quits [Ping timeout: 265 seconds]
14:58:36qwertyasdfuiopghjkl joins
15:20:32HP_Archivist quits [Client Quit]
17:06:15qwertyasdfuiopghjkl quits [Client Quit]
17:23:09jacobk quits [Ping timeout: 252 seconds]
19:19:01monoxane4 quits [Client Quit]
19:19:17monoxane4 (monoxane) joins
20:01:18qwertyasdfuiopghjkl joins
20:02:18<@JAA>/*stdin*\ : 0.08% (1572864000 => 1254110 bytes
20:02:20<@JAA>Neat :-)
20:17:02LeGoupil joins
20:22:14<TheTechRobo>JAA: Wow, that's... quite a ratio
20:23:06DiscantX joins
20:23:27DiscantX quits [Remote host closed the connection]
20:24:34DiscantX joins
20:24:57DiscantX quits [Remote host closed the connection]
20:26:04DiscantX joins
20:26:27DiscantX quits [Remote host closed the connection]
20:27:34DiscantX joins
20:27:57DiscantX quits [Remote host closed the connection]
20:28:19DiscantX joins
20:37:06spirit quits [Client Quit]
20:41:42LeGoupil quits [Client Quit]
20:53:27us3rrr quits [Read error: Connection reset by peer]
21:19:00lunik1 joins
21:22:19tbc1887 (tbc1887) joins
21:27:09lunik1 quits [Client Quit]
21:30:53lunik1 joins
21:35:37lunik1 quits [Client Quit]
21:37:46DiscantX quits [Ping timeout: 265 seconds]
21:38:24lunik1 joins
21:39:55DiscantX joins
21:54:49<@JAA>TheTechRobo: I had this one a while ago: 626524160 => 107307 bytes :-)
21:55:44<TheTechRobo>0.02%?!
21:55:51<TheTechRobo>zstd is magic
21:56:45<@JAA>Yeah, I'm convinced there's a deal with the devil involved.
22:06:58<@JAA>The 0.08% figure above was with -10. I recompressed it with --ultra -22: 0.03% (1572864000 => 498410 bytes
22:09:57driib083536 quits [Client Quit]
22:11:27driib0835367 (driib) joins
22:34:19<Terbium>zstd is a miracle. I've been working on adding zstd support for WARCIO to allow me to convert my GZIPed WARCs to Dictionary compressed ZSTDs
22:35:16<@JAA>If only warcio didn't suck...
22:35:49<Terbium>eh, it's been working fine for me, what issues did you encounter? performance?
22:36:07<@JAA>It mangles WARC contents: https://github.com/webrecorder/warcio/issues/created_by/JustAnotherArchivist
22:40:00<Terbium>yeah, it hasn't been updated in a while, more focus was put towards the browsertrix and other JS based tools
22:41:22<@JAA>My issue with it is that some of that mangling was introduced *intentionally* and the people behind it had to be convinced to even see it as a problem. So I'm staying away from warcio or anything using it as far as I can now.
22:42:09<@JAA>(And working on my own WARC implementation from scratch)
22:47:03hexa- quits [Quit: WeeChat 3.3]
22:48:34hexa- (hexa-) joins
22:49:51Mayk78 quits [Ping timeout: 252 seconds]
22:52:03BlueMaxima joins
22:52:29<Terbium>hmm, i was planning on doing the same thing, but i decided against it due to the amount of time required. I've been focusing instead on migrating wpull to support python 3.8-3.10 and modernizing the code and adding compat for latest version of tornado and sqlalchemy
23:00:54Mayk78 joins
23:07:05Arcorann (Arcorann) joins
23:29:27datechnoman quits [Ping timeout: 252 seconds]
23:37:55datechnoman (datechnoman) joins
23:41:40HP_Archivist (HP_Archivist) joins
23:46:57qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds]
23:48:09Mayk78 quits [Ping timeout: 252 seconds]
23:52:04Mayk78 joins