00:10:34etnguyen03 (etnguyen03) joins
00:11:23etnguyen03 quits [Remote host closed the connection]
00:12:25etnguyen03 (etnguyen03) joins
00:55:28etnguyen03 quits [Client Quit]
01:20:41vitzli (vitzli) joins
01:26:51<nicolas17>there's now 48 builds of the Hytale game (including release and beta) and they're like 1.5GiB each so I guess I will *not* be feeding all to archivebot...
01:26:52vitzli quits [Client Quit]
01:26:57etnguyen03 (etnguyen03) joins
01:29:50<pokechu22>That's probably fine still, though it sounds like they don't deduplicate assets between versions (unlike Minecraft where they only duplicate assets for each major version... but that also works because translations can be updated independently of major/minor/snapshot releases)
01:30:40<nicolas17>pokechu22: they have deltas
01:31:25<pokechu22>ah, but also have non-delta versions of the same and those would be big? I guess maybe you could just save the deltas for beta versions?
01:32:16<nicolas17>afaik if you install the game from scratch, it downloads windows/amd64/release/0/4.pwr which is 1.46GiB
01:33:06<pokechu22>(and that also reminds me that I still need to automate sending new Minecraft versions to archivebot - I have automatic detection of new ones set up for an old and now-broken automatic analysis tool, which even feeds stuff to IRC, but I haven't hooked that up to archivebot)
01:33:11<nicolas17>if you already have the game at internal version 3, it downloads windows/amd64/release/3/4.pwr ("patch from 3 to 4") which is 67MiB
01:34:12<nicolas17>2/4.pwr doesn't exist, so maybe it applies 2/3.pwr and 3/4.pwr in that case
01:34:33<nicolas17>or maybe it goes "screw you" and downloads the whole 1.5GiB again
01:38:15<nicolas17>for local data-hoarding purposes, I wasted 2 days figuring out how to decompress a .pwr and *re-compress it back to the original*, so I can do my own delta'ing of the large files
01:38:59<nicolas17>but that's useless for WBM purposes :P
01:41:40lucifer_sam joins
02:04:07Guest58 quits [Read error: Connection reset by peer]
02:04:33Guest58 joins
02:49:31lucifer_sam quits [Ping timeout: 272 seconds]
02:53:17lucifer_sam joins
03:30:34Wohlstand quits [Quit: Wohlstand]
03:34:02tzt (tzt) joins
03:52:45datechnoman quits [Read error: Connection reset by peer]
03:53:46datechnoman (datechnoman) joins
03:59:08lennier2 joins
04:01:50lennier2_ quits [Ping timeout: 256 seconds]
04:28:46DogsRNice quits [Read error: Connection reset by peer]
04:40:38Wohlstand1 (Wohlstand) joins
04:43:01Wohlstand1 is now known as Wohlstand
04:53:05Wohlstand quits [Client Quit]
04:56:54Wohlstand1 (Wohlstand) joins
04:59:18Wohlstand1 is now known as Wohlstand
05:04:44n9nes quits [Ping timeout: 256 seconds]
05:04:47n9nes joins
05:10:18Wohlstand quits [Client Quit]
05:21:06etnguyen03 quits [Remote host closed the connection]
05:47:07<h2ibot>TriangleDemon edited Main Page/Current Projects (+0): https://wiki.archiveteam.org/?diff=60322&oldid=60302
06:01:01wotd joins
06:09:10<h2ibot>TriangleDemon edited Maxmodels.pl (+51): https://wiki.archiveteam.org/?diff=60324&oldid=60313
06:20:41APOLLO03- quits [Read error: Connection reset by peer]
06:21:57APOLLO03 joins
06:23:52nexussfan quits [Quit: Konversation terminated!]
07:36:16Hackerpcs quits [Quit: Hackerpcs]
07:46:55Island quits [Read error: Connection reset by peer]
08:29:11Hackerpcs (Hackerpcs) joins
08:52:32midou quits [Ping timeout: 256 seconds]
09:01:12tertu (tertu) joins
09:04:27tertu2 quits [Ping timeout: 272 seconds]
09:45:59Dada joins
09:53:13midou joins
10:05:04Dada quits [Remote host closed the connection]
10:05:16Dada joins
10:16:37Guest58 quits [Quit: My Mac has gone to sleep. ZZZzzz…]
10:17:06Guest58 joins
10:21:41Guest58 quits [Client Quit]
10:22:31Guest58 joins
10:28:41midou quits [Ping timeout: 272 seconds]
10:58:45beastbg8_ quits [Read error: Connection reset by peer]
11:03:19Woodie quits []
11:17:25jonte6 (jonte4) joins
11:19:59jonte quits [Ping timeout: 272 seconds]
11:19:59jonte6 is now known as jonte
11:39:06<cruller>nicolas17 pokechu22:Out of curiosity, I tried running `hdiffz -s-64 -d game-patches.hytale.com-patches-windows-amd64-release-0-3.pwr.warc game-patches.hytale.com-patches-windows-amd64-release-0-4.pwr.warc output.patch`
11:39:23<cruller>The file sizes are as follows: 3.pwr.warc = 1,578,281,510; 4.pwr.warc = 1,578,171,694; hdiff-patch = 860,744,931; bsdiff-pacth = 850,700,130; vcdiff-patch = 860,790,261
11:39:25jonte9 (jonte4) joins
11:39:42jonte quits [Ping timeout: 256 seconds]
11:39:42jonte9 is now known as jonte
11:41:29<cruller>-m option should yield better results, but I don't have enough memory.
11:44:03Dada quits [Remote host closed the connection]
11:48:45beastbg8 (beastbg8) joins
11:50:56<cruller>Courgette might be better too, but I hear it's difficult to install. However, there are https://github.com/hiromi-mi/standalone-courgette and https://github.com/rgov/courgette-build
11:51:45<h|ca2>cruller: out of curiosity, RE: memory: (a) would zram maybe help at all? and (b) how much do you have?
11:58:27<cruller>h|ca2: (a) I have no idea... (b) Since it was just a test, I used a machine with a measly 8GB of RAM. My main machine has 16GB, which isn't exactly high-end, but it might just be enough?
11:59:37<h|ca2>cruller: I'd suggest trying to set up 16gb of zram as a test on the 8G machine in case that ends up being enough (in my experience, you can generally get away with that much, although ofc it varies a lot based on what's actually happening)
12:00:05Bleo182600722719623455222 quits [Quit: The Lounge - https://thelounge.chat]
12:01:56<cruller>Thanks. Btw according to https://github.com/sisong/HDiffPatch , it requres {9+O(1)} GB. (In theory)
12:02:53Bleo182600722719623455222 joins
12:23:25gosc joins
12:24:17<gosc>I've got 160mb of urls from mobile games and I've been hanging on to them for about 10 days now, I'm guessing just upload the zip to #archivebot?
12:24:31<gosc>it's not a single 100mb file so it shouldn't be an issue I think
13:07:07<h2ibot>Manu edited Discourse/archived (+100, Queued chapel.discourse.group): https://wiki.archiveteam.org/?diff=60325&oldid=60317
13:07:39pseudorizer quits [Ping timeout: 272 seconds]
13:34:33etnguyen03 (etnguyen03) joins
13:49:07<cruller><cruller> "The file sizes are as follows: 3..." <- with -m option: hdiff = 850162804; bsdiff = 843431466; vcdiff = 854538976
13:52:39<cruller>diff time: hdiff = 757; bsdiff = 815; vcdiff = 714
14:05:58KerwoodDerby quits [Quit: WeeChat 4.1.1]
14:14:29etnguyen03 quits [Client Quit]
14:37:41etnguyen03 (etnguyen03) joins
14:58:05Dada joins
15:00:26<h2ibot>Hans5958 edited Main Page/Current Projects (+21, Add none currently): https://wiki.archiveteam.org/?diff=60326&oldid=60322
15:00:49nexussfan (nexussfan) joins
15:04:11mls quits [Ping timeout: 272 seconds]
15:05:26mls (mls) joins
15:06:38etnguyen03 quits [Client Quit]
15:39:58ducky quits [Ping timeout: 256 seconds]