| 00:10:34 | | etnguyen03 (etnguyen03) joins |
| 00:11:23 | | etnguyen03 quits [Remote host closed the connection] |
| 00:12:25 | | etnguyen03 (etnguyen03) joins |
| 00:55:28 | | etnguyen03 quits [Client Quit] |
| 01:20:41 | | vitzli (vitzli) joins |
| 01:26:51 | <nicolas17> | there's now 48 builds of the Hytale game (including release and beta) and they're like 1.5GiB each so I guess I will *not* be feeding all to archivebot... |
| 01:26:52 | | vitzli quits [Client Quit] |
| 01:26:57 | | etnguyen03 (etnguyen03) joins |
| 01:29:50 | <pokechu22> | That's probably fine still, though it sounds like they don't deduplicate assets between versions (unlike Minecraft where they only duplicate assets for each major version... but that also works because translations can be updated independently of major/minor/snapshot releases) |
| 01:30:40 | <nicolas17> | pokechu22: they have deltas |
| 01:31:25 | <pokechu22> | ah, but also have non-delta versions of the same and those would be big? I guess maybe you could just save the deltas for beta versions? |
| 01:32:16 | <nicolas17> | afaik if you install the game from scratch, it downloads windows/amd64/release/0/4.pwr which is 1.46GiB |
| 01:33:06 | <pokechu22> | (and that also reminds me that I still need to automate sending new Minecraft versions to archivebot - I have automatic detection of new ones set up for an old and now-broken automatic analysis tool, which even feeds stuff to IRC, but I haven't hooked that up to archivebot) |
| 01:33:11 | <nicolas17> | if you already have the game at internal version 3, it downloads windows/amd64/release/3/4.pwr ("patch from 3 to 4") which is 67MiB |
| 01:34:12 | <nicolas17> | 2/4.pwr doesn't exist, so maybe it applies 2/3.pwr and 3/4.pwr in that case |
| 01:34:33 | <nicolas17> | or maybe it goes "screw you" and downloads the whole 1.5GiB again |
| 01:38:15 | <nicolas17> | for local data-hoarding purposes, I wasted 2 days figuring out how to decompress a .pwr and *re-compress it back to the original*, so I can do my own delta'ing of the large files |
| 01:38:59 | <nicolas17> | but that's useless for WBM purposes :P |
| 01:41:40 | | lucifer_sam joins |
| 02:04:07 | | Guest58 quits [Read error: Connection reset by peer] |
| 02:04:33 | | Guest58 joins |
| 02:49:31 | | lucifer_sam quits [Ping timeout: 272 seconds] |
| 02:53:17 | | lucifer_sam joins |
| 03:30:34 | | Wohlstand quits [Quit: Wohlstand] |
| 03:34:02 | | tzt (tzt) joins |
| 03:52:45 | | datechnoman quits [Read error: Connection reset by peer] |
| 03:53:46 | | datechnoman (datechnoman) joins |
| 03:59:08 | | lennier2 joins |
| 04:01:50 | | lennier2_ quits [Ping timeout: 256 seconds] |
| 04:28:46 | | DogsRNice quits [Read error: Connection reset by peer] |
| 04:40:38 | | Wohlstand1 (Wohlstand) joins |
| 04:43:01 | | Wohlstand1 is now known as Wohlstand |
| 04:53:05 | | Wohlstand quits [Client Quit] |
| 04:56:54 | | Wohlstand1 (Wohlstand) joins |
| 04:59:18 | | Wohlstand1 is now known as Wohlstand |
| 05:04:44 | | n9nes quits [Ping timeout: 256 seconds] |
| 05:04:47 | | n9nes joins |
| 05:10:18 | | Wohlstand quits [Client Quit] |
| 05:21:06 | | etnguyen03 quits [Remote host closed the connection] |
| 05:47:07 | <h2ibot> | TriangleDemon edited Main Page/Current Projects (+0): https://wiki.archiveteam.org/?diff=60322&oldid=60302 |
| 06:01:01 | | wotd joins |
| 06:09:10 | <h2ibot> | TriangleDemon edited Maxmodels.pl (+51): https://wiki.archiveteam.org/?diff=60324&oldid=60313 |
| 06:20:41 | | APOLLO03- quits [Read error: Connection reset by peer] |
| 06:21:57 | | APOLLO03 joins |
| 06:23:52 | | nexussfan quits [Quit: Konversation terminated!] |
| 07:36:16 | | Hackerpcs quits [Quit: Hackerpcs] |
| 07:46:55 | | Island quits [Read error: Connection reset by peer] |
| 08:29:11 | | Hackerpcs (Hackerpcs) joins |
| 08:52:32 | | midou quits [Ping timeout: 256 seconds] |
| 09:01:12 | | tertu (tertu) joins |
| 09:04:27 | | tertu2 quits [Ping timeout: 272 seconds] |
| 09:45:59 | | Dada joins |
| 09:53:13 | | midou joins |
| 10:05:04 | | Dada quits [Remote host closed the connection] |
| 10:05:16 | | Dada joins |
| 10:16:37 | | Guest58 quits [Quit: My Mac has gone to sleep. ZZZzzz…] |
| 10:17:06 | | Guest58 joins |
| 10:21:41 | | Guest58 quits [Client Quit] |
| 10:22:31 | | Guest58 joins |
| 10:28:41 | | midou quits [Ping timeout: 272 seconds] |
| 10:58:45 | | beastbg8_ quits [Read error: Connection reset by peer] |
| 11:03:19 | | Woodie quits [] |
| 11:17:25 | | jonte6 (jonte4) joins |
| 11:19:59 | | jonte quits [Ping timeout: 272 seconds] |
| 11:19:59 | | jonte6 is now known as jonte |
| 11:39:06 | <cruller> | nicolas17 pokechu22:Out of curiosity, I tried running `hdiffz -s-64 -d game-patches.hytale.com-patches-windows-amd64-release-0-3.pwr.warc game-patches.hytale.com-patches-windows-amd64-release-0-4.pwr.warc output.patch` |
| 11:39:23 | <cruller> | The file sizes are as follows: 3.pwr.warc = 1,578,281,510; 4.pwr.warc = 1,578,171,694; hdiff-patch = 860,744,931; bsdiff-pacth = 850,700,130; vcdiff-patch = 860,790,261 |
| 11:39:25 | | jonte9 (jonte4) joins |
| 11:39:42 | | jonte quits [Ping timeout: 256 seconds] |
| 11:39:42 | | jonte9 is now known as jonte |
| 11:41:29 | <cruller> | -m option should yield better results, but I don't have enough memory. |
| 11:44:03 | | Dada quits [Remote host closed the connection] |
| 11:48:45 | | beastbg8 (beastbg8) joins |
| 11:50:56 | <cruller> | Courgette might be better too, but I hear it's difficult to install. However, there are https://github.com/hiromi-mi/standalone-courgette and https://github.com/rgov/courgette-build |
| 11:51:45 | <h|ca2> | cruller: out of curiosity, RE: memory: (a) would zram maybe help at all? and (b) how much do you have? |
| 11:58:27 | <cruller> | h|ca2: (a) I have no idea... (b) Since it was just a test, I used a machine with a measly 8GB of RAM. My main machine has 16GB, which isn't exactly high-end, but it might just be enough? |
| 11:59:37 | <h|ca2> | cruller: I'd suggest trying to set up 16gb of zram as a test on the 8G machine in case that ends up being enough (in my experience, you can generally get away with that much, although ofc it varies a lot based on what's actually happening) |
| 12:00:05 | | Bleo182600722719623455222 quits [Quit: The Lounge - https://thelounge.chat] |
| 12:01:56 | <cruller> | Thanks. Btw according to https://github.com/sisong/HDiffPatch , it requres {9+O(1)} GB. (In theory) |
| 12:02:53 | | Bleo182600722719623455222 joins |
| 12:23:25 | | gosc joins |
| 12:24:17 | <gosc> | I've got 160mb of urls from mobile games and I've been hanging on to them for about 10 days now, I'm guessing just upload the zip to #archivebot? |
| 12:24:31 | <gosc> | it's not a single 100mb file so it shouldn't be an issue I think |
| 13:07:07 | <h2ibot> | Manu edited Discourse/archived (+100, Queued chapel.discourse.group): https://wiki.archiveteam.org/?diff=60325&oldid=60317 |
| 13:07:39 | | pseudorizer quits [Ping timeout: 272 seconds] |
| 13:34:33 | | etnguyen03 (etnguyen03) joins |
| 13:49:07 | <cruller> | <cruller> "The file sizes are as follows: 3..." <- with -m option: hdiff = 850162804; bsdiff = 843431466; vcdiff = 854538976 |
| 13:52:39 | <cruller> | diff time: hdiff = 757; bsdiff = 815; vcdiff = 714 |
| 14:05:58 | | KerwoodDerby quits [Quit: WeeChat 4.1.1] |
| 14:14:29 | | etnguyen03 quits [Client Quit] |
| 14:37:41 | | etnguyen03 (etnguyen03) joins |
| 14:58:05 | | Dada joins |
| 15:00:26 | <h2ibot> | Hans5958 edited Main Page/Current Projects (+21, Add none currently): https://wiki.archiveteam.org/?diff=60326&oldid=60322 |
| 15:00:49 | | nexussfan (nexussfan) joins |
| 15:04:11 | | mls quits [Ping timeout: 272 seconds] |
| 15:05:26 | | mls (mls) joins |
| 15:06:38 | | etnguyen03 quits [Client Quit] |
| 15:39:58 | | ducky quits [Ping timeout: 256 seconds] |