00:20:03qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
00:31:38<@JAA>nicolas17: I suspect that the fileformats wiki might not have existed when they were first created.
00:32:24<@JAA>But storage media are kind of not a good fit on either.
00:32:36<@JAA>Compression formats definitely belong on fileformats, yeah.
00:32:54etnguyen03 quits [Client Quit]
00:49:40Wohlstand (Wohlstand) joins
00:50:17<h2ibot>JustAnotherArchivist edited Storage Media (+320, /* Blu-Ray (BD) */ Add M-Disc BD clarification): https://wiki.archiveteam.org/?diff=52462&oldid=52458
00:51:08<fireonlive>:)
01:03:44etnguyen03 (etnguyen03) joins
01:23:46jacksonchen666 quits [Ping timeout: 264 seconds]
01:29:40jacksonchen666 (jacksonchen666) joins
01:29:40jacksonchen666 quits [Client Quit]
01:41:32abirkill quits [Quit: Let us prepare to grapple with the ineffable itself, and see if we may not eff it after all.]
01:51:47etnguyen03 quits [Client Quit]
02:03:22abirkill (abirkill) joins
02:09:37etnguyen03 (etnguyen03) joins
02:25:39etnguyen03 quits [Client Quit]
02:40:26montigazou joins
02:53:40Guest45 joins
02:55:53montigazou quits [Client Quit]
03:17:09Guest45 is now known as muchadotodo
03:29:01Harg quits [Ping timeout: 255 seconds]
03:33:07<pabs>has the PTT BBS (Taiwanese BBS) ever been saved? not in danger but around since 1995 https://en.wikipedia.org/wiki/PTT_Bulletin_Board_System https://www.ptt.cc/index.bbs.html
03:33:23<pabs>looks mostly telnet/ssh based, but there is a web thing too https://www.ptt.cc/bbs/index.html
03:54:25muchadotodo quits [Client Quit]
04:19:08<fireonlive>hmm, ERROR: Postprocessing: file:ztRldMbFoa0.f140.mkv: Invalid data found when processing input
04:19:11<fireonlive>stream finished
04:25:23<fireonlive>cc katia, though there's a VOD
04:27:57<fireonlive>anyone able to get a url list for AB for the few unity games at http://13.212.246.85/? not sure about unity myself
04:37:17fireonlive is now known as notfireonlive
04:37:23notfireonlive is now known as fireonlive
04:38:45nicolas17 quits [Ping timeout: 272 seconds]
04:43:59nicolas17 joins
04:52:29Wohlstand quits [Client Quit]
04:55:05pixel leaves [Error from remote client]
04:55:06pixel (pixel) joins
05:00:44Island_ quits [Read error: Connection reset by peer]
05:13:02nicolas17 quits [Remote host closed the connection]
05:13:29nicolas17 joins
05:14:51Juest quits [Ping timeout: 272 seconds]
05:17:11Juest (Juest) joins
05:22:12nertzy joins
05:22:27nicolas17 quits [Ping timeout: 272 seconds]
05:23:14nicolas17 joins
05:34:57Guest54 quits [Client Quit]
05:37:27Juesto (Juest) joins
05:39:33Juest quits [Ping timeout: 272 seconds]
05:39:34Juesto is now known as Juest
05:53:55nicolas17 quits [Ping timeout: 255 seconds]
05:54:11<h2ibot>PaulWise edited SmolNet (+26, another url): https://wiki.archiveteam.org/?diff=52463&oldid=52366
05:56:26loug4 joins
05:57:37nicolas17 joins
06:02:28nicolas17 quits [Ping timeout: 255 seconds]
06:04:18nicolas17 joins
06:06:09Juest quits [Ping timeout: 272 seconds]
06:11:13nicolas17 quits [Ping timeout: 272 seconds]
06:27:14<that_lurker>fireonlive: I use https://github.com/xenova/chat-downloader for live chats
06:29:05HP_Archivist quits [Read error: Connection reset by peer]
06:29:36<fireonlive>ah tks :)
07:09:29Unholy23619246453771 quits [Ping timeout: 272 seconds]
07:11:30BlueMaxima quits [Read error: Connection reset by peer]
07:18:42Ruthalas598 (Ruthalas) joins
07:21:31Ruthalas59 quits [Ping timeout: 272 seconds]
07:21:31Ruthalas598 is now known as Ruthalas59
07:24:10Arcorann (Arcorann) joins
07:24:31nulldata5 (nulldata) joins
07:25:57nulldata quits [Ping timeout: 272 seconds]
07:26:07nulldata5 is now known as nulldata
07:43:17medecau (medecau) joins
07:56:29MrMcNuggets (MrMcNuggets) joins
08:01:39monoxane2 (monoxane) joins
08:01:58monoxane2 quits [Remote host closed the connection]
08:02:37monoxane quits [Ping timeout: 255 seconds]
08:02:56monoxane2 (monoxane) joins
08:04:53Gadelhas56 joins
08:07:03knecht4 quits [Client Quit]
08:09:16knecht4 joins
08:39:31medecau quits [Ping timeout: 255 seconds]
08:46:20Wohlstand (Wohlstand) joins
09:00:01Bleo1826007227196 quits [Client Quit]
09:01:18Bleo1826007227196 joins
09:08:00Bleo1826007227196 quits [Client Quit]
09:39:49nertzy quits [Read error: Connection reset by peer]
09:40:32nertzy joins
09:43:15Doomaholic quits [Read error: Connection reset by peer]
09:45:12Doomaholic (Doomaholic) joins
09:58:51Stvkimension123 joins
10:00:05<Stvkimension123>Anyone online here?
10:00:32<theblazehen|m>Stvkimension123: Yep
10:01:14<Stvkimension123>i just want to ask that is there any plan to port Warrior to Android?
10:02:19<theblazehen|m>Not an official response, but I don't see that happening / happening anytime soon. No docker support on android, which is what the warrior is based on. Also wget-at isn't verified to work correctly on arm, so it would need to run under x86 emulation
10:04:51<Vokun>It'd be an infathomable amount of work I can't imagine anyone agreeing to, but it'd potentially double the possible ip range of a decent percent of people running the warrior assuming they know it exists, which is also probably not unfortunately
10:06:32<Stvkimension123>most people using Android are not tech-savvy so probally won't be much =(
10:06:40<Stvkimension123>i'm planning to archive some xenforo forums, probally a simple ping & save app will work
10:09:05<Vokun>Any time I want to contribute with my phone I just use PDANet and sync it to my laptop with docker on it
10:10:03<Vokun>it's kinda janky, but it creates a wifi hotspot whether your provider has it or not. Makes use of my unlimited data
10:20:54<h2ibot>Exorcism edited MoinMoin (-37, /* Status */): https://wiki.archiveteam.org/?diff=52464&oldid=52417
10:24:33Stvkimension123 quits [Ping timeout: 272 seconds]
10:29:56<h2ibot>Exorcism edited MoinMoin (+0): https://wiki.archiveteam.org/?diff=52465&oldid=52464
10:30:56<h2ibot>Exorcism edited MoinMoin (-41, /* Not yet archived */ Error 500): https://wiki.archiveteam.org/?diff=52466&oldid=52465
11:10:09Wohlstand quits [Ping timeout: 272 seconds]
11:10:09nulldata quits [Ping timeout: 272 seconds]
11:16:07nulldata (nulldata) joins
11:37:03tertu2 quits [Quit: so long...]
11:40:32tertu (tertu) joins
12:07:16<pabs>Exorcism: maybe put dead things in a separate section? IIRC the Mailman/2 page got a dead section
12:07:42IDK quits [Client Quit]
12:13:17Gadelhas56 quits [Client Quit]
12:13:54<kokos>Hi. My warrior container keeps shutting down. If I restart it, it grabs some tasks as seen in web ui and shuts down after 5s-5min. same when I restart the vm. is this normal?
12:20:41<katia>kokos, i don't use warrior myself but it doesn't sound normal, do you see anything in the logs or such?
12:25:40<kokos>the warrior-dockerfile based conatiner says Exited (0), and docker logs just have: seesaw.warrior - INFO - Project urls installed. I am guessing thats a startup message so it just shutdown soon after start.
12:32:37<katia>kokos, what container runtime do you use? asking to see if i can try and reproduce it
12:33:26nicolas17 joins
12:35:02Harg joins
12:37:43<theblazehen|m>@katia looks like they're using the VM
12:38:01<katia>theblazehen|m, ?
12:38:57<kokos>using the VM warrior version 4 which is running atdr.meo.ws/archiveteam/warrior-dockerfile container along with containrrr/watchtower (which shows healthy)
12:39:19<theblazehen|m>"same when I restart the vm." based on this from their message
12:40:15<katia>kokos, podman, docker?
12:42:38<kokos>just docker
12:43:14<kokos>whatever the python process inside just exitted with 0
12:44:34<theblazehen|m>All projects or only the default project?
12:47:32<kokos>I think the url project was selected last but last startup it exited so quickly
12:51:15Gadelhas56 joins
12:55:55Gadelhas56 quits [Ping timeout: 272 seconds]
12:56:18Guest54 joins
13:00:20<h2ibot>JAABot edited CurrentWarriorProject (-4): https://wiki.archiveteam.org/?diff=52467&oldid=52388
13:02:14Guest45 joins
13:02:30<kokos>started it again, switched to AT choice, which is Telegram now, died again
13:02:50<kokos>not worthy ;-(
13:25:42michaelblob quits [Read error: Connection reset by peer]
13:26:57michaelblob (michaelblob) joins
13:38:59Arcorann quits [Ping timeout: 272 seconds]
13:40:23katocala quits [Remote host closed the connection]
13:47:11Gadelhas56 joins
14:21:20bladem (bladem) joins
14:37:38katocala joins
14:46:42Guest45 quits [Client Quit]
14:56:16Guest45 joins
14:56:48Guest45 quits [Client Quit]
15:10:11^ quits [Ping timeout: 272 seconds]
15:11:28^ (^) joins
15:12:05Harg quits [Ping timeout: 272 seconds]
15:12:33pixel leaves
15:12:35pixel (pixel) joins
15:13:01Wohlstand (Wohlstand) joins
15:17:26Stvkimension123 joins
15:18:38<Stvkimension123>Dear experienced archivist, is
15:18:54<Stvkimension123>dint expect \n to be send
15:20:34<Stvkimension123>Dear experienced archivist, is /about.htm /about.htm.meta.xml /index.htm /index.htm.meta.xml better or /about.htm /index.htm /DIRECTORY-META.xml better?
15:21:30@JAA isn't familiar with either.
15:21:46<@JAA>What do the metadata files contain, and why isn't it stored as WARC instead?
15:22:42<h2ibot>Nulldata edited LEGO Insiders Community (-4, Site is now dead.): https://wiki.archiveteam.org/?diff=52468&oldid=52406
15:23:15DopefishJustin quits [Remote host closed the connection]
15:24:27<kokos>Now I am tihnking the VM is running at 445MB of RAM, very close to the recommended 512MB. Maybe it died because it ran out. Maybe the recommendation is tight (for 6 workers)
15:24:45<Stvkimension123>@JAA i'm programming an Android app (FOSS) and before i learn about WARC format i want to do something simpler, the metadata here are just date time and CRC32
15:27:45<@JAA>Stvkimension123: Mhm. Well, WARC is the standard format for web archival, and anything else likely misses important information. I don't know how hard it'd be to write WARCs on Android, but in general, I wouldn't recommend trying to write code to produce WARCs in general. Despite conceptually being a very simple format, there are a lot of ways to get it wrong.
15:28:33<@JAA>But ignoring WARC, at a minimum, you also want the exact URL and the HTTP headers for both the request and the response.
15:29:34<@JAA>kokos: Where did you find that recommendation?
15:30:00<@JAA>Oh, on the v4 GitHub repo, I see.
15:31:53Stvkimension11 joins
15:32:48<@JAA>512 MB seems like it should be plenty, but it would vary by project, and the URLs project loads a bunch of lists into memory, too.
15:33:25nertzy quits [Client Quit]
15:33:37Stvkimension123 quits [Ping timeout: 272 seconds]
15:33:51<kokos>https://github.com/ArchiveTeam/warrior4-vm README
15:33:54<theblazehen|m>For me, URLs project is at 600MB RAM, the rest are all below 250 MB RAM (6 workers)
15:35:19<kokos>Odd the container would exit with 0, but I'm gonna blame it on docker somehow
15:35:53<Stvkimension11>@JAA fortunately there's many people implemented WARC in Java before, i will try those. And ignoring WARC, yeah i originally i'd plan to add Cookie to the meta file but probally should be a big warning to user that it might leak their session id
15:36:13nicolas17 quits [Ping timeout: 255 seconds]
15:36:15<@JAA>Stvkimension11: Unfortunately, there are many bad WARC implementations out there.
15:40:28<@JAA>See also https://wiki.archiveteam.org/index.php/The_WARC_Ecosystem and in particular the 'Recommended' column. Most implementations haven't been audited; many are expected to be flawed. If you use something by the Internet Archive, it should probably be fine.
15:42:48<Stvkimension11>wow Internet Archive heritrix look good
15:42:54Thor joins
15:43:16Thor quits [Client Quit]
15:48:13<Stvkimension11> okay so a good archive format should save both request & response
15:49:39grid joins
15:51:15<@JAA>Yes, and ample metadata. I'd strongly recommend against trying to come up with your own format.
15:55:56<Stvkimension11>for now i'll just do something like https://example.org:80/abc.htm save to /<save directory>/https-__example.org-80/abc.htm
15:56:50<Stvkimension11>and compress it all to a 7z, tar.gz, tar.xz or tar.zstd
16:00:48<h2ibot>Exorcism edited Mailman/2 (+41, /* Not yet archived */): https://wiki.archiveteam.org/?diff=52469&oldid=52341
16:00:52<kokos>> According to the guidelines, WARC files should top out at 1 gb. :D
16:08:27Stvkimension11 quits [Ping timeout: 272 seconds]
16:10:34Stvkimension123 joins
16:10:41bobbyg joins
16:11:11bobbyg quits [Client Quit]
16:11:59Stvkimension123 quits [Client Quit]
16:21:51Megame (Megame) joins
16:59:34DopefishJustin (DopefishJustin) joins
17:01:18Commander001 joins
17:03:18<Commander001>Hello, My container is restarting every 4000 seconds for some reason. In VMbox it says "Container Stopped responding. Restating in 3312 seconds". But in web gui I can see everything running smoothly?
17:08:04matoro quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
17:08:19matoro joins
17:15:04Island joins
17:26:29nick9 joins
17:27:17nick9 quits [Client Quit]
17:44:15nicolas17 joins
17:44:40MrMcNuggets quits [Client Quit]
17:49:47Ruthalas59 quits [Ping timeout: 272 seconds]
17:51:53Ruthalas59 (Ruthalas) joins
17:56:06Bleo1826007227196 joins
18:03:51Wohlstand quits [Client Quit]
18:09:30grid quits [Client Quit]
18:43:48Commander001 quits [Client Quit]
18:58:18Commander001 joins
18:58:36Commander001 quits [Client Quit]
19:03:15DogsRNice joins
19:09:07JimmyDee joins
19:10:05JimmyDee quits [Client Quit]
19:40:56loug4 quits [Client Quit]
19:41:11loug4 joins
19:44:41<that_lurker>Living Computers Museum to permanently close, auction vintage items: https://www.geekwire.com/2024/seattles-living-computers-museum-logs-off-for-good-as-paul-allen-estate-will-auction-vintage-items/ https://news.ycombinator.com/item?id=40789179
20:45:10loug49 joins
20:46:18loug4 quits [Read error: Connection reset by peer]
20:46:18loug49 is now known as loug4
20:59:51<nicolas17>D:
21:00:49<fireonlive>the estate wants that ching ching
21:01:32<nicolas17>even while closed to the public irl, they still kept the telnet/ssh system working
21:01:40<nicolas17>where you could connect to a real ancient computer
21:07:26Wohlstand (Wohlstand) joins
21:08:49etnguyen03 (etnguyen03) joins
21:44:41^ quits [Remote host closed the connection]
21:44:55^ (^) joins
21:57:42<BornOn420>Some big closures recently. https://latenighter.com/news/paramount-axes-comedy-central-website-show-clips-library/
22:01:18Megame quits [Client Quit]
22:02:19JayEmbee quits [Ping timeout: 255 seconds]
22:18:12pixel leaves
22:18:13pixel (pixel) joins
22:42:57Dango360 quits [Read error: Connection reset by peer]
22:42:57BlueMaxima joins
22:46:24Wohlstand quits [Client Quit]
22:49:36Dango360 (Dango360) joins
22:57:37Dango360 quits [Read error: Connection reset by peer]
23:00:39GNU_world joins
23:05:41veselcraft joins
23:09:28etnguyen03 quits [Client Quit]
23:11:24JayEmbee (JayEmbee) joins
23:12:05<nulldata>xarph - agreed on the need to archive TWiT - though I recall someone recently said IA was blocking uploads of TWiT content due to copyright requests despite the license allowing it.
23:13:30<nulldata>Might need someone with contacts at IA to get clarification on that before we start doing anything
23:34:17etnguyen03 (etnguyen03) joins
23:37:19Wohlstand (Wohlstand) joins
23:37:41etnguyen03 quits [Remote host closed the connection]
23:39:59etnguyen03 (etnguyen03) joins
23:42:09<h2ibot>Switchnode created Picdig (+937, stub): https://wiki.archiveteam.org/?title=Picdig
23:48:58lizardexile quits [Read error: Connection reset by peer]
23:49:07mr_sarge quits [Read error: Connection reset by peer]
23:49:10lizardexile joins
23:49:30mr_sarge (sarge) joins
23:55:11<h2ibot>Switchnode edited Picdig (+124, add youtube channel): https://wiki.archiveteam.org/?diff=52471&oldid=52470
23:55:21loug4 quits [Client Quit]
23:56:11<h2ibot>Switchnode edited Picdig (+23, clean up source/tracker links): https://wiki.archiveteam.org/?diff=52472&oldid=52471
23:58:04loug4 joins
23:58:25loug4 quits [Client Quit]
23:58:33<thuban>do we normally include the -items repo in the infobox in some way? (i realize it's less relevant when we yolo a site with backfeed, but for this one there was an enumerative endpoint)