00:20:03 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
00:31:38 | <@JAA> | nicolas17: I suspect that the fileformats wiki might not have existed when they were first created. |
00:32:24 | <@JAA> | But storage media are kind of not a good fit on either. |
00:32:36 | <@JAA> | Compression formats definitely belong on fileformats, yeah. |
00:32:54 | | etnguyen03 quits [Client Quit] |
00:49:40 | | Wohlstand (Wohlstand) joins |
00:50:17 | <h2ibot> | JustAnotherArchivist edited Storage Media (+320, /* Blu-Ray (BD) */ Add M-Disc BD clarification): https://wiki.archiveteam.org/?diff=52462&oldid=52458 |
00:51:08 | <fireonlive> | :) |
01:03:44 | | etnguyen03 (etnguyen03) joins |
01:23:46 | | jacksonchen666 quits [Ping timeout: 264 seconds] |
01:29:40 | | jacksonchen666 (jacksonchen666) joins |
01:29:40 | | jacksonchen666 quits [Client Quit] |
01:41:32 | | abirkill quits [Quit: Let us prepare to grapple with the ineffable itself, and see if we may not eff it after all.] |
01:51:47 | | etnguyen03 quits [Client Quit] |
02:03:22 | | abirkill (abirkill) joins |
02:09:37 | | etnguyen03 (etnguyen03) joins |
02:25:39 | | etnguyen03 quits [Client Quit] |
02:40:26 | | montigazou joins |
02:53:40 | | Guest45 joins |
02:55:53 | | montigazou quits [Client Quit] |
03:17:09 | | Guest45 is now known as muchadotodo |
03:29:01 | | Harg quits [Ping timeout: 255 seconds] |
03:33:07 | <pabs> | has the PTT BBS (Taiwanese BBS) ever been saved? not in danger but around since 1995 https://en.wikipedia.org/wiki/PTT_Bulletin_Board_System https://www.ptt.cc/index.bbs.html |
03:33:23 | <pabs> | looks mostly telnet/ssh based, but there is a web thing too https://www.ptt.cc/bbs/index.html |
03:54:25 | | muchadotodo quits [Client Quit] |
04:19:08 | <fireonlive> | hmm, ERROR: Postprocessing: file:ztRldMbFoa0.f140.mkv: Invalid data found when processing input |
04:19:11 | <fireonlive> | stream finished |
04:25:23 | <fireonlive> | cc katia, though there's a VOD |
04:27:57 | <fireonlive> | anyone able to get a url list for AB for the few unity games at http://13.212.246.85/? not sure about unity myself |
04:37:17 | | fireonlive is now known as notfireonlive |
04:37:23 | | notfireonlive is now known as fireonlive |
04:38:45 | | nicolas17 quits [Ping timeout: 272 seconds] |
04:43:59 | | nicolas17 joins |
04:52:29 | | Wohlstand quits [Client Quit] |
04:55:05 | | pixel leaves [Error from remote client] |
04:55:06 | | pixel (pixel) joins |
05:00:44 | | Island_ quits [Read error: Connection reset by peer] |
05:13:02 | | nicolas17 quits [Remote host closed the connection] |
05:13:29 | | nicolas17 joins |
05:14:51 | | Juest quits [Ping timeout: 272 seconds] |
05:17:11 | | Juest (Juest) joins |
05:22:12 | | nertzy joins |
05:22:27 | | nicolas17 quits [Ping timeout: 272 seconds] |
05:23:14 | | nicolas17 joins |
05:34:57 | | Guest54 quits [Client Quit] |
05:37:27 | | Juesto (Juest) joins |
05:39:33 | | Juest quits [Ping timeout: 272 seconds] |
05:39:34 | | Juesto is now known as Juest |
05:53:55 | | nicolas17 quits [Ping timeout: 255 seconds] |
05:54:11 | <h2ibot> | PaulWise edited SmolNet (+26, another url): https://wiki.archiveteam.org/?diff=52463&oldid=52366 |
05:56:26 | | loug4 joins |
05:57:37 | | nicolas17 joins |
06:02:28 | | nicolas17 quits [Ping timeout: 255 seconds] |
06:04:18 | | nicolas17 joins |
06:06:09 | | Juest quits [Ping timeout: 272 seconds] |
06:11:13 | | nicolas17 quits [Ping timeout: 272 seconds] |
06:27:14 | <that_lurker> | fireonlive: I use https://github.com/xenova/chat-downloader for live chats |
06:29:05 | | HP_Archivist quits [Read error: Connection reset by peer] |
06:29:36 | <fireonlive> | ah tks :) |
07:09:29 | | Unholy23619246453771 quits [Ping timeout: 272 seconds] |
07:11:30 | | BlueMaxima quits [Read error: Connection reset by peer] |
07:18:42 | | Ruthalas598 (Ruthalas) joins |
07:21:31 | | Ruthalas59 quits [Ping timeout: 272 seconds] |
07:21:31 | | Ruthalas598 is now known as Ruthalas59 |
07:24:10 | | Arcorann (Arcorann) joins |
07:24:31 | | nulldata5 (nulldata) joins |
07:25:57 | | nulldata quits [Ping timeout: 272 seconds] |
07:26:07 | | nulldata5 is now known as nulldata |
07:43:17 | | medecau (medecau) joins |
07:56:29 | | MrMcNuggets (MrMcNuggets) joins |
08:01:39 | | monoxane2 (monoxane) joins |
08:01:58 | | monoxane2 quits [Remote host closed the connection] |
08:02:37 | | monoxane quits [Ping timeout: 255 seconds] |
08:02:56 | | monoxane2 (monoxane) joins |
08:04:53 | | Gadelhas56 joins |
08:07:03 | | knecht4 quits [Client Quit] |
08:09:16 | | knecht4 joins |
08:39:31 | | medecau quits [Ping timeout: 255 seconds] |
08:46:20 | | Wohlstand (Wohlstand) joins |
09:00:01 | | Bleo1826007227196 quits [Client Quit] |
09:01:18 | | Bleo1826007227196 joins |
09:08:00 | | Bleo1826007227196 quits [Client Quit] |
09:39:49 | | nertzy quits [Read error: Connection reset by peer] |
09:40:32 | | nertzy joins |
09:43:15 | | Doomaholic quits [Read error: Connection reset by peer] |
09:45:12 | | Doomaholic (Doomaholic) joins |
09:58:51 | | Stvkimension123 joins |
10:00:05 | <Stvkimension123> | Anyone online here? |
10:00:32 | <theblazehen|m> | Stvkimension123: Yep |
10:01:14 | <Stvkimension123> | i just want to ask that is there any plan to port Warrior to Android? |
10:02:19 | <theblazehen|m> | Not an official response, but I don't see that happening / happening anytime soon. No docker support on android, which is what the warrior is based on. Also wget-at isn't verified to work correctly on arm, so it would need to run under x86 emulation |
10:04:51 | <Vokun> | It'd be an infathomable amount of work I can't imagine anyone agreeing to, but it'd potentially double the possible ip range of a decent percent of people running the warrior assuming they know it exists, which is also probably not unfortunately |
10:06:32 | <Stvkimension123> | most people using Android are not tech-savvy so probally won't be much =( |
10:06:40 | <Stvkimension123> | i'm planning to archive some xenforo forums, probally a simple ping & save app will work |
10:09:05 | <Vokun> | Any time I want to contribute with my phone I just use PDANet and sync it to my laptop with docker on it |
10:10:03 | <Vokun> | it's kinda janky, but it creates a wifi hotspot whether your provider has it or not. Makes use of my unlimited data |
10:20:54 | <h2ibot> | Exorcism edited MoinMoin (-37, /* Status */): https://wiki.archiveteam.org/?diff=52464&oldid=52417 |
10:24:33 | | Stvkimension123 quits [Ping timeout: 272 seconds] |
10:29:56 | <h2ibot> | Exorcism edited MoinMoin (+0): https://wiki.archiveteam.org/?diff=52465&oldid=52464 |
10:30:56 | <h2ibot> | Exorcism edited MoinMoin (-41, /* Not yet archived */ Error 500): https://wiki.archiveteam.org/?diff=52466&oldid=52465 |
11:10:09 | | Wohlstand quits [Ping timeout: 272 seconds] |
11:10:09 | | nulldata quits [Ping timeout: 272 seconds] |
11:16:07 | | nulldata (nulldata) joins |
11:37:03 | | tertu2 quits [Quit: so long...] |
11:40:32 | | tertu (tertu) joins |
12:07:16 | <pabs> | Exorcism: maybe put dead things in a separate section? IIRC the Mailman/2 page got a dead section |
12:07:42 | | IDK quits [Client Quit] |
12:13:17 | | Gadelhas56 quits [Client Quit] |
12:13:54 | <kokos> | Hi. My warrior container keeps shutting down. If I restart it, it grabs some tasks as seen in web ui and shuts down after 5s-5min. same when I restart the vm. is this normal? |
12:20:41 | <katia> | kokos, i don't use warrior myself but it doesn't sound normal, do you see anything in the logs or such? |
12:25:40 | <kokos> | the warrior-dockerfile based conatiner says Exited (0), and docker logs just have: seesaw.warrior - INFO - Project urls installed. I am guessing thats a startup message so it just shutdown soon after start. |
12:32:37 | <katia> | kokos, what container runtime do you use? asking to see if i can try and reproduce it |
12:33:26 | | nicolas17 joins |
12:35:02 | | Harg joins |
12:37:43 | <theblazehen|m> | @katia looks like they're using the VM |
12:38:01 | <katia> | theblazehen|m, ? |
12:38:57 | <kokos> | using the VM warrior version 4 which is running atdr.meo.ws/archiveteam/warrior-dockerfile container along with containrrr/watchtower (which shows healthy) |
12:39:19 | <theblazehen|m> | "same when I restart the vm." based on this from their message |
12:40:15 | <katia> | kokos, podman, docker? |
12:42:38 | <kokos> | just docker |
12:43:14 | <kokos> | whatever the python process inside just exitted with 0 |
12:44:34 | <theblazehen|m> | All projects or only the default project? |
12:47:32 | <kokos> | I think the url project was selected last but last startup it exited so quickly |
12:51:15 | | Gadelhas56 joins |
12:55:55 | | Gadelhas56 quits [Ping timeout: 272 seconds] |
12:56:18 | | Guest54 joins |
13:00:20 | <h2ibot> | JAABot edited CurrentWarriorProject (-4): https://wiki.archiveteam.org/?diff=52467&oldid=52388 |
13:02:14 | | Guest45 joins |
13:02:30 | <kokos> | started it again, switched to AT choice, which is Telegram now, died again |
13:02:50 | <kokos> | not worthy ;-( |
13:25:42 | | michaelblob quits [Read error: Connection reset by peer] |
13:26:57 | | michaelblob (michaelblob) joins |
13:38:59 | | Arcorann quits [Ping timeout: 272 seconds] |
13:40:23 | | katocala quits [Remote host closed the connection] |
13:47:11 | | Gadelhas56 joins |
14:21:20 | | bladem (bladem) joins |
14:37:38 | | katocala joins |
14:37:38 | | katocala is now authenticated as katocala |
14:46:42 | | Guest45 quits [Client Quit] |
14:56:16 | | Guest45 joins |
14:56:48 | | Guest45 quits [Client Quit] |
15:10:11 | | ^ quits [Ping timeout: 272 seconds] |
15:11:28 | | ^ (^) joins |
15:12:05 | | Harg quits [Ping timeout: 272 seconds] |
15:12:33 | | pixel leaves |
15:12:35 | | pixel (pixel) joins |
15:13:01 | | Wohlstand (Wohlstand) joins |
15:17:26 | | Stvkimension123 joins |
15:18:38 | <Stvkimension123> | Dear experienced archivist, is |
15:18:54 | <Stvkimension123> | dint expect \n to be send |
15:20:34 | <Stvkimension123> | Dear experienced archivist, is /about.htm /about.htm.meta.xml /index.htm /index.htm.meta.xml better or /about.htm /index.htm /DIRECTORY-META.xml better? |
15:21:30 | | @JAA isn't familiar with either. |
15:21:46 | <@JAA> | What do the metadata files contain, and why isn't it stored as WARC instead? |
15:22:42 | <h2ibot> | Nulldata edited LEGO Insiders Community (-4, Site is now dead.): https://wiki.archiveteam.org/?diff=52468&oldid=52406 |
15:23:15 | | DopefishJustin quits [Remote host closed the connection] |
15:24:27 | <kokos> | Now I am tihnking the VM is running at 445MB of RAM, very close to the recommended 512MB. Maybe it died because it ran out. Maybe the recommendation is tight (for 6 workers) |
15:24:45 | <Stvkimension123> | @JAA i'm programming an Android app (FOSS) and before i learn about WARC format i want to do something simpler, the metadata here are just date time and CRC32 |
15:27:45 | <@JAA> | Stvkimension123: Mhm. Well, WARC is the standard format for web archival, and anything else likely misses important information. I don't know how hard it'd be to write WARCs on Android, but in general, I wouldn't recommend trying to write code to produce WARCs in general. Despite conceptually being a very simple format, there are a lot of ways to get it wrong. |
15:28:33 | <@JAA> | But ignoring WARC, at a minimum, you also want the exact URL and the HTTP headers for both the request and the response. |
15:29:34 | <@JAA> | kokos: Where did you find that recommendation? |
15:30:00 | <@JAA> | Oh, on the v4 GitHub repo, I see. |
15:31:53 | | Stvkimension11 joins |
15:32:48 | <@JAA> | 512 MB seems like it should be plenty, but it would vary by project, and the URLs project loads a bunch of lists into memory, too. |
15:33:25 | | nertzy quits [Client Quit] |
15:33:37 | | Stvkimension123 quits [Ping timeout: 272 seconds] |
15:33:51 | <kokos> | https://github.com/ArchiveTeam/warrior4-vm README |
15:33:54 | <theblazehen|m> | For me, URLs project is at 600MB RAM, the rest are all below 250 MB RAM (6 workers) |
15:35:19 | <kokos> | Odd the container would exit with 0, but I'm gonna blame it on docker somehow |
15:35:53 | <Stvkimension11> | @JAA fortunately there's many people implemented WARC in Java before, i will try those. And ignoring WARC, yeah i originally i'd plan to add Cookie to the meta file but probally should be a big warning to user that it might leak their session id |
15:36:13 | | nicolas17 quits [Ping timeout: 255 seconds] |
15:36:15 | <@JAA> | Stvkimension11: Unfortunately, there are many bad WARC implementations out there. |
15:40:28 | <@JAA> | See also https://wiki.archiveteam.org/index.php/The_WARC_Ecosystem and in particular the 'Recommended' column. Most implementations haven't been audited; many are expected to be flawed. If you use something by the Internet Archive, it should probably be fine. |
15:42:48 | <Stvkimension11> | wow Internet Archive heritrix look good |
15:42:54 | | Thor joins |
15:43:16 | | Thor quits [Client Quit] |
15:48:13 | <Stvkimension11> | okay so a good archive format should save both request & response |
15:49:39 | | grid joins |
15:51:15 | <@JAA> | Yes, and ample metadata. I'd strongly recommend against trying to come up with your own format. |
15:55:56 | <Stvkimension11> | for now i'll just do something like https://example.org:80/abc.htm save to /<save directory>/https-__example.org-80/abc.htm |
15:56:50 | <Stvkimension11> | and compress it all to a 7z, tar.gz, tar.xz or tar.zstd |
16:00:48 | <h2ibot> | Exorcism edited Mailman/2 (+41, /* Not yet archived */): https://wiki.archiveteam.org/?diff=52469&oldid=52341 |
16:00:52 | <kokos> | > According to the guidelines, WARC files should top out at 1 gb. :D |
16:03:03 | | Stvkimension11 is now authenticated as Stvkimension11 |
16:08:27 | | Stvkimension11 quits [Ping timeout: 272 seconds] |
16:10:34 | | Stvkimension123 joins |
16:10:41 | | bobbyg joins |
16:11:11 | | bobbyg quits [Client Quit] |
16:11:59 | | Stvkimension123 quits [Client Quit] |
16:21:51 | | Megame (Megame) joins |
16:59:34 | | DopefishJustin (DopefishJustin) joins |
17:01:18 | | Commander001 joins |
17:03:18 | <Commander001> | Hello, My container is restarting every 4000 seconds for some reason. In VMbox it says "Container Stopped responding. Restating in 3312 seconds". But in web gui I can see everything running smoothly? |
17:08:04 | | matoro quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.] |
17:08:19 | | matoro joins |
17:15:04 | | Island joins |
17:26:29 | | nick9 joins |
17:27:17 | | nick9 quits [Client Quit] |
17:44:15 | | nicolas17 joins |
17:44:40 | | MrMcNuggets quits [Client Quit] |
17:49:47 | | Ruthalas59 quits [Ping timeout: 272 seconds] |
17:51:53 | | Ruthalas59 (Ruthalas) joins |
17:56:06 | | Bleo1826007227196 joins |
18:03:51 | | Wohlstand quits [Client Quit] |
18:09:30 | | grid quits [Client Quit] |
18:43:48 | | Commander001 quits [Client Quit] |
18:58:18 | | Commander001 joins |
18:58:36 | | Commander001 quits [Client Quit] |
19:03:15 | | DogsRNice joins |
19:09:07 | | JimmyDee joins |
19:10:05 | | JimmyDee quits [Client Quit] |
19:40:56 | | loug4 quits [Client Quit] |
19:41:11 | | loug4 joins |
19:44:41 | <that_lurker> | Living Computers Museum to permanently close, auction vintage items: https://www.geekwire.com/2024/seattles-living-computers-museum-logs-off-for-good-as-paul-allen-estate-will-auction-vintage-items/ https://news.ycombinator.com/item?id=40789179 |
19:48:58 | | sludge is now authenticated as sludge |
20:45:10 | | loug49 joins |
20:46:18 | | loug4 quits [Read error: Connection reset by peer] |
20:46:18 | | loug49 is now known as loug4 |
20:59:51 | <nicolas17> | D: |
21:00:49 | <fireonlive> | the estate wants that ching ching |
21:01:32 | <nicolas17> | even while closed to the public irl, they still kept the telnet/ssh system working |
21:01:40 | <nicolas17> | where you could connect to a real ancient computer |
21:07:26 | | Wohlstand (Wohlstand) joins |
21:08:49 | | etnguyen03 (etnguyen03) joins |
21:44:41 | | ^ quits [Remote host closed the connection] |
21:44:55 | | ^ (^) joins |
21:57:42 | <BornOn420> | Some big closures recently. https://latenighter.com/news/paramount-axes-comedy-central-website-show-clips-library/ |
22:01:18 | | Megame quits [Client Quit] |
22:02:19 | | JayEmbee quits [Ping timeout: 255 seconds] |
22:18:12 | | pixel leaves |
22:18:13 | | pixel (pixel) joins |
22:42:57 | | Dango360 quits [Read error: Connection reset by peer] |
22:42:57 | | BlueMaxima joins |
22:46:24 | | Wohlstand quits [Client Quit] |
22:49:36 | | Dango360 (Dango360) joins |
22:57:37 | | Dango360 quits [Read error: Connection reset by peer] |
23:00:39 | | GNU_world joins |
23:05:41 | | veselcraft joins |
23:09:28 | | etnguyen03 quits [Client Quit] |
23:11:24 | | JayEmbee (JayEmbee) joins |
23:12:05 | <nulldata> | xarph - agreed on the need to archive TWiT - though I recall someone recently said IA was blocking uploads of TWiT content due to copyright requests despite the license allowing it. |
23:13:30 | <nulldata> | Might need someone with contacts at IA to get clarification on that before we start doing anything |
23:34:17 | | etnguyen03 (etnguyen03) joins |
23:37:19 | | Wohlstand (Wohlstand) joins |
23:37:41 | | etnguyen03 quits [Remote host closed the connection] |
23:39:59 | | etnguyen03 (etnguyen03) joins |
23:42:09 | <h2ibot> | Switchnode created Picdig (+937, stub): https://wiki.archiveteam.org/?title=Picdig |
23:48:58 | | lizardexile quits [Read error: Connection reset by peer] |
23:49:07 | | mr_sarge quits [Read error: Connection reset by peer] |
23:49:10 | | lizardexile joins |
23:49:30 | | mr_sarge (sarge) joins |
23:55:11 | <h2ibot> | Switchnode edited Picdig (+124, add youtube channel): https://wiki.archiveteam.org/?diff=52471&oldid=52470 |
23:55:21 | | loug4 quits [Client Quit] |
23:56:11 | <h2ibot> | Switchnode edited Picdig (+23, clean up source/tracker links): https://wiki.archiveteam.org/?diff=52472&oldid=52471 |
23:58:04 | | loug4 joins |
23:58:25 | | loug4 quits [Client Quit] |
23:58:33 | <thuban> | do we normally include the -items repo in the infobox in some way? (i realize it's less relevant when we yolo a site with backfeed, but for this one there was an enumerative endpoint) |