00:00:47pabs quits [Remote host closed the connection]
00:01:21pabs (pabs) joins
00:11:20HackMii_ quits [Remote host closed the connection]
00:11:39HackMii_ (hacktheplanet) joins
00:14:35sec^nd quits [Remote host closed the connection]
00:15:29sec^nd (second) joins
00:20:21sec^nd quits [Remote host closed the connection]
00:21:02sec^nd (second) joins
00:24:47Wingy1139793760180 quits [Remote host closed the connection]
00:25:37Wingy1139793760180 (Wingy) joins
00:29:25march_happy quits [Read error: Connection reset by peer]
00:29:56march_happy (march_happy) joins
00:36:59fangfufu quits [Remote host closed the connection]
00:37:05fangfufu joins
00:37:20Wingy1139793760180 quits [Remote host closed the connection]
00:38:13Wingy1139793760180 (Wingy) joins
00:39:34march_happy quits [Read error: Connection reset by peer]
00:40:20march_happy (march_happy) joins
00:44:58sec^nd quits [Remote host closed the connection]
00:45:17sec^nd (second) joins
01:01:19march_happy quits [Read error: Connection reset by peer]
01:02:06march_happy (march_happy) joins
01:02:46Discant quits [Ping timeout: 265 seconds]
01:12:17sec^nd quits [Remote host closed the connection]
01:12:17HackMii_ quits [Write error: Broken pipe]
01:13:31HackMii_ (hacktheplanet) joins
01:14:10sec^nd (second) joins
02:02:13Wingy1139793760180 quits [Remote host closed the connection]
02:02:13march_happy quits [Ping timeout: 265 seconds]
02:02:26march_happy (march_happy) joins
02:03:10Wingy1139793760180 (Wingy) joins
02:07:03march_happy quits [Ping timeout: 265 seconds]
02:08:02march_happy (march_happy) joins
02:08:15sec^nd quits [Remote host closed the connection]
02:08:15HackMii_ quits [Write error: Connection reset by peer]
02:08:41tzt (tzt) joins
02:09:00sec^nd (second) joins
02:09:08mind_combatant joins
02:09:51HackMii_ (hacktheplanet) joins
02:35:04Wingy1139793760180 quits [Remote host closed the connection]
02:35:54Wingy1139793760180 (Wingy) joins
02:50:55sec^nd quits [Remote host closed the connection]
02:51:25sec^nd (second) joins
03:03:27katocala joins
03:22:11Wingy1139793760180 quits [Remote host closed the connection]
03:23:01Wingy1139793760180 (Wingy) joins
03:48:54sec^nd quits [Remote host closed the connection]
03:49:12sec^nd (second) joins
03:57:16HackMii_ quits [Ping timeout: 240 seconds]
03:57:54celestial_ quits [Quit: ZNC 1.8.0 - https://znc.in]
03:59:39HackMii_ (hacktheplanet) joins
04:03:16thuban quits [Ping timeout: 240 seconds]
04:05:05thuban joins
04:05:57programmerq quits [Ping timeout: 265 seconds]
04:11:45thuban quits [Ping timeout: 265 seconds]
04:25:20thuban joins
04:36:53celestial joins
04:50:15programmerq (programmerq) joins
04:52:44kwahoon quits [Remote host closed the connection]
04:56:16leo60228 quits [Ping timeout: 240 seconds]
05:23:30BlueMaxima quits [Client Quit]
05:33:28leo60228 (leo60228) joins
06:13:46spirit joins
06:17:38s17 joins
06:18:32s17 quits [Remote host closed the connection]
06:19:38igloo22225 quits [Quit: Ping timeout (120 seconds)]
06:19:47igloo22225 (igloo22225) joins
06:20:12igloo22225 quits [Excess Flood]
06:20:25igloo22225 (igloo22225) joins
06:58:31mutantmonkey quits [Remote host closed the connection]
06:58:31HackMii_ quits [Write error: Broken pipe]
06:58:52mutantmonkey (mutantmonkey) joins
06:59:08HackMii_ (hacktheplanet) joins
07:20:50sec^nd quits [Remote host closed the connection]
07:21:38Wingy1139793760180 quits [Read error: Connection reset by peer]
07:21:51sec^nd (second) joins
07:22:36Wingy1139793760180 (Wingy) joins
07:46:39Discant joins
08:09:57tech_exorcist (tech_exorcist) joins
08:13:22Wingy1139793760180 quits [Remote host closed the connection]
08:14:13sec^nd quits [Remote host closed the connection]
08:14:18Wingy1139793760180 (Wingy) joins
08:15:36sec^nd (second) joins
08:15:38Discant quits [Client Quit]
08:16:03tech_exorcist quits [Remote host closed the connection]
08:16:03sec^nd quits [Remote host closed the connection]
08:16:57sec^nd (second) joins
08:26:35Wingy1139793760180 quits [Remote host closed the connection]
08:27:25Wingy1139793760180 (Wingy) joins
08:28:46sec^nd quits [Ping timeout: 240 seconds]
08:29:13sec^nd (second) joins
09:17:27nick joins
09:18:40<nick>Heya! Is the source code for archive.today available somewhere? I would like to archive an internal website that is based on an ancient cms. I would like to take it offline, but I first want to archive it somewhere.
09:19:01<nick>archive.today seems like the perfect software to do this, but other suggestions are very welcome!
09:21:12sec^nd quits [Remote host closed the connection]
09:21:53sec^nd (second) joins
09:26:42<@arkiver>nick: archive team is completely not related to archive.today and similar
09:26:56<nick>ah. my bad
09:34:26<Maakuth|m>nick, would wget --mirror cut it?
09:55:02<nick>unfortunatley not. there's the issue of authentication first and foremost. i can get around that by saving cookies. but then there are all sorts of resources on the page that wget doesn't pick up for some reason
09:55:55<nick>and to get everything on the page, you need to do an ajax request, too :(
10:28:10Wingy1139793760180 quits [Remote host closed the connection]
10:29:01Wingy1139793760180 (Wingy) joins
10:46:38HackMii_ quits [Remote host closed the connection]
10:47:26HackMii_ (hacktheplanet) joins
10:52:46HackMii (hacktheplanet) joins
10:53:42HackMii_ quits [Remote host closed the connection]
11:29:34nick quits [Remote host closed the connection]
11:32:59Wingy1139793760180 quits [Remote host closed the connection]
11:33:50Wingy1139793760180 (Wingy) joins
11:45:39Wingy1139793760180 quits [Remote host closed the connection]
11:46:29Wingy1139793760180 (Wingy) joins
13:17:53nepeat (nepeat) joins
13:43:03march_happy quits [Ping timeout: 265 seconds]
13:43:47march_happy (march_happy) joins
13:48:22march_happy quits [Ping timeout: 265 seconds]
13:49:10march_happy (march_happy) joins
14:16:27Wingy1139793760180 quits [Remote host closed the connection]
14:17:18Wingy1139793760180 (Wingy) joins
14:25:59<systwi_>Too bad nick left, I'd suggest grab-site if that would work.
14:26:25<systwi_>On a related note, I wonder if the archive.today owner has stopped by here before.
14:30:16Arcorann quits [Ping timeout: 240 seconds]
14:30:39<pabs>this person died: https://alblue.bandlem.com/ https://www.infoq.com/profile/Alex-Blewitt/ https://www.infoq.com/news/2022/07/alex-blewitt/
14:40:09mutantmonkey quits [Remote host closed the connection]
14:40:31mutantmonkey (mutantmonkey) joins
14:55:32<pabs>a dying company: https://boltmobility.com/ https://www.micromobility.com/ https://techcrunch.com/2022/07/31/bolt-mobility-has-vanished-leaving-e-bikes-unanswered-calls-behind-in-several-us-cities/
14:55:34Wingy1139793760180 quits [Remote host closed the connection]
14:56:25Wingy1139793760180 (Wingy) joins
15:06:26HP_Archivist (HP_Archivist) joins
15:41:58HP_Archivist quits [Client Quit]
15:42:25HP_Archivist (HP_Archivist) joins
16:02:15march_happy quits [Ping timeout: 265 seconds]
16:02:44Minkafighter quits [Client Quit]
16:03:12march_happy (march_happy) joins
16:03:48Wingy1139793760180 quits [Remote host closed the connection]
16:04:19Minkafighter joins
16:04:33Wingy1139793760180 (Wingy) joins
16:20:08thuban quits [Ping timeout: 265 seconds]
16:22:33fangfufu quits [Ping timeout: 265 seconds]
16:23:30thuban joins
16:26:14fangfufu joins
16:47:12@dxrt quits [Ping timeout: 265 seconds]
16:58:43dxrt joins
16:58:45dxrt quits [Changing host]
16:58:45dxrt (dxrt) joins
16:58:45@ChanServ sets mode: +o dxrt
17:01:27mutantmonkey quits [Remote host closed the connection]
17:02:11mutantmonkey (mutantmonkey) joins
17:03:09Ryz quits [Ping timeout: 265 seconds]
17:03:38@dxrt quits [Ping timeout: 265 seconds]
17:07:15dxrt joins
17:07:17dxrt quits [Changing host]
17:07:17dxrt (dxrt) joins
17:07:17@ChanServ sets mode: +o dxrt
17:08:36Ryz (Ryz) joins
17:10:53march_happy quits [Ping timeout: 265 seconds]
17:12:31<systwi>I'm trying to save this page recursively with grab-site:
17:12:33<systwi_>https://www.cyberciti.biz/faq/debian-linux-install-openssh-sshd-server/
17:12:51<systwi>and for some reason, it just _will not save_. I keep getting 403s every time I try.
17:13:19<systwi>I can load the page in Firefox just fine. Even copying the curl request and running that, I get a 403.
17:13:52<systwi>I tried refreshing the page a few times to have it save cookies, which I then use in both grab-site and curl to no avail!
17:14:04<systwi>I'm really confused as to why this is happening. :-S
17:14:21<systwi>I changed my user agent in Firefox to match that of grab-site, too, for extra measure.
17:16:25<systwi>The 403 is an annoying Cloudflare page.
17:16:27<Jake>server: cloudflare
17:16:40<Jake>It's probably TLS fingerprinting (or something similar.)
17:17:00<systwi>Is that something impossible to replicate over a curl request?
17:17:30<Jake>impossible, no
17:17:41<Jake>https://github.com/lwthiker/curl-impersonate
17:17:49<systwi>Thank you, will take a look...
17:18:02<Jake>something like this gets you a nearly identical fingerprint.
17:18:26<systwi>Huh, is that different from a canvas fingerprint?
17:18:39Wingy1139793760180 quits [Remote host closed the connection]
17:19:24<Jake>Canvas fingerprints and similar are all in javascript. Most crawlers, curl, wget, grab-site, etc, don't normally run much of any JS.
17:19:29Wingy1139793760180 (Wingy) joins
17:30:42@dxrt quits [Ping timeout: 265 seconds]
17:31:11Ryz quits [Ping timeout: 265 seconds]
17:34:06<systwi>How do you like that, it saves it just fine that way.
17:34:49<systwi>Thank you Jake! But it would still be nice to save this properly with grab-site instead of curl.
17:35:15<Jake>Of course.
17:35:48<Jake>I don't think TLS fingerprinting has been added to wget-at or grab-site yet. It's quite the endeavor to get correct.
17:36:06dxrt joins
17:36:09Ryz (Ryz) joins
17:36:09dxrt quits [Changing host]
17:36:09dxrt (dxrt) joins
17:36:09@ChanServ sets mode: +o dxrt
17:36:10<systwi>Ahh, gotcha. :-/
17:36:56<systwi>Well, at least I know of one more way of saving _something_ when webpages misbehave like that.
17:37:09<systwi>Aside from saving a screenshot, of course. :-)
17:42:42LeGoupil joins
17:48:21<systwi>I have somewhat of a stupid question, does it sound like there might be any conflicts with having libnss3/libnspr4 installed on the same machine (Debian 11) as grab-site?
17:48:45<systwi>I ask because I know grab-site has some specific package requirements and I'm curious if having that installed might cause issues.
17:55:57<Jake>well, no. It's a fundamental issue with what's being sent in the TLS ClientHello. Having conflicts there shouldn't matter.
18:23:28<systwi>Okay, sounds good then, thanks Jake for the reassurance.
18:39:46<patrickg>Hi fellow hoarders. I'm trying to collect GNU arch repos (uploaded to archive.org, of course). Any good way to scan for directory names on the wider internet or archives beyond "index of" "..." on search engines? I'm looking for directories named "=meta-info" because that's probably used for nothing else.
18:42:50<Jake>Do you have an example of an item on IA?
18:49:50<patrickg>https://archive.org/details/arch-repo--david_bamsoftware.com--archive
18:54:00<patrickg>These repos were published via http and ftp. GNU arch doesn't have its own network protocols. I bundled them in archives because it's tons of files - every commit is 2-5 files
18:55:16Wingy1139793760180 quits [Ping timeout: 240 seconds]
18:57:26Wingy1139793760180 (Wingy) joins
19:04:59LeGoupil1 joins
19:06:28LeGoupil quits [Ping timeout: 240 seconds]
19:06:28LeGoupil1 is now known as LeGoupil
19:07:18<Jake>Ahhhhh, sorry. I can't read today! :)
19:10:04Wingy1139793760180 quits [Ping timeout: 240 seconds]
19:19:13Wingy1139793760180 (Wingy) joins
20:06:28qwertyasdfuiopghjkl quits [Remote host closed the connection]
20:16:00dm4v quits [Ping timeout: 265 seconds]
20:17:25dm4v joins
20:20:16hackbug quits [Client Quit]
20:22:52pabs quits [Ping timeout: 240 seconds]
20:22:57hackbug (hackbug) joins
20:23:36qwertyasdfuiopghjkl joins
20:34:45<@JAA>Whew, GNU arch is a name I haven't heard in a long time...
20:50:12<systwi>Without looking it up, is GNU arch a not-very-widely-used VCS?
20:50:38systwi cheats anyway
20:50:43<systwi>Ahh, I was right, heh.
20:51:10<systwi>Or, well, close, if revision control system != version control system.
21:42:31jmtd quits [Ping timeout: 265 seconds]
21:44:46HackMii quits [Ping timeout: 240 seconds]
21:46:55HackMii (hacktheplanet) joins
21:47:13LeGoupil quits [Client Quit]
21:50:16march_happy (march_happy) joins
22:16:50Wingy1139793760180 quits [Read error: Connection reset by peer]
22:17:19Church quits [Ping timeout: 265 seconds]
22:17:40Wingy1139793760180 (Wingy) joins
22:18:56Church (Church) joins
23:06:42Jon joins
23:12:25geezabiscuit quits [Ping timeout: 265 seconds]
23:17:19HackMii quits [Remote host closed the connection]
23:23:08HackMii (hacktheplanet) joins
23:24:17geezabiscuit (geezabiscuit) joins
23:28:31Arcorann (Arcorann) joins
23:36:35Sluggs quits [Ping timeout: 265 seconds]
23:37:40Sluggs joins
23:50:43Wingy1139793760180 quits [Remote host closed the connection]
23:51:33Wingy1139793760180 (Wingy) joins