HomeSearchPrevious dayNext day

00:34:26etnguyen03 (etnguyen03) joins
00:41:52Umbire (Umbire) joins
01:01:24Chris50102 quits [Ping timeout: 268 seconds]
01:09:52<@JAA>c3manu: Correct, WARC/1.0 and WARC/1.1 can only store HTTP/1.1 (and maybe 1.0 depending on how strictly you interpret the spec). In theory, one could store packet captures (à la tcpdump) and TLS keys, which could then be converted into a future WARC version that does support other HTTP versions. But I wouldn't exactly call that reasonable.
01:14:21rohvani quits [Ping timeout: 268 seconds]
01:16:28Chris50102 (Chris5010) joins
01:19:58rohvani joins
01:41:38Island quits [Read error: Connection reset by peer]
01:50:50<ericgallager>https://www.pcgamer.com/games/action/conceived-in-a-secure-military-facility-this-jedi-knight-fansite-has-been-running-consistently-for-almost-30-years-it-looks-really-close-to-what-it-did-back-in-1998/
01:59:59daxxy quits [Ping timeout: 268 seconds]
02:13:09daxxy joins
02:33:03nexussfan quits [Quit: Konversation terminated!]
02:34:57nexussfan (nexussfan) joins
02:39:27etnguyen03 quits [Ping timeout: 268 seconds]
02:40:31etnguyen03 (etnguyen03) joins
02:44:04chrismrtn quits [Quit: leaving]
02:44:38windasd joins
02:45:10chrismrtn (chrismrtn) joins
02:49:26windasd quits [Client Quit]
02:52:00Island joins
03:01:13etnguyen03 quits [Remote host closed the connection]
03:05:41ihs joins
03:06:03ihs quits [Client Quit]
03:20:04Island quits [Read error: Connection reset by peer]
03:37:41steering quits [Changing host]
03:37:41steering (steering) joins
03:38:08steering quits [Changing host]
03:38:08steering (steering) joins
03:44:01nexussfan quits [Remote host closed the connection]
03:55:24rohvani quits [Ping timeout: 252 seconds]
04:02:54rohvani joins
04:25:26Tom1992 joins
04:45:35<pokechu22>ericgallager: Huh, when I first saw that I assumed it was https://www.youtube.com/watch?v=TCBFD9lLxzg but sounds like this is something else
04:47:27Tom1992 quits [Client Quit]
04:48:17<pokechu22>Looks like we ran https://www.massassi.net/ in 2023 and some of the subdomains in 2024
04:50:53bladem (bladem) joins
04:59:09nexussfan (nexussfan) joins
05:16:56atphoenix__ (atphoenix) joins
05:19:22atphoenix_ quits [Ping timeout: 252 seconds]
05:33:15nexussfan quits [Remote host closed the connection]
06:13:26gosc joins
06:23:48nine quits [Quit: See ya!]
06:24:01nine joins
06:56:46Umbire quits [Quit: Umbire zaps a wand of digging!]
07:08:50<h2ibot>Brad edited Governments on YouTube (+156, Made Italy and added Ministero di Ravvedimento…): https://wiki.archiveteam.org/?diff=63301&oldid=63210
07:23:53earthnative (earthnative) joins
07:35:27ThreeHM quits [Ping timeout: 268 seconds]
07:38:18ThreeHM (ThreeHeadedMonkey) joins
07:48:58ThreeHM quits [Ping timeout: 252 seconds]
07:50:46ThreeHM (ThreeHeadedMonkey) joins
07:50:48JTL1 (JTL) joins
07:54:34JTL quits [Ping timeout: 268 seconds]
07:56:08JTL1 is now known as JTL
08:15:39earthnative quits [Read error: Connection reset by peer]
08:17:29earthnative (earthnative) joins
08:58:28Doranwen quits [Read error: Connection reset by peer]
08:58:50Doranwen (Doranwen) joins
09:02:45McAfee leaves [Disconnected: Hibernating too long]
09:11:51hexa- quits [Quit: Disconnected]
09:12:48hexa- (hexa-) joins
09:13:10McAfee joins
09:19:02hexa- quits [Quit: Disconnected]
09:19:54hexa- (hexa-) joins
09:28:55ericgallager quits [Ping timeout: 268 seconds]
09:44:07Webuser161765 joins
09:48:42Webuser161765 quits [Client Quit]
11:00:22Bleo18260072271962345522201107 quits [Quit: The Lounge - https://thelounge.chat]
11:03:08Bleo18260072271962345522201107 joins
11:15:30goro (goro) joins
11:17:56dada quits [Quit: chief, beam me out of here]
11:26:40Chris501026 (Chris5010) joins
11:28:33Chris50102 quits [Ping timeout: 268 seconds]
11:28:34Chris501026 is now known as Chris50102
11:48:24key quits [Quit: WeeChat 4.9.4]
12:04:14key (xkey) joins
12:25:17HP_Archivist quits [Quit: Leaving]
12:28:41MPThLee quits [Quit: bye]
12:28:57MPThLee (MPThLee) joins
12:34:48Webuser034777 joins
12:34:51Webuser034777 quits [Client Quit]
13:37:38kirb quits [Quit: oh no]
13:37:38missaustraliana quits [Quit: ZNC - https://znc.in]
13:40:36missaustraliana joins
13:43:10kirb joins
13:43:39missaustraliana quits [Client Quit]
13:43:56missaustraliana joins
13:46:33pie_ quits []
13:46:42pie_ (pie_) joins
14:01:22nexussfan (nexussfan) joins
14:37:11<pabs>arkiver: seems the caddy web server has a PoW thing, here is an example of it https://git.ring0.de/
14:37:25<pabs>my browser doesn't seem to be able to complete that PoW for some reason though
14:43:04<c3manu>JAA: could you please double check that HTTP1.1 is indeed the issue with for example https://adygei.er.ru/ ? just in case i goofed or i missed something
14:46:14<c3manu>looks like there's a wordpress vulnerability around that's making the news: https://www.elastic.co/security-labs/wp2shell-wordpress-rce-detection-elastic-defend
14:47:35<@JAA>c3manu: I got HTTP 200s with the curl command from Firefox and --http1.1, so it isn't that. But I got banned while experimenting with the headers and am now only getting timeouts.
14:50:10<c3manu>JAA: hm, the immediate timeouts is what i'm seeing as well.
14:52:53dada joins
14:53:51<@JAA>pabs: Almost certain that's not part of Caddy itself but a third-party plugin, though I can't find it right now.
15:10:58Island joins
16:08:18<h2ibot>Manu edited Distributed recursive crawls (+94, Candidates: Add er.ru_regional-subdomains.txt): https://wiki.archiveteam.org/?diff=63302&oldid=63262
16:09:18<h2ibot>Manu edited Distributed recursive crawls (+79, Candidates: Add https://en-dangcongsan.nhandan.vn/): https://wiki.archiveteam.org/?diff=63303&oldid=63302
16:17:30ericgallager joins
17:15:07skyrocket quits [Ping timeout: 268 seconds]
17:33:30<justauser>https://echo.archivarix.net/catalog doesn't appear to contain anything generally useful that is not on our wiki, but please someone double-check.
17:35:31<h2ibot>Justauser edited Instagram (+29, /* Archiving */ https://anonyig.com/): https://wiki.archiveteam.org/?diff=63304&oldid=61278
18:19:38<h2ibot>Bear edited List of websites excluded from the Wayback Machine/Time exclusions (+434, + noz.de subpage - first known subpage time…): https://wiki.archiveteam.org/?diff=63305&oldid=61364
18:19:56ThreeHM quits [Read error: Connection reset by peer]
18:21:39<h2ibot>Bear edited List of websites excluded from the Wayback Machine/Time exclusions (+0, count up): https://wiki.archiveteam.org/?diff=63306&oldid=63305
18:23:24ThreeHM (ThreeHeadedMonkey) joins
18:26:39<h2ibot>Bear edited List of websites excluded from the Wayback Machine/Time exclusions (+63, more detail): https://wiki.archiveteam.org/?diff=63307&oldid=63306
18:30:48Goofybally quits [Killed (NickServ (GHOST command used by Goofybally7!~Goofyball@145.82.40.108))]
18:30:53Goofybally joins
18:44:19nine quits [Quit: See ya!]
18:44:32nine joins
19:02:37<pokechu22>Cloudflare tarpits are now showing up on archivebot, e.g. https://archive.vg-resource.com/cdn-cgi/content?id=CUIcAU.Sbl45jVT6Da7nFcxkJs2nrn7HtZ1jRPJ9TNM-1785134893.569846-1.2.1.1-GgUmZTcZ1.xhxoEbDJ9cmdmCwTz0Y9g4e0GZhBstbmQ - it seems like those appearing doesn't mean the bot is banned, but those specific URLs are junk and should be ignored
19:03:42gosc quits [Quit: Leaving]
19:03:54<pokechu22>Those URLs do not appear to be listed in robots.txt. They might be marked as nofollow though
19:17:13balrog quits [Ping timeout: 268 seconds]
19:20:43Wohlstand (Wohlstand) joins
19:21:47balrog (balrog) joins
19:59:46ericgallager quits [Ping timeout: 268 seconds]
20:01:02ericgallager joins
20:13:59<@JAA>For the record re https://adygei.er.ru/ , I trimmed the curl command from Firefox down to UA, Accept, Accept-Language, and Accept-Encoding before I got banned. I got timeouts on the attempt where I had also removed Accept-Encoding. I saw only 200s, so whatever triggers it isn't immediately obvious.
20:14:29<@JAA>Still timing out now and won't try again.
20:21:08nexussfan quits [Remote host closed the connection]
20:21:57nexussfan (nexussfan) joins
20:32:05skyrocket joins
21:04:57Goofybally quits [Killed (NickServ (GHOST command used by Goofybally9!~Goofyball@141.179.81.153))]
21:05:02Goofybally joins
21:53:27goro quits []
22:07:36Webuser927284 joins
22:09:24<Webuser927284>Requesting a crawl of https://roguewarecommunity.jcink.net/ not shutting down but it's a bit inactive; it uses Invision Power Board
22:09:44Wohlstand quits [Client Quit]
22:25:55Webuser927284 leaves
22:26:00etnguyen03 (etnguyen03) joins
22:27:46ericgallager quits [Ping timeout: 268 seconds]
22:44:15skyrocket quits [Client Quit]
22:45:07skyrocket joins
22:45:57<pokechu22>AB job started for https://roguewarecommunity.jcink.net
22:47:27<pokechu22>Huh, dislikes the AB UA but others work.
22:49:09etnguyen03 quits [Client Quit]
22:54:18Zachava quits [Read error: Connection reset by peer]
23:00:29UwU quits [Remote host closed the connection]
23:01:24UwU joins
23:03:47thewinwin81 joins
23:04:36thewinwin8 quits [Read error: Connection reset by peer]
23:04:38thewinwin81 is now known as thewinwin8
23:35:43AffinityFan joins
23:37:27<AffinityFan>In the process of collecting a couple url lists for https://forum.affinity.serif.com/index.php?/forums/ - It's an archived forum with a wealth of knowledge on the affinity editing suite. Can you give me some guidance on what to do next?
23:47:00<pokechu22>If you want to get a list of URLs, https://archive.fart.website/archivebot/viewer/job/20240207023957a0w1c has forum.affinity.serif.com-inf-20240207-023957-a0w1c-meta.warc.gz which lists all URLs archivebot found (it's the job log, so you can read it with zcat/zless). Looks like https://forum.affinity.serif.com/sitemap.php also exists.
23:50:05<AffinityFan>I'm working from the sitemap, seems to be missing hundreds of thousand of topics though. I found 178528 topic URLs, A single subforum is listed as having 600k posts.
23:50:28etnguyen03 (etnguyen03) joins
23:50:35<AffinityFan>(It just finished running in the last few minutes)
23:52:15rohvani quits [Ping timeout: 268 seconds]
23:52:46AffinityFan quits [Client Quit]
23:52:51<@JAA>Note that the AB job is from early 2024 and the forums only went read-only in late 2025. So it'll naturally be missing those. (But that's unrelated to the sitemap.)
23:52:59<pokechu22>That's pretty normal - "posts" includes replies, not just topics. E.g. https://forum.affinity.serif.com/index.php?/forum/5-desktop-questions-macos-and-windows/ says https://forum.affinity.serif.com/index.php?/forum/136-pre-v2-archive-of-desktop-questions-macos-and-windows/ has 406.5k posts but it has only 2534 pages where each page lists 25 topics, so 63350 topics. That just
23:53:01<pokechu22>means that the average thread has 406500/63350=6.4 topics
23:54:06entrox quits [Ping timeout: 268 seconds]
23:56:29Umbire (Umbire) joins

HomeSearchPrevious dayNext day