HomeSearchPrevious dayNext day

00:01:12etnguyen03 quits [Client Quit]
00:09:22n9nes quits [Ping timeout: 268 seconds]
00:09:29ericgallager joins
00:11:46n9nes joins
00:13:15Webuser011264 joins
00:13:16Webuser011264 quits [Client Quit]
00:15:39ScenarioPlanet quits [Quit: meow meowy meow]
00:15:39Pedrosso quits [Quit: Leaving]
00:15:51TheTechRobo quits [Quit: Bye :3]
00:26:33etnguyen03 (etnguyen03) joins
00:31:20Webuser104827 joins
00:31:31Webuser104827 quits [Client Quit]
00:41:46error quits [Remote host closed the connection]
00:42:08error (disinfecttm) joins
00:43:13Hackerpcs quits [Remote host closed the connection]
00:44:05Hackerpcs (Hackerpcs) joins
00:46:43Pedrosso joins
00:46:45ScenarioPlanet (ScenarioPlanet) joins
00:51:08TheTechRobo (TheTechRobo) joins
00:54:08useretail quits [Remote host closed the connection]
00:54:26useretail joins
00:57:44Webuser593366 joins
01:00:12<Webuser593366>Hi, I'm new here, and I've been working on the URLs project. I've noticed that some websites display a Cloudflare block page saying, "Sorry, you have been blocked," with my IP address shown at the bottom. Will my IP address be recorded when this happens?
01:15:11Webuser593366 quits [Client Quit]
01:23:28thewinwin89 joins
01:25:03thewinwin8 quits [Ping timeout: 248 seconds]
01:25:07thewinwin89 is now known as thewinwin8
01:42:23Pendonym quits [Quit: Pendonym]
01:51:40<TheTechRobo>yeah, I really think the URLs project needs a stronger warning
01:53:16Pendonym (Pendonym) joins
01:57:42Island quits [Read error: Connection reset by peer]
02:18:16<yzqzss>https://github.com/saveweb/unwarc
02:18:16<yzqzss>hi guys, I crafted a new WARC reader library with golang, xD. take a look!
02:20:22etnguyen03 quits [Client Quit]
02:20:51etnguyen03 (etnguyen03) joins
02:31:49skankhunt42 quits [Ping timeout: 268 seconds]
02:32:15etnguyen03 quits [Remote host closed the connection]
03:16:04DogsRNice quits [Read error: Connection reset by peer]
03:29:26MrMcNuggets quits [Read error: Connection reset by peer]
03:39:20useretail quits [Remote host closed the connection]
04:59:45skankhunt42 (skankhunt42) joins
05:00:31h|ca2 quits [Ping timeout: 248 seconds]
05:04:53h|ca2 (h) joins
05:28:27nexussfan quits [Quit: Konversation terminated!]
05:44:25<pokechu22>arkiver: loading different sitemaps in https://grossmanontruth.com/sitemap.xml triggers some kind of https://cleantalk.org/ challenge
05:44:44<pokechu22>at least with curl/AB
06:00:54<@arkiver>thank you pokechu22 !
06:01:03<@arkiver>JAA: understood, thank you
06:01:29<@arkiver>for krakenfiles, we cannot archive it fully, but we i see some pages do include playable version of data online, like audio, etc.
06:02:03<@arkiver>if there is popular stuff on krakenfiles we could look into it, but a full site archiving project will not happen, or only in a metadata "everything except the actual files" way
06:02:14nathang218438 quits [Quit: The Lounge - https://thelounge.chat]
06:02:37nathang218438 joins
06:21:40JohnnyJ joins
06:26:47<c3manu>klea: as usual i can't follow or retrace your thoughts or what you did there, but thanks anyways for looking at it :)
06:27:45<c3manu>klea: i ran the list earlier and it looks a little short compared to just the number of devices listed on there. i found at least one pdf yesterday that (to me) didn't seem to be part of the bucket, so i might have to go through those anyways. or maybe just for the english ones
06:27:48<klea>hmm, I basically looked at the browser console and figured out which requests the website made, and replicated them with curl.
06:28:10<klea>huh
06:28:39<c3manu>urls like these: https://service.oneplus.com/content/dam/support/user-manuals/lt/OnePlus_8_Pro_User_Manual_LT.pdf
06:29:32<c3manu>discovered from here: https://service.oneplus.com/us/user-manual#/detail?equipmentModelId=924922fa-a0ce-11ef-9811-fa168f20b2a1
06:30:22<c3manu>those bucketed ones will be hard to find anyways depending on how well that pile of JS works in the WBM
06:31:42tbc1887837 quits [Ping timeout: 268 seconds]
06:33:30<klea>It will likely not replay properly, since it seems to do POST requests.
06:33:32<c3manu>it might also be possible the list of available devices (also in the json) depends on the selected region?
06:34:00<klea>I think yeah, since I don't see 924922fa-a0ce-11ef-9811-fa168f20b2a1 in the tar I sent.
06:35:12<c3manu>i might just click through them by hand and upload them directly to IA
06:36:07<klea>Would probably make better discoverability, yeah.
06:40:04<@arkiver>c3manu: you can do these as both direct upload to IA and into the Wayback Machine
06:40:28<@arkiver>this usually is not *that* much data, but still very important so have them be discoverable in both ways (IA item and Wayback Machine) is useful
06:47:58twiswist quits [Read error: Connection reset by peer]
06:52:27<c3manu>hm, that would give me the "download links" for those anyways, so i could create a list that way
06:52:54<c3manu>that's gonna take a bit though..let's hope that website isn't gonna go disappear this week ^^
07:05:10<h2ibot>Hans5958 edited Data.world (-1, Rename to ODA): https://wiki.archiveteam.org/?diff=63159&oldid=63157
07:06:14<@arkiver>c3manu: do you suspect it will disappear? (i'm unaware of the context here)
07:08:21<c3manu>arkiver: i have no clue: https://www.techspot.com/news/113109-oneplus-expected-announce-us-europe-exit-week-deepening.html
07:08:40<c3manu>> Now, WinFuture, citing "well-informed" sources, reports that OnePlus will announce its withdrawal from these markets this week.
07:09:11tbc1887837 joins
07:09:32<c3manu>i probably misread that thinking the timeline was about the withdrawal rather than the announcement
07:10:10<h2ibot>Hans5958 edited Main Page/Current Projects (+169, data.world has deadline passed, Roblox Groups…): https://wiki.archiveteam.org/?diff=63160&oldid=63036
07:26:49ThreeHM quits [Read error: Connection reset by peer]
07:28:39<@arkiver>well manuals are very important, good to get them
07:30:18<h2ibot>Hans5958 edited Data.world (+1128): https://wiki.archiveteam.org/?diff=63161&oldid=63159
07:30:20ThreeHM (ThreeHeadedMonkey) joins
07:32:06Wohlstand (Wohlstand) joins
07:33:30<c3manu>agreed
07:35:19<h2ibot>Hans5958 edited Data.world (+128): https://wiki.archiveteam.org/?diff=63162&oldid=63161
08:02:39Webuser039232 joins
08:03:17<Webuser039232>Good morning, I have crawled a blog that'll be shutdown by the 29th this month. Is there a way to upload the warc.gz file to Way Back Machine?
08:19:47<@Sanqui>Webuser039232: sadly, the Internet Archive is unable to accept WARCs of unknown provenance for ingestion. You should still upload the data, as well as tell us the blog so that we can make a copy as Archive Team
08:22:26<Webuser039232>The link is https://smallpages.blog/
08:22:26<Webuser039232>Do I upload the data as an "item"?
08:27:58<@arkiver>Webuser039232: yes you can upload the data as 'item' to IA (Internet Archive), it will be preserved but not end up in the Wayback Machine
08:28:55Webuser039232 quits [Client Quit]
08:30:42amphitryon_ joins
08:32:49Goofybally quits [Killed (NickServ (GHOST command used by Goofybally4!~Goofyball@2.89.128.101))]
08:32:54Goofybally joins
08:34:25nathang218438 quits [Ping timeout: 268 seconds]
08:34:25amphitryon quits [Ping timeout: 268 seconds]
08:42:45nathang218438 joins
08:44:04MrMcNuggets (MrMcNuggets) joins
08:57:14Mateon1 quits [Ping timeout: 268 seconds]
08:57:48Mateon1 joins
09:04:31croissant` joins
09:05:52f_ quits [Ping timeout: 268 seconds]
09:08:00croissant quits [Ping timeout: 248 seconds]
09:11:33f_ (funderscore) joins
09:12:58croissant joins
09:15:44croissant` quits [Ping timeout: 268 seconds]
09:31:53benjins3_ quits [Remote host closed the connection]
10:00:47tertu quits [Ping timeout: 248 seconds]
10:30:10tertu (tertu) joins
10:38:22nulldata quits [Ping timeout: 268 seconds]
10:41:44nulldata (nulldata) joins
11:00:19Bleo18260072271962345522201107 quits [Quit: The Lounge - https://thelounge.chat]
11:03:04Bleo18260072271962345522201107 joins
11:20:54<h2ibot>Cruller edited Deathwatch (+280, /* 2026-08 */ Add mastodon.cloud): https://wiki.archiveteam.org/?diff=63163&oldid=63158
11:21:38<cruller|irc>On 2026-08-10, mastodon.cloud, which has approximately 280k users, will be shutting down. Its owner is looking for someone to take it over.
11:22:45<cruller|irc>In the thread at https://mstdn.jp/@Sujiyan/116877225547993287, there is a discussion about the persistence (as a service) of Mastodon instances, with the Executive Director of Mastodon GmbH also participating. If you're interested, please join this. This could be a good opportunity for you as well.
11:22:56<cruller|irc>I'm also a user on mastodon.cloud, so please ping me if anything comes up.
11:25:47<@arkiver>thank you cruller|irc !
11:31:22benjins3 joins
11:42:25void09 quits []
11:43:03void09 joins
11:44:42<cruller|irc>P.S. Its owner, Sujitech, LLC, also owns mstdn.jp and pawoo.net. While there are currently no signs of these two servers being shut down, I am personally concerned. This company is probably the second largest "centralized point" on the Fediverse.
12:12:43Starchives__ quits [Ping timeout: 268 seconds]
12:20:13Umbire (Umbire) joins
12:22:33thewinwin82 joins
12:25:51thewinwin8 quits [Ping timeout: 248 seconds]
12:25:55thewinwin82 is now known as thewinwin8
12:30:05<h2ibot>Cruller edited Deathwatch (+651, /* 2026 */ Add [[LINE]] VOOM, POPOPO, and Sendo…): https://wiki.archiveteam.org/?diff=63164&oldid=63163
12:33:26Starchives (Starchives) joins
12:41:34<eggdrop>[remind] cruller: Have these recovered? https://irclogs.archivete.am/archiveteam-bs/2026-07-08#l2efbd7c6
12:46:07<h2ibot>Manu edited Distributed recursive crawls (+97, Candidates: Add https://www.alghadalsoury.com/): https://wiki.archiveteam.org/?diff=63165&oldid=63155
13:07:45<cruller|irc>eggdrop: Archive.st is dead. For the others, yes.
13:24:56Tacticslion joins
13:26:05<Tacticslion>I have no idea what I'm doing, however I have been told that this is a good place to put something on Deathwatch for archival purposes.
13:27:11<Tacticslion>The website in need of archiving is https://legacy.aonprd.com/
13:28:20<Tacticslion>It seems like it has about ten days before it's gone, well, nine, now (today is the 15th, and it seems like it will be removed by the 24th).
13:31:56<TheTechRobo>Tacticslion: I don't see any shutdown message on there, am I missing something?
13:32:21<Tacticslion>It's from here: https://www.archivesofnethys.com/agreement.html
13:33:11<Tacticslion>Basically, AoN is losing its licensing agreement with Paizo, and so they a) have to remove all art, b) will no longer be able to receive advance copies of stuff, and (the one relevant for this purpose) c) will lose the legacy prd.
13:34:15<TheTechRobo>Looks like that subdomain was saved back in 2019: https://archive.fart.website/archivebot/viewer/domain/legacy.aonprd.com
13:34:15<TheTechRobo>The other art they're removing is probably a good idea to save, though
13:34:18<Tacticslion>IF there was a way to retain AoN with intact artwork, that would be swell, but that seems like a messy and too-large project to accomplish in ten days. I think preserving the legacy prd is more important.
13:34:48<Tacticslion>Oh, okay, if you think so. I honestly don't know what I'm doing, and had this recommended to me based on events. If stuff is already saved, it's all good.
13:36:37<TheTechRobo>And thank you for bringing this up :-)
13:37:41<Tacticslion>Gladly! thank you for the help!
13:44:07<c3manu>Tacticslion: do you happen to have an example for the artwork referenced in the agreement notice?
13:47:00<c3manu>https://legacy.aonprd.com/ is now running in #archivebot
13:47:38Island joins
13:50:38<c3manu>it's all static HTML but i haven't seen any artwork on there yet. going through other subdomains rn
13:51:15nine quits [Quit: See ya!]
13:51:29nine joins
13:52:53<c3manu>here is some artwork: https://2e.aonprd.com/Archetypes.aspx?ID=377
13:55:35<c3manu>Tacticslion: apart from that, thanks for telling us about those :)
13:56:13<Tacticslion>Oh, sorry for the delayed response. Um, let me see.
13:57:26<c3manu>don't worry
13:57:37<Tacticslion>This page has an example in Starfinder: https://aonsrd.com/AlienDisplay.aspx?ItemName=Alorbidaemon&Family=Daemon
13:58:14<c3manu>oh, that's on another domain. so there's a bunch of them belonging together?
13:58:42<c3manu>ah, it's per game it looks like
13:59:32<Tacticslion>Yeah, sorry. Here's an example for Starfinder 2e: https://2e.aonsrd.com/archetypes/7-envoy
14:00:00<c3manu>all good, just figuring out as i go :)
14:00:25<masterx244|m>mapping out the structure is essential for a efficient grab-and-save
14:00:41<masterx244|m>(or to see if the big guns need to be used)
14:00:47<Tacticslion>That makes sense! Do you want more examples, or is that good enough?
14:01:13<Tacticslion>Here's the "hub" of the four systems, if that helps: https://www.archivesofnethys.com/
14:01:32<Tacticslion>I also need to step away for a while. Sorry. And thank you for all you do!
14:01:50<c3manu>haha, that's "good enough". i wasn't sure about the domain involved and was confused because the notice mentions artwork but https://legacy.aonprd.com/ seems to be all text
14:02:08<c3manu>you can watch the jobs here btw: http://archivebot.com/?initialFilter=aonprd.com
14:03:17nexussfan (nexussfan) joins
14:04:52<c3manu>masterx244|m: true. they don't seem huge though
14:07:29<c3manu>(famous last words, i know)
14:12:15NotKlea joins
14:12:41NotKlea is now known as RJHacker84754
14:14:39McAfee leaves [Error from remote client]
14:28:57McAfee joins
14:30:39<klea>https://www.theverge.com/tech/962479/get-google-earth-pro-while-you-still-can
14:30:44<klea>Not sure if we can archive that.
14:38:04<steering>>The PC version of Kelly Slater's Pro Surfer (released in 2003) did indeed come bundled with a special digital promotion for Keyhole Voyager—the groundbreaking 3D satellite mapping software that Google purchased in 2004 and rebranded as Google Earth.
14:38:08<steering>wat lol
14:39:56<klea>Not sure, I just looked at https://killedbygoogle.com/ and noticed another thing.
14:56:25<@arkiver>end of an era
15:04:14NotKlea joins
15:04:39NotKlea is now known as RJHacker48938
15:05:18klea003 joins
15:07:14RJHacker84754 quits [Ping timeout: 268 seconds]
15:08:28superkuh quits [Ping timeout: 268 seconds]
15:09:05RJHacker48938 quits [Ping timeout: 268 seconds]
15:17:12superkuh joins
15:18:32lumidify quits [Quit: leaving]
15:20:26lumidify (lumidify) joins
15:27:52thewinwin81 joins
15:29:51thewinwin8 quits [Ping timeout: 248 seconds]
15:29:56thewinwin81 is now known as thewinwin8
15:34:59moth3 quits [Ping timeout: 268 seconds]
15:35:02moth3 joins
15:38:03<c3manu>i'm still mad about google reader tbh
15:38:10<c3manu>but that was back when i cared about google
15:44:21nine quits [Client Quit]
15:44:34nine joins
15:44:56thewinwin87 joins
15:46:42thewinwin8 quits [Ping timeout: 268 seconds]
15:46:44thewinwin87 is now known as thewinwin8
15:48:31Yna quits [Ping timeout: 248 seconds]
15:48:46Yna joins
16:05:49cyanbox quits [Ping timeout: 268 seconds]
16:11:44cyanbox joins
16:14:06ThreeHM quits [Read error: Connection reset by peer]
16:14:29nate1766 joins
16:17:33ThreeHM (ThreeHeadedMonkey) joins
16:18:46cyanbox quits [Ping timeout: 268 seconds]
16:19:23moth3 quits [Ping timeout: 268 seconds]
16:20:50cyanbox joins
16:41:08Webuser039857 quits [Quit: Ooops, wrong browser tab.]
16:41:14DogsRNice joins
16:51:58<nicolas17>ac,script,cadmus)/d2p05h3o2h56ra/script.js 20260714083350 https://cadmus.script.ac/d2p05h3o2h56ra/script.js application/javascript 200 PRPOVKW7CLNKLQWLKGZSSJBPBZB7KWU7 - - 90518 4503318921 archiveteam_archivebot_go_20260714092223_9ca3be29/geogee.wordpress.com-inf-20260714-062245-cz11w-00002.warc.gz
16:52:02<nicolas17>random line from a cdx
16:52:16<nicolas17>is "90518" supposed to be the WARC record size? payload size?
16:52:34<klea>I think position in the WARC.
16:52:43<nicolas17>no I think "4503318921" is position
16:52:52<klea>ah
16:53:46<nicolas17>I'm seeing stuff with the same hash and different size, so I think it's the whole record, including headers and compression
16:58:22Wohlstand quits [Remote host closed the connection]
17:25:03nine quits [Client Quit]
17:25:16nine joins
17:28:27klea003 quits [Ping timeout: 268 seconds]
17:46:57MrMcNuggets quits [Quit: WeeChat 4.9.2]
18:01:20nathang218438 quits [Ping timeout: 248 seconds]
18:08:50<klea>Could I get https://ibiblio-icon-archive.danq.dev/ ran on AB, along with the correct URLs from ibiblio.org (see pseudocode from https://danq.me/2026/07/10/rescuing-7234-gifs/)
18:14:09nine quits [Client Quit]
18:14:23nine joins
18:18:03Wohlstand1 (Wohlstand) joins
18:20:27Wohlstand1 is now known as Wohlstand
19:16:55msfjarvis quits [Quit: Lurker 1.0.8 (the truth is out there) https://lurker.chat]
19:17:45msfjarvis joins
19:21:36thelounge781 joins
19:23:09thelounge78 quits [Ping timeout: 268 seconds]
19:23:11thelounge781 is now known as thelounge78
19:28:47croissant quits [Ping timeout: 248 seconds]
19:29:41croissant joins
19:29:51<nicolas17>another warc mystery
19:31:04<nicolas17>https://archive.org/download/archiveteam_archivebot_go_20260714092223_9ca3be29/paragoninstitute.org-inf-20260713-223945-6fxxy-00004.warc.gz has several URLs (eg. https://offers.premierinc.com/js/forms2/js/fields/inputCheckbox.js) that returned 404
19:31:20<nicolas17>WARC-Type: response
19:31:22<nicolas17>WARC-Target-URI: https://offers.premierinc.com/js/forms2/js/fields/inputCheckbox.js
19:31:25<nicolas17>WARC-Payload-Digest: sha1:ZBRUY33G6YI2WWO42TALJG5ZKMTGDWUY
19:31:47<nicolas17>however, in the generated cdx for the whole item https://archive.org/download/archiveteam_archivebot_go_20260714092223_9ca3be29/archiveteam_archivebot_go_20260714092223_9ca3be29.cdx.gz
19:32:04<nicolas17>I see hash 2JTZOLIRUYU4CVFG7XNVJZNQXQJ3AFM5
19:59:32unknownsrc quits [Ping timeout: 268 seconds]
20:01:51tertu quits [Ping timeout: 248 seconds]
20:10:52unknownsrc (unknownsrc) joins
20:12:52tertu (tertu) joins
20:22:16<Pendonym>i think i have found the best irc client
20:24:05<klea>`rlwrap -nH /dev/null socat - socat stdio openssl:irc.hackint.org:6697,verify=0` (and don't log in) right?
20:26:49<Pendonym>klea: surely youre not responding to what i said
20:27:11<klea>I mean, it is a valid IRC client.
20:27:17tertu quits [Ping timeout: 268 seconds]
20:31:40<Pendonym>klea: no its https://halloy.chat/

HomeSearchPrevious dayNext day