00:08:43skankhunt42 (skankhunt42) joins
02:35:15DogsRNice joins
04:17:11DogsRNice quits [Read error: Connection reset by peer]
04:36:13n9nes quits [Remote host closed the connection]
04:37:18n9nes joins
05:04:29n9nes quits [Ping timeout: 268 seconds]
05:04:50n9nes joins
07:47:49IDK quits [Ping timeout: 633 seconds]
07:49:27JSharp quits [Read error: Connection reset by peer]
07:49:33JSharp (JSharp) joins
07:49:36IDK (IDK) joins
09:10:49systwo (systwi) joins
09:14:46systwi quits [Ping timeout: 268 seconds]
10:17:12gamer191-1|m joins
10:22:23<gamer191-1|m>I got over excited and sent this in archiveteam-bs instead of this channel. Anyway, archive.today have a non-rate-limited API to expand URLs:
10:22:23<gamer191-1|m>https://archive.md/cse.js?id=ID where the ID is 5 alphanumeric characters
11:54:39<klea>I wonder what order they use to fill their id database thing: https://archive.md/cse.js?id=ZZZZZ
11:55:53<klea>And I don't think this might be the best project since AFAIK it'd lose some information, like the time, since it only stores URL <-> URL mappings.
11:58:11<klea>gamer191-1|m: This channel isn't publicly logged :)
11:58:33<klea>Tho I guess if you're just summarizing stuff that is, it might be okay, not entirely sure.
12:00:44<klea>oh
12:00:46<klea>I'm stupid
12:00:51<klea>They're all internal links.
12:02:57<klea>So https://archive.today/meowa -> https://archive.today/2013-04-13-070646/http://www.proposteericerche.it/index.html for example.
12:09:23<gamer191-1|m>That’s a dead link?
12:10:30<gamer191-1|m>klea: it includes the archived time at the end of the second last line
12:11:11<klea>oh yeah I confused myself, since I first queried meowa and then meoww.
12:12:48<gamer191-1|m>It gives us url mappings, archived time, and a thumbnail URL. And all of that is accessible through Tor browser, implying it isn’t rate-limited/captcha-protected like the rest of the site
12:15:19<gamer191-1|m>To access the thumbnails you have to add a random subdomain. Lemme figure out the rules for that…
12:19:08<gamer191-1|m>It has to start with a d and then have 13 more characters
12:19:36<gamer191-1|m>Eg https://a1234567890123.archive.md/THUMBNAILURL
12:19:45<gamer191-1|m>Sorry
12:19:51<gamer191-1|m>https://d1234567890123.archive.md/THUMBNAILURL
12:23:01<gamer191-1|m>klea: it’s not public, I discovered it using dev tools. I don’t know how quickly archive.today would patch it if we used it (so perhaps it should be done without rate limiting, using "ArchiveTeam’s Choice")
12:24:09<klea>mhmm
12:24:47<gamer191-1|m>(And I would have zero guilt about archiving their site without rate limiting, if necessary, because this whole drama started with them attempting to DDOS another site)
12:25:22<klea>AT needs Warriors on another project rn AFAIK
12:26:42<gamer191-1|m>Also I’m a newbie here who just popped into this server and suggested starting a new project as ArchiveTeam’s Choice💀
12:28:01<klea>nah, don't worry :p
12:28:45<gamer191-1|m>Anyway, imo this should wait until the next lull, so that it can be ArchiveTeam’s choice—archive.md are unlikely to be reading this channel (or the other one) and if they patch this then we’ll likely have no way to ever archive their site
12:29:52<gamer191-1|m>Alternatively we could do a DPOS with a low priority and hope they don’t notice
12:30:03<gamer191-1|m>I don’t know which is better tbh
12:31:40<gamer191-1|m>I think it should either be rate limited to stay low, or done as a high priority to hopefully back up everything before they can block us
12:34:39skankhunt42 quits [Ping timeout: 268 seconds]
12:56:00FiTheArchiver joins
13:02:41FiTheArchiver quits [Client Quit]
16:11:38@imer quits [Quit: Oh no]
16:41:17imer (imer) joins
16:41:17@ChanServ sets mode: +o imer
16:54:41DogsRNice joins
19:26:24systwo is now known as systwi
21:37:39pabs quits [Read error: Connection reset by peer]
23:40:25pabs (pabs) joins