00:07:59<@flashfire42|m>lenarium: if I get some time today I may play around with the archive.today stuff. I just wanna avoid any workers getting a ban as I know some crazy people run this residentially
00:07:59<@flashfire42|m>Tho I don’t know if we have as many workers as we did in the days when this was the default project
00:08:40JaffaCakes118 quits [Remote host closed the connection]
00:09:03JaffaCakes118 (JaffaCakes118) joins
00:16:08nepeat quits [Client Quit]
00:18:37nepeat (nepeat) joins
02:20:26michaelblob quits [Read error: Connection reset by peer]
02:21:10HP_Archivist (HP_Archivist) joins
02:21:45michaelblob (michaelblob) joins
04:52:59fireonlive quits [Killed (NickServ (GHOST command used by fireonlive_))]
04:53:21fireonlive (fireonlive) joins
04:54:40silsha quits [*.net *.split]
04:54:40Ishiguro|m quits [*.net *.split]
04:54:40Cydog|m quits [*.net *.split]
04:54:40whatsthis53|m quits [*.net *.split]
04:54:40jwoglom|m quits [*.net *.split]
04:54:40piraces|m quits [*.net *.split]
04:54:40phaeton quits [*.net *.split]
04:54:40yzqzss quits [*.net *.split]
04:54:40s-crypt|m|m quits [*.net *.split]
04:54:40thermospheric quits [*.net *.split]
04:54:40Froxcey|m quits [*.net *.split]
04:54:40Hans5958 quits [*.net *.split]
04:54:40octylFractal|m quits [*.net *.split]
04:54:40tech234a|m quits [*.net *.split]
04:54:40Roki_100|m quits [*.net *.split]
04:54:40moe-a-m|m quits [*.net *.split]
04:54:40schwarzkatz|m quits [*.net *.split]
04:54:40Thibaultmol quits [*.net *.split]
04:54:41Minkafighter|m quits [*.net *.split]
04:54:41nstrom|m quits [*.net *.split]
04:54:41@flashfire42|m quits [*.net *.split]
04:54:41audrooku|m quits [*.net *.split]
04:54:41xxia|m quits [*.net *.split]
04:54:41x9fff00 quits [*.net *.split]
04:54:41Vokun quits [*.net *.split]
04:54:41M0x52617370626572727920|m quits [*.net *.split]
04:54:41DigitalDragon quits [*.net *.split]
04:54:41mind_combatant quits [*.net *.split]
04:54:41@Sanqui|m quits [*.net *.split]
04:54:41britmob|m quits [*.net *.split]
04:55:10thenes quits [Ping timeout: 260 seconds]
04:56:39thenes (thenes) joins
04:58:29silsha joins
04:58:29Ishiguro|m joins
04:58:29Vokun (Vokun) joins
04:58:29flashfire42|m (flashfire42) joins
04:58:29Cydog|m joins
04:58:29Froxcey|m joins
04:58:29phaeton (phaeton) joins
04:58:29yzqzss (yzqzss) joins
04:58:29octylFractal|m joins
04:58:29s-crypt|m|m joins
04:58:29M0x52617370626572727920|m joins
04:58:29Roki_100|m joins
04:58:29audrooku|m joins
04:58:29moe-a-m|m joins
04:58:29Hans5958 (Hans5958) joins
04:58:29jwoglom|m joins
04:58:29whatsthis53|m joins
04:58:29x9fff00 (x9fff00) joins
04:58:29Minkafighter|m joins
04:58:29Thibaultmol joins
04:58:29piraces|m joins
04:58:29thermospheric (Thermospheric) joins
04:58:29schwarzkatz|m joins
04:58:29britmob|m joins
04:58:29Sanqui|m (Sanqui) joins
04:58:29tech234a|m joins
04:58:29DigitalDragon (DigitalDragon) joins
04:58:29nstrom|m joins
04:58:29mind_combatant joins
04:58:29xxia|m joins
04:58:29nuke.hackint.org sets mode: +oo flashfire42|m Sanqui|m
05:37:32benjins2__ joins
05:40:17benjins2_ quits [Ping timeout: 272 seconds]
06:05:37Medowar quits [Ping timeout: 255 seconds]
06:07:05Medowar joins
08:05:46qwertyasdfuiopghjkl quits [Ping timeout: 255 seconds]
09:01:49imer quits [Quit: Oh no]
09:03:18imer (imer) joins
10:14:51thenes_ (thenes) joins
10:14:52thenes quits [Remote host closed the connection]
11:35:10VerifiedJ9 quits [Remote host closed the connection]
11:35:59VerifiedJ9 (VerifiedJ) joins
13:31:37lenarium (lenarium) joins
13:33:09<lenarium>Flashfire42: Great. How can I help?
13:38:58<lenarium>flashfire42|m: (tagging both nicks) note that archiving archive.today URLs will need a little custom code.
13:39:28<lenarium>turning this https://archive.is/PlqTh
13:39:32<lenarium>into this https://archive.is/2014.10.13-085708/http://kruel.co/backup/Ontological%20Therapy.html
13:40:42<lenarium>requires fetching the HTML and grabbing a value in the tag <link rel="canonical" .../>
13:40:55<@JAA>I don't believe that requires custom code.
13:41:14JaffaCakes118_2 (JaffaCakes118) joins
13:41:51<lenarium>in the sense that it's simple?
13:42:13<lenarium>i can get the link in one line of shell
13:42:22<@JAA>In the sense that such extraction is built into terroroftinytown anyway because it's needed for a lot of shorteners IIRC.
13:42:38<lenarium>oh yeah that's what I wanted to know
13:43:25<lenarium>I had the suspicion that maybe the extractors so far only looked at the headers and waited to get redirected
13:48:38<lenarium>some basic info on the url format: 1. It's non-sequential 2. [A-z0-9]{4} 3. Switched to 5 digits once they ran out of 4-digit codes (around 2012?)
14:07:49vitriol joins
14:35:01vitriol quits [Ping timeout: 255 seconds]
15:15:37<@JAA>https://old.reddit.com/r/Archiveteam/comments/1eqqhrw/why_is_mplyio_apart_of_url_team_2s_list/
15:15:44<@JAA>> Why is mply.io apart of URL Team 2's list?
15:16:36<@JAA>Oh, deleted and reposted: https://old.reddit.com/r/Archiveteam/comments/1eqqxq1/why_is_mplyio_apart_of_url_team_2s_list/
16:52:46BearFortress quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
17:24:33sepro quits [Read error: Connection reset by peer]
17:24:48sepro (sepro) joins
17:53:20qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
18:13:26f_ quits [Remote host closed the connection]
18:13:53f_ (funderscore) joins
18:19:49f_ quits [Remote host closed the connection]
18:19:59f_ (funderscore) joins
18:23:27BearFortress joins
18:52:44JaffaCakes118 quits [Remote host closed the connection]
18:53:24JaffaCakes118 (JaffaCakes118) joins
19:31:07JaffaCakes118_2 quits [Client Quit]
20:43:18<@Flashfire42>JAA cause we needed more stuff to run and I was lazy on what I was gonna add because this project is running on autopilot most of the time
21:04:42lenarium_ (lenarium) joins
21:07:29lenarium quits [Ping timeout: 272 seconds]
21:31:16lenarium_ quits [Ping timeout: 255 seconds]
21:53:33<@JAA>Flashfire42: Yeah, figured as much. They do have a point though that we've scanned 79 million IDs and found a grand total of zero.
22:53:13JSharp_ (JSharp) joins
23:00:49JSharp quits [Ping timeout: 624 seconds]
23:00:50JSharp_ is now known as JSharp
23:04:25datechnoman quits [Ping timeout: 255 seconds]
23:10:07datechnoman (datechnoman) joins
23:38:36systwi quits [Read error: Connection reset by peer]
23:39:07systwi (systwi) joins