HomeSearchPrevious dayNext day

00:09:34lechmagik quits [Remote host closed the connection]
00:27:25tech234a (tech234a) joins
00:41:50Matthww quits [Ping timeout: 258 seconds]
00:46:21Matthww joins
00:55:37Iki quits [Ping timeout: 265 seconds]
01:00:02dm4v quits [Client Quit]
01:01:26asdf81 joins
01:03:13dm4v joins
01:03:15dm4v quits [Changing host]
01:03:15dm4v (dm4v) joins
01:11:05katocala quits [Ping timeout: 265 seconds]
01:11:23katocala joins
01:15:25wessel1512 quits [Client Quit]
01:16:09wessel1512 joins
01:27:27lennier1 quits [Ping timeout: 258 seconds]
01:27:31Zerote_ quits [Ping timeout: 265 seconds]
01:28:12lennier1 (lennier1) joins
01:36:53asdf quits [Remote host closed the connection]
01:42:12Zerote joins
02:02:43dm4v quits [Ping timeout: 258 seconds]
02:04:35h2ibot quits [Remote host closed the connection]
02:05:36h2ibot (h2ibot) joins
02:09:58dm4v joins
02:10:00dm4v quits [Changing host]
02:10:00dm4v (dm4v) joins
02:40:02Iki joins
02:55:40<s-crypt>Found this: https://github.com/skyzh/canvas_grab
03:01:39FileplanetHunter quits [Ping timeout: 244 seconds]
03:15:06IDK_ quits [Quit: Ping timeout (120 seconds)]
03:15:22IDK_ joins
03:33:30asdf81 quits [Remote host closed the connection]
04:05:43qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
04:38:53qw3rty__ joins
04:42:47qw3rty_ quits [Ping timeout: 265 seconds]
05:08:24superkuh joins
05:24:01BlueMaxima quits [Read error: Connection reset by peer]
05:25:14h2ibot quits [Client Quit]
05:25:27h2ibot (h2ibot) joins
05:32:43Mateon2 joins
05:33:56Mateon1 quits [Ping timeout: 258 seconds]
05:33:56Mateon2 is now known as Mateon1
05:50:30sonick (sonick) joins
06:19:14thelounge318 joins
06:21:52thelounge31 quits [Ping timeout: 265 seconds]
06:21:52thelounge318 is now known as thelounge31
06:35:39godane1 joins
06:36:22godane quits [Ping timeout: 265 seconds]
07:03:32qwertyasdfuiopghjkl joins
07:56:09qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
07:57:02qwertyasdfuiopghjkl joins
08:42:02thelounge31 quits [Ping timeout: 265 seconds]
08:47:22qw3rty_ joins
08:51:13qw3rty__ quits [Ping timeout: 265 seconds]
09:00:08britmob25636477 quits [Client Quit]
09:58:42thelounge31 joins
10:04:57Arcorann quits [Ping timeout: 258 seconds]
10:06:17Arcorann (Arcorann) joins
10:28:09akrillic joins
10:50:14monoxane4 quits [Quit: estoy fuera]
10:55:43jtagcat quits [Quit: Bye!]
10:59:55jtagcat (jtagcat) joins
11:03:10wyatt8740 quits [Ping timeout: 265 seconds]
11:11:08wyatt8740 joins
11:15:21monoxane4 (monoxane) joins
11:21:39qwertyasdfuiopghjkl quits [Client Quit]
11:28:03SwedishMask joins
11:28:17Viniter6927 quits [Quit: Ping timeout (120 seconds)]
11:29:38Viniter6927 (Viniter) joins
11:33:00SwedishMask quits [Remote host closed the connection]
12:14:42Viniter6927 quits [Ping timeout: 265 seconds]
13:37:21Arcorann quits [Ping timeout: 265 seconds]
14:19:15TastyWiener95 quits [Client Quit]
15:01:37xkey quits [Quit: WeeChat 3.3]
15:02:21xkey (eyo) joins
16:02:19vukky (Vukky) joins
16:22:54vukky quits [Client Quit]
16:24:00vukky (Vukky) joins
16:43:57AlsoHP_Archivist joins
16:46:18HP_Archivist quits [Ping timeout: 258 seconds]
16:47:27lennier1 quits [Client Quit]
16:49:32lennier1 (lennier1) joins
18:20:36HackMii_ quits [Ping timeout: 258 seconds]
18:20:57AlsoHP_Archivist quits [Client Quit]
18:21:12HP_Archivist (HP_Archivist) joins
18:21:37HackMii_ (hacktheplanet) joins
19:01:01HackMii_ quits [Remote host closed the connection]
19:01:39HackMii_ (hacktheplanet) joins
19:15:00jamesp (jamesp) joins
19:58:16<hexa->inb4: alexa.com sold to amazon for undisclosed amount of gold-pressed latinum
19:58:25<hexa->oh
19:58:30<hexa->already "an amazon company"
20:03:12<@OrIdow6>Yes, the sale to Amazon was an important part of the Internet Archive's founding from what I understand
20:03:27<@OrIdow6>But sort of ot
20:18:40datechnoman quits [Ping timeout: 258 seconds]
20:29:20<tech234a>Also sort of ot but I thought Alexa contributed crawl data to WBM
20:45:59<monika>looks like they stopped donating data about a year ago?
20:46:01<monika>https://archive.org/details/alexa20201211-05
20:48:05<tech234a>There's supposed to be an "embargo period", not sure how long that period is
20:51:51katocala quits [Remote host closed the connection]
20:59:07katocala joins
21:10:28BlueMaxima joins
21:16:34vukky quits [Client Quit]
21:28:26datechnoman (datechnoman) joins
22:35:13etnguyen03 (etnguyen03) joins
22:35:28Arcorann (Arcorann) joins
23:29:01qwertyasdfuiopghjkl joins
23:38:46etnguyen03 quits [Ping timeout: 258 seconds]
23:41:30<akrillic>Sorry to bother everyone, but I'm new to archiving. How would you guys suggest finding the subdomains of a site (Tripod in this case) that doesn't have them listed on a sitemap?
23:48:49<jodizzle>Sublist3r is one that I've used before: https://github.com/aboul3la/Sublist3r
23:49:25<jodizzle>I believe there are several webapps that people commonly use.
23:50:06<jodizzle>No guarantees of fetching all the subdomains, of course.
23:51:49<@JAA>Search engines, Twitter searches, and the WBM are also sources I use typically.
23:52:29<@JAA>Well, CDX API, not sure it's possible through the WBM directly.
23:53:14<akrillic>i was afraid that would be the answer
23:53:25<akrillic>^^ sublist3r only turned up about 500 domains, unfortunately
23:54:32<@JAA>Yeah, unless there's a sitemap, easy way to enumerate, or open AXFR (lol as if anyone does that), everything's going to be messy and typically very incomplete.
23:54:52<@JAA>Oh yeah, Rapid7's Sonar data is also very useful.
23:58:38BlueMaxima quits [Read error: Connection reset by peer]

HomeSearchPrevious dayNext day