| 00:10:36 | | lennier2 joins |
| 00:14:34 | | lennier1 quits [Ping timeout: 252 seconds] |
| 00:14:41 | | lennier2 is now known as lennier1 |
| 01:00:44 | | HP_Archivist (HP_Archivist) joins |
| 01:02:38 | <OrIdow6> | In other news, they disabled the JS-less Twitter on the 15th |
| 01:08:14 | | HP_Archivist quits [Client Quit] |
| 01:35:33 | | HP_Archivist (HP_Archivist) joins |
| 02:00:01 | | Dallas quits [Client Quit] |
| 02:03:58 | | Dallas (Dallas) joins |
| 02:51:08 | | luckcolors quits [Ping timeout: 252 seconds] |
| 02:52:17 | | luckcolors (luckcolors) joins |
| 02:57:44 | | @arkiver quits [Ping timeout: 252 seconds] |
| 02:57:57 | | arkiver (arkiver) joins |
| 02:57:57 | | @ChanServ sets mode: +o arkiver |
| 02:58:30 | | Muad-Dib joins |
| 02:58:50 | | Muad_Dib quits [Ping timeout: 252 seconds] |
| 03:24:42 | | HP_Archivist quits [Client Quit] |
| 04:49:30 | | qw3rty__ joins |
| 04:52:44 | | qw3rty_ quits [Ping timeout: 240 seconds] |
| 05:27:02 | | brsq joins |
| 05:44:08 | <brsq> | i'm so sad i didn't know about you previously, recently 20 year old blog service from my country is closed, 20 years of important internet history for my country is just destroyed, you guys would probably save it if I alerted you |
| 05:48:45 | <atphoenix> | what was the URL? |
| 05:50:28 | <brsq> | blogcu.com but it's gone already |
| 05:54:14 | <atphoenix> | there are some versions on http://web.archive.org/web/*/blogcu.com |
| 05:55:58 | <brsq> | yeah but i'm guessing most subdomains (ie. blogs) are just gone |
| 05:56:13 | <brsq> | can we query how many different subdomains are saved in internet archive? |
| 05:56:25 | <atphoenix> | there may be gaps, of course. If in the future you learn of upcoming shutdowns of other sites, it's always a good idea to let someone here know. |
| 05:56:41 | <atphoenix> | someone else may know how to query the way you are requesting |
| 05:56:50 | <atphoenix> | so hang around :) |
| 05:58:36 | <brsq> | yeah will alert you if something similar is going to happen in the future :) |
| 06:13:03 | <OrIdow6> | brsq: 129885 subdomains |
| 06:13:19 | <OrIdow6> | Including www. and no subdomain |
| 06:15:24 | <brsq> | wow thanks for looking |
| 06:15:29 | <brsq> | looks better than i imagined |
| 06:24:12 | <atphoenix> | The main thing that happens different when we are notified, is we often make an attempt to get a near complete set of the last or near-to-last version of a site (or portion of a site if only a portion, like forums, is being shutdown). The other versions in web.archive.org may be incomplete, or a mix of versions collected at widely different times. Also, especially in case of complex sites, we may have different tools |
| 06:24:12 | <atphoenix> | available than what archive.org uses as part of it's default web archiving method. |
| 06:25:16 | <OrIdow6> | brsq: Yep |
| 07:35:08 | | brsq is now authenticated as brsq |
| 08:04:40 | | brsq quits [Remote host closed the connection] |
| 08:43:18 | | quartz_ quits [Client Quit] |
| 08:45:50 | | QuartzProto (QuartzProto) joins |
| 09:24:41 | | hooway joins |
| 11:02:52 | | HackMii quits [Remote host closed the connection] |
| 11:03:11 | | HackMii (hacktheplanet) joins |
| 11:32:06 | | icedice quits [Client Quit] |
| 14:54:04 | | Arcorann_ quits [Ping timeout: 240 seconds] |
| 15:27:44 | | HackMii quits [Ping timeout: 240 seconds] |
| 15:39:17 | | HackMii (hacktheplanet) joins |
| 15:59:24 | | HackMii quits [Ping timeout: 240 seconds] |
| 16:10:08 | | HackMii (hacktheplanet) joins |
| 16:48:02 | | Craigle quits [Quit: The Lounge - https://thelounge.chat] |
| 16:49:07 | | Craigle (Craigle) joins |
| 17:57:46 | | tapos joins |
| 18:32:00 | | systwi quits [Ping timeout: 252 seconds] |
| 18:32:30 | <Dallas> | Are there any known ways to bypass cloudflares captcha when scraping pages or am I shit outta luck |
| 18:51:51 | | quartz_ joins |
| 18:54:56 | | QuartzProto quits [Ping timeout: 252 seconds] |
| 18:57:17 | | systwi (systwi) joins |
| 18:59:23 | <tapos> | I know that rippers for manga reading site in the past at least could handle CloudFlare sites |
| 19:40:36 | | DogsRNice (Webuser299) joins |
| 20:21:05 | | quartz_ is now authenticated as QuartzProto |
| 20:21:40 | | quartz_ quits [Client Quit] |
| 23:07:17 | | Arcorann_ joins |
| 23:08:14 | | Arcorann_ quits [Remote host closed the connection] |
| 23:08:37 | | Arcorann_ joins |
| 23:33:50 | <@JAA> | There's that awful Python package that can still get around it I think by running untrusted JS in Node. |
| 23:34:06 | <@JAA> | What could possibly go wrong? |
| 23:36:00 | <@JAA> | joepie wrote a parser years ago that would solve the challenge directly and I ported it to Python a while back, but Cloudflare changed their challenges since, so that's completely broken nowadays. |
| 23:36:09 | <@JAA> | I've been meaning to take another look at that but didn't get around to it yet. |
| 23:52:16 | <jodizzle> | You mean this Python package that uses node? https://github.com/Anorov/cloudflare-scrape |
| 23:52:36 | <jodizzle> | I actually think it doesn't work currently, see the issues. |