| 00:08:38 | <Ryz> | Any updates on the UK web domains situation due to Brexit? Less than 2 months left oo; |
| 00:13:13 | | Sanqui quits [Ping timeout: 244 seconds] |
| 00:14:12 | <OrIdow6> | Just thinking about that |
| 00:14:17 | <OrIdow6> | To my knowledge, no |
| 00:14:40 | | Sanqui joins |
| 00:14:41 | | Sanqui is now authenticated as Sanqui |
| 00:16:12 | <OrIdow6> | My idea on that is still a two-crawl approach: first, get all (that you can find) .eu domains, but only the front page (and possibly "interesting" pages, e.g. /contact if the link exist); then look at the results and try figure out which are likely in the UK; then get those |
| 00:17:35 | <OrIdow6> | *try to figure |
| 00:19:12 | | lennier2 joins |
| 00:21:44 | | lennier1 quits [Ping timeout: 240 seconds] |
| 00:21:53 | | lennier2 is now known as lennier1 |
| 00:51:19 | <purplebot> | Deathwatch edited by JustAnotherArchivist (+86, /* 2020 */ Fix Smack Jeeves entry) just now -- https://www.archiveteam.org/?diff=45762&oldid=45760 |
| 01:02:42 | <@arkiver> | I'll bring this up with IA as well, they might have connections |
| 01:02:58 | <@arkiver> | OrIdow6: Ryz ^ |
| 01:16:39 | | lunik1 quits [Quit: :x] |
| 01:23:46 | | lunik1 joins |
| 01:46:33 | | Craigle (Craigle) joins |
| 02:10:32 | <OrIdow6> | Ok |
| 02:48:07 | | @arkiver quits [Excess Flood] |
| 02:49:02 | | arkiver (arkiver) joins |
| 02:49:02 | | @ChanServ sets mode: +o arkiver |
| 03:31:17 | <@arkiver> | were some people already working on the chrome store data? |
| 03:33:29 | <OrIdow6> | Looks like tech234a did a bit on discovery |
| 03:33:43 | <OrIdow6> | https://gist.github.com/tech234a/44cf6d692f6c1c17807bacc26a5485dc https://gist.github.com/tech234a/9ee4ee9489f4ca1a03e3c7e144db7f91 |
| 03:33:53 | <OrIdow6> | Also there is a channel #chromeweblore |
| 03:33:56 | <OrIdow6> | With no ops |
| 03:34:23 | <@arkiver> | thanks OrIdow6 |
| 03:34:50 | <tech234a> | it looks like Kiska was op in that channel at one point |
| 03:35:10 | <tech234a> | IDK if they rejoin perhaps they'll get ops back? |
| 03:35:11 | <OrIdow6> | So everybody should join, to definitively prevent ops |
| 03:36:32 | <@kiska> | I guess you can go and bug someone to give ops back? |
| 03:37:10 | <@JAA> | Either that or cycle the channel. |
| 03:37:10 | <OrIdow6> | (Probably should've PMd the channel anme instead of mentioned it here) |
| 03:53:33 | <@kiska> | fionera: Can I pls have op back in #chromeweblore :P |
| 04:03:19 | <purplebot> | Videok.hu edited by Bzc6p (+362, saved) just now -- https://www.archiveteam.org/?diff=45763&oldid=45601 |
| 04:25:35 | | wickedplayer494 quits [Read error: Connection reset by peer] |
| 04:27:11 | | wickedplayer494 joins |
| 04:27:25 | | wickedplayer494 is now authenticated as wickedplayer494 |
| 04:35:16 | | wickedplayer494 quits [Remote host closed the connection] |
| 04:40:39 | | wickedplayer494 joins |
| 04:41:20 | | wickedplayer494 is now authenticated as wickedplayer494 |
| 04:50:10 | | qw3rty_ joins |
| 04:53:30 | | qw3rty__ quits [Ping timeout: 252 seconds] |
| 05:29:33 | | @arkiver quits [Excess Flood] |
| 05:30:20 | | arkiver (arkiver) joins |
| 05:30:20 | | @ChanServ sets mode: +o arkiver |
| 06:12:32 | | systwi quits [Ping timeout: 252 seconds] |
| 06:29:54 | | systwi (systwi) joins |
| 07:49:18 | <purplebot> | Deathwatch edited by JustAnotherArchivist (+256, /* 2021 */ Add Khan Academy's MCAT …) just now -- https://www.archiveteam.org/?diff=45764&oldid=45762 |
| 07:54:34 | | godane1 joins |
| 07:56:36 | | godane quits [Read error: Connection reset by peer] |
| 08:16:49 | | Craigle quits [Ping timeout: 244 seconds] |
| 08:29:51 | | Craigle (Craigle) joins |
| 09:21:24 | | mutantmonkey quits [Ping timeout: 240 seconds] |
| 09:34:32 | | mutantmonkey (mutantmonkey) joins |
| 09:54:30 | | Zerote_ joins |
| 09:57:24 | | Zerote quits [Ping timeout: 240 seconds] |
| 10:15:34 | | fuzzy802 joins |
| 10:18:04 | | fuzzy8021 quits [Ping timeout: 240 seconds] |
| 10:18:51 | | britmob2 quits [Quit: Ping timeout (120 seconds)] |
| 10:19:04 | | Kenshin quits [Ping timeout: 240 seconds] |
| 10:19:07 | | britmob2 joins |
| 10:19:13 | | Kenshin joins |
| 10:42:39 | | @arkiver quits [Excess Flood] |
| 10:43:27 | | arkiver (arkiver) joins |
| 10:43:27 | | @ChanServ sets mode: +o arkiver |
| 11:03:12 | | mutantmonkey quits [Remote host closed the connection] |
| 11:06:25 | | mutantmonkey (mutantmonkey) joins |
| 13:02:50 | | lunik1 quits [Client Quit] |
| 13:03:13 | | lunik1 joins |
| 13:11:16 | | lunik1 quits [Client Quit] |
| 13:14:54 | | lunik1 joins |
| 13:40:03 | | Craigle quits [Read error: Connection reset by peer] |
| 13:41:20 | | Craigle (Craigle) joins |
| 13:50:56 | | mutantmonkey quits [Remote host closed the connection] |
| 13:51:17 | | mutantmonkey (mutantmonkey) joins |
| 14:06:03 | | mutantmonkey quits [Remote host closed the connection] |
| 14:06:24 | | mutantmonkey (mutantmonkey) joins |
| 14:09:11 | | Craigle quits [Ping timeout: 244 seconds] |
| 14:20:59 | | Craigle (Craigle) joins |
| 14:29:11 | | Arcorann quits [Ping timeout: 252 seconds] |
| 14:34:31 | | SketchTh1Cow joins |
| 14:35:37 | | SketchTheCow quits [Read error: Connection reset by peer] |
| 15:18:10 | | @arkiver quits [Excess Flood] |
| 15:19:03 | | arkiver (arkiver) joins |
| 15:19:03 | | @ChanServ sets mode: +o arkiver |
| 15:37:41 | | s-crypt8 (s-crypt) joins |
| 15:38:00 | | s-crypt quits [Read error: Connection reset by peer] |
| 15:38:00 | | s-crypt8 is now known as s-crypt |
| 15:38:00 | | Zerote_ quits [Read error: Connection reset by peer] |
| 15:38:21 | | Zerote_ joins |
| 15:40:04 | | wickedplayer494 quits [Ping timeout: 240 seconds] |
| 15:40:39 | | wickedplayer494 joins |
| 16:33:10 | | @arkiver quits [Excess Flood] |
| 16:34:05 | | arkiver (arkiver) joins |
| 16:34:05 | | @ChanServ sets mode: +o arkiver |
| 16:43:44 | | balrog quits [Ping timeout: 240 seconds] |
| 16:49:15 | | balrog joins |
| 16:49:16 | | balrog is now authenticated as balrog |
| 17:15:40 | | @arkiver quits [Excess Flood] |
| 17:16:43 | | arkiver (arkiver) joins |
| 17:16:43 | | @ChanServ sets mode: +o arkiver |
| 17:23:41 | | @arkiver quits [Excess Flood] |
| 17:23:57 | | arkiver (arkiver) joins |
| 17:23:57 | | @ChanServ sets mode: +o arkiver |
| 19:07:34 | | @arkiver quits [Excess Flood] |
| 19:08:31 | | arkiver (arkiver) joins |
| 19:08:31 | | @ChanServ sets mode: +o arkiver |
| 19:11:41 | | lennier2 joins |
| 19:15:32 | | lennier1 quits [Ping timeout: 252 seconds] |
| 19:15:32 | | lennier2 is now known as lennier1 |
| 20:32:11 | | atphoenix quits [Remote host closed the connection] |
| 20:32:47 | | atphoenix joins |
| 21:04:11 | | @arkiver quits [Excess Flood] |
| 21:05:03 | | arkiver (arkiver) joins |
| 21:05:03 | | @ChanServ sets mode: +o arkiver |
| 21:32:15 | | treora joins |
| 21:38:14 | | @arkiver quits [Excess Flood] |
| 21:39:13 | | arkiver (arkiver) joins |
| 21:39:13 | | @ChanServ sets mode: +o arkiver |
| 21:59:46 | | Arcorann (Arcorann) joins |
| 22:09:38 | | Suika (Suika) joins |
| 22:10:19 | <SketchTh1Cow> | So, FOS |
| 22:10:30 | <SketchTh1Cow> | I think you folks are pumping in A LOT OF DATA |
| 22:10:38 | <SketchTh1Cow> | I am pumping it out very quickly, but that's still A LOT OF DATA |
| 22:10:44 | <SketchTh1Cow> | So it can't catch breath |
| 22:10:50 | | SketchTh1Cow is now known as SketchTheCow |
| 22:11:42 | <SketchTheCow> | I mean, shit's flying out at 24.22MiB/s to 38.50MiB/s |
| 22:29:07 | <Suika> | Sup. A site named yiff.party died a few days ago taking all content with it. I'm probably one of few people who have almost complete scrape of that site ~32T. Now I have two questions: |
| 22:29:27 | <Suika> | 1. Will IA accept the data? (probably yes) |
| 22:30:54 | <Suika> | 2. Is there someone in germany to whom I can give the data on foot? Since uploading 32TB of data will take >120 days |
| 22:31:34 | <OrIdow6> | Accepting the data as an upload =/= it gets into the Wayback Machine |
| 22:34:46 | <@Fusl> | Suika: how far are you from dusseldorf? |
| 22:35:40 | <Suika> | 1h |
| 22:36:27 | <@Fusl> | you willing to drive there? |
| 22:37:31 | <Suika> | Yeh, don't see a problem. |
| 22:40:14 | <Suika> | It will take a bit of time for me to consolidate the data onto 4 disks and recalculate the parity, but after that I can pull out the disks and drive over there. |
| 22:47:45 | | wickedplayer494 is now authenticated as wickedplayer494 |
| 22:52:09 | <SketchTheCow> | What form is the data in? |
| 22:52:19 | <SketchTheCow> | WARC? .tif? .tar? .zip? |
| 22:52:24 | <SketchTheCow> | .uu? |
| 22:53:44 | <@Fusl> | .uwu |
| 22:53:55 | <@Fusl> | Suika: bring a 1U server |
| 22:56:34 | <Suika> | None of my 1Us have 3.5". And the current data server is 4U... so that might be a bit problematic. |
| 22:58:23 | <Suika> | The data I have mirrors the original server structure. So I have the JSON/HTML files + most of the data that was behind the urls. No thumbs tho, I can regenerate them. |
| 23:00:46 | <Suika> | And for record, I do not intend to move my 4U. I don't even think I can get it out of the rack. That is a horror you do not want to know about. |
| 23:07:53 | <SketchTheCow> | Two days of archivebot have put 7.7tb of data into the IA server. |
| 23:07:55 | <SketchTheCow> | This is a lot. |
| 23:14:23 | <Suika> | I'm in no hurry to move the data and unless 6 disks die in my system, the data will not vanish. |
| 23:31:32 | | marked1957 quits [Quit: The Lounge - https://thelounge.chat] |
| 23:32:09 | | marked1957 joins |
| 23:38:25 | <mgrandi> | Do we want to archive that? Yiff.party was a "stolen" patron / other pay site archive |
| 23:40:41 | <mgrandi> | If the answer is yes, I might recommend splitting it up by the "patreon/paysite" user it comes from, because people are going to 100% dcma it because it will basically be a free copy of their work that a lot of them are currently selling |
| 23:41:11 | <mgrandi> | And if it's in a giant archive with everything that might make the entire thing have to come down |
| 23:45:13 | <mgrandi> | It's a weird situation because the "source" of everything on that site has not disappeared, it's just a pirate site of it, but there is a non 0 possibility that someone had their patreon banned, artist disappeared, etc, and this could be the only copy of said work |
| 23:49:44 | | Barto quits [Ping timeout: 240 seconds] |
| 23:51:08 | <Suika> | The main reason behind question #1. So it's up to you. ¯\_(ツ)_/¯ |
| 23:51:53 | <mgrandi> | Either way, is it already organized by patreon/pay site userm |
| 23:52:11 | <mgrandi> | ?* That is the first step in making the data sorta usable |
| 23:57:50 | | Barto (Barto) joins |