| 00:00:13 | <mgrandi> | Switch will be a pain in the butt when we get to SMM2 |
| 00:00:25 | <mgrandi> | And I have no idea what to do with the smm on the 3ds |
| 00:00:40 | <benjins> | https://github.com/Kinnay/NintendoClients/blob/master/examples/wiiu/donkeykong.py#L12 tells you what data you need to get |
| 00:15:37 | <tech234a> | Also worth looking into is the Pretendo Network project; they've been working on reimplementing Wii U online servers for various services, and some people in the community seem interested in the Mario Maker shutdown. It seems the developers have been focusing on reimplementing Miiverse at the moment https://pretendo.network/ |
| 00:24:52 | | VADemon quits [Client Quit] |
| 00:29:50 | <tech234a> | Also this person seems to have grabbed a lot of Mario Maker data, has anyone tried contacting them? https://twitter.com/Jaku/status/984151380259692544 |
| 00:32:18 | <purplebot> | ITunesU edited by Kyndigs (+513, /* Beyond Campus */) just now -- https://www.archiveteam.org/?diff=45798&oldid=45778 |
| 00:32:18 | <purplebot> | Chrome Web Store edited by Lennier1 (-1, Add project IRC channel) just now -- https://www.archiveteam.org/?diff=45799&oldid=45662 |
| 02:03:40 | <lennier1> | There's a Mario Maker collection here. https://the-eye.eu/public/Games/MarioMaker/ |
| 02:04:24 | <lennier1> | "This collection contains Super Mario Maker courses downloaded from smmdb.ddns.net...The content was dumped 22.-23. Jan 2018." |
| 02:51:26 | <@arkiver> | I remember some (photo?) website shutting down, but it might not have been added to the deathwatch page yet |
| 02:51:51 | <@arkiver> | anyone know of stuff shutting down that's not on the deathwatch page yet? |
| 03:00:46 | <OrIdow6> | arkiver: Here's my list https://transfer.notkiska.pw/C54Qb/todo |
| 03:01:05 | <OrIdow6> | All non-English stuff |
| 03:03:18 | <purplebot> | Deathwatch edited by JustAnotherArchivist (+443, /* 2020 */ Add Adobe Flash and …) just now -- https://www.archiveteam.org/?diff=45800&oldid=45795 |
| 03:24:36 | <@kiska> | arkiver: This https://www.smackjeeves.com/ |
| 03:24:38 | <@kiska> | ?\ |
| 03:24:53 | <@JAA> | kiska: That's on Deathwatch. |
| 03:25:04 | <@kiska> | Is it :D |
| 03:29:18 | <purplebot> | Deathwatch edited by JustAnotherArchivist (+345, /* 2021 */ Add Unity Connect and …) 23 minutes ago -- https://www.archiveteam.org/?diff=45801&oldid=45800 |
| 04:40:01 | | qw3rty_ joins |
| 04:43:38 | | qw3rty__ quits [Ping timeout: 252 seconds] |
| 04:52:50 | | Zopolis4 quits [Remote host closed the connection] |
| 06:07:58 | | Zopolis4 joins |
| 07:23:40 | | betamax quits [Ping timeout: 252 seconds] |
| 07:24:17 | | betamax (betamax) joins |
| 08:42:31 | | hooway joins |
| 09:01:43 | | godane quits [Client Quit] |
| 10:08:52 | | Jeroentje joins |
| 10:09:29 | <jodizzle> | Does 9lives.be need anything other than archivebot? I can't tell |
| 10:09:40 | <Jeroentje> | jodizzle I won't be here for too long, I'm on my work laptop and haven't configured my ZNC yet. |
| 10:10:15 | <jodizzle> | Oh, that's fine. I just meant further discussion for anyone interested (since we try to keep #archiveteam as an annoucement channel) |
| 10:10:30 | <Jeroentje> | I've only visited 9lives occasionally when looking up gaming things, I wouldn't really know. However it's packed with a lot of gaming chats on the forums. |
| 10:10:44 | <jodizzle> | So is it mostly a forum? |
| 10:11:25 | <Jeroentje> | There's also reviews and news. |
| 10:11:35 | <Jeroentje> | If you need help translating specific parts, please do ask me./ |
| 10:12:08 | <jodizzle> | Sure, thanks |
| 10:12:19 | <Jeroentje> | Looks like there's videos as well, however these seem to be hosted on YouTube already. However the announcement also said that they'd be closing their social media accounts. |
| 10:13:20 | <jodizzle> | Okay, we can get those pretty easily. |
| 10:14:08 | <jodizzle> | Hmm, I guess I'll put this on the Deathwatch wiki page to be safe, but it may just need archivebot. |
| 10:14:55 | <Jeroentje> | If it ever gets put as a preferred project my warriors will help grabbing it all. |
| 10:18:18 | <Jeroentje> | I should probably configure my warriors to each use a different IP address, since my server has 15 IPv4 addresses. |
| 10:19:19 | <purplebot> | Deathwatch edited by Jodizzle (+253, /* 2021 */ Add 9lives) just now -- https://www.archiveteam.org/?diff=45802&oldid=45801 |
| 10:19:27 | <jodizzle> | Yes, that would probably be better. Especially since I think the only project working on warriors right now is urlteam? |
| 10:20:03 | <jodizzle> | Where the main constraint is IP addresses, as far as I know. |
| 10:20:56 | <Jeroentje> | I think I've been blocked many times before on my server, especially during high priority projects. |
| 10:21:37 | <Jeroentje> | I'm not even sure if my warriors work right now, I had to re-install the server and restored the docker images. Could be that they're in limbo or not up at all. |
| 10:21:53 | | Arcorann quits [Ping timeout: 252 seconds] |
| 10:23:23 | <jodizzle> | If you're about to stick around/come back later, there are some people here who know more about the current state of warriors. My understanding is that most new projects can't use the standard warrior setup, so it's just urlteam. |
| 10:24:33 | | Arcorann (Arcorann) joins |
| 10:25:33 | <Jeroentje> | Is it due to firewalls/rate-limiting, variables or enforced logins? Because 9lives.be seems to be a decent site for the warriors. They've also been here since 2001 so there's a lot of content. |
| 10:29:21 | <OrIdow6> | It's because recent additions to the wget fork that ArchiveTeam uses depends on libraries the warrior doesn't have |
| 10:29:22 | <jodizzle> | So for DPoS projects that might go on warriors (https://archiveteam.org/index.php?title=DPoS), there's some custom scripting and setup required. We tend to use that for very large sites, sites that need a lot of IPs, or sites where we need some kind of custom crawl behavior. For most other things, we just use #archivebot. |
| 10:30:11 | <jodizzle> | Ah, right. What OrIdow6 said is why warriors specifically are broken. |
| 10:31:18 | <jodizzle> | There are ways to run DPoS projects other than with a warrior, though, which is how people have been participating in them more recently. |
| 10:33:04 | <jodizzle> | Jeroentje: If you use Docker, there's usually a Dockerfile for each of the new DPoS projects. For example, here's one that's running right now: https://github.com/ArchiveTeam/urls-grab |
| 10:34:19 | <purplebot> | Webzdarma edited by Sanqui (+629, add job list) just now -- https://www.archiveteam.org/?diff=45803&oldid=45573 |
| 10:34:30 | <OrIdow6> | Docker images are also published on some site |
| 10:34:49 | <OrIdow6> | It used to be Dockerhub but IIRC it moved a few weeks ago, and I don't know where to |
| 10:37:35 | <OrIdow6> | Anyhow, |
| 10:37:44 | <OrIdow6> | eyeballing it, that forum looks to be ~300k threads |
| 10:40:02 | <fuzzy8021> | docker images are available at atdr.meo.ws/archiveteam/${PROJECT}-grab |
| 10:41:23 | <OrIdow6> | Oh, thank you |
| 10:45:35 | <jodizzle> | Hmm, I don't really have a good sense of whether 300k threads is "too much" or not for AB |
| 10:46:05 | <jodizzle> | But forums generally take longer, and I feel like that's a big forum |
| 10:48:07 | <OrIdow6> | Oh, I was way off |
| 10:48:09 | <OrIdow6> | 701771 |
| 10:49:18 | <jodizzle> | lol, even worse |
| 11:41:18 | <purplebot> | Keybase edited by Sanqui (+204) just now -- https://www.archiveteam.org/?diff=45804&oldid=44428 |
| 11:52:20 | | Zopolis4 quits [Ping timeout: 244 seconds] |
| 12:01:07 | | Jeroentje quits [Ping timeout: 244 seconds] |
| 12:10:48 | | Jeroentje joins |
| 12:30:42 | | VADemon joins |
| 13:15:20 | | Ryz quits [Remote host closed the connection] |
| 13:16:10 | | Ryz (Ryz) joins |
| 13:32:33 | <@JAA> | 700k threads with offsite links is going to take several months and might not finish in time with AB. |
| 13:32:42 | <@JAA> | Without offsite, *maybe*. |
| 15:01:20 | <benjins> | !averybig aysora0818 |
| 15:01:33 | <benjins> | !averybig https://www.youtube.com/c/FilmmakerIQ |
| 15:01:52 | <benjins> | whoops |
| 15:29:18 | | Ryz quits [Client Quit] |
| 15:29:54 | | Ryz (Ryz) joins |
| 15:48:57 | | Jeroentje quits [Remote host closed the connection] |
| 16:05:07 | | Jake5 (Jake) joins |
| 16:06:44 | | Jake quits [Ping timeout: 240 seconds] |
| 16:06:44 | | Jake5 is now known as Jake |
| 16:23:47 | | Arcorann quits [Ping timeout: 252 seconds] |
| 16:28:04 | | lennier1 quits [Ping timeout: 240 seconds] |
| 16:29:05 | | lennier1 (lennier1) joins |
| 19:01:09 | <jodizzle> | Hm okay, so for the forum I guess that leaves DPoS or qwarc. Maybe we can get the non-forum parts in AB. |
| 20:00:18 | <purplebot> | Deathwatch edited by Jodizzle (+34, /* 2021 */ Add size detail to 9lives) just now -- https://www.archiveteam.org/?diff=45805&oldid=45802 |
| 20:18:33 | <SketchTheCow> | JAA: So, it appears teamarchive1 is .... working at drawing down the incoming data. |
| 20:19:02 | <SketchTheCow> | So it's not a magic bullet, but it does give is a little more flexibility as a release valve if teamarchive2 gets stuffed. All we can hope for, I guess. |
| 20:43:08 | <@JAA> | SketchTheCow: Yep, I've been keeping an eye on it as well, and both are slowly dropping, so that's good. AB isn't very busy at the moment though, which obviously helps. I've *finally* started working on the concrete design of the new uploader, by the way, so hopefully that can take over soon™ and those two machines can handle it until then even if things get more active again. |
| 20:58:10 | <Ryz> | !ig ahzflg8y7dcncv98f7ad9w6om ^https?://vp\.nyt\.com/ |
| 20:58:10 | <Ryz> | !ig ahzflg8y7dcncv98f7ad9w6om ^https?://video1\.nytimes\.com/ |
| 20:58:12 | <Ryz> | Oops |
| 21:03:34 | | Jake quits [Client Quit] |
| 21:04:07 | | Ryz8 (Ryz) joins |
| 21:04:30 | | _EggplantN joins |
| 21:04:32 | | xit5 joins |
| 21:04:32 | | VADemon_ joins |
| 21:04:34 | | Hecz quits [Read error: Connection reset by peer] |
| 21:04:38 | | Ryz quits [Read error: Connection reset by peer] |
| 21:04:39 | | Jake (Jake) joins |
| 21:04:45 | | @dxrt quits [Quit: ZNC - http://znc.sourceforge.net] |
| 21:04:48 | | nyany quits [Quit: (516): and then you went into taco bell without pants...and surprisingly you weren't the only one there without pants] |
| 21:04:51 | | Hecz joins |
| 21:04:52 | | Hecz is now authenticated as Hecz |
| 21:04:52 | | Hecz quits [Changing host] |
| 21:04:52 | | Hecz (Hecz) joins |
| 21:04:54 | | Ryz8 is now known as Ryz |
| 21:04:57 | | simon816 quits [Read error: Connection reset by peer] |
| 21:04:59 | | nyany (nyany) joins |
| 21:05:03 | | dxrt joins |
| 21:05:06 | | dxrt is now authenticated as dxrt |
| 21:05:06 | | dxrt quits [Changing host] |
| 21:05:06 | | dxrt (dxrt) joins |
| 21:05:06 | | @ChanServ sets mode: +o dxrt |
| 21:05:24 | | HP_Archivist quits [Ping timeout: 240 seconds] |
| 21:05:24 | | xit quits [Ping timeout: 240 seconds] |
| 21:05:24 | | xit5 is now known as xit |
| 21:05:34 | | Doranwen quits [Remote host closed the connection] |
| 21:05:44 | | EggplantN quits [Ping timeout: 240 seconds] |
| 21:05:57 | | Doranwen joins |
| 21:06:12 | | simon816 (simon816) joins |
| 21:07:44 | | VADemon quits [Ping timeout: 240 seconds] |
| 21:19:25 | | _EggplantN is now known as EggplantN |
| 22:07:45 | | HP_Archivist (HP_Archivist) joins |
| 22:11:25 | | Arcorann (Arcorann) joins |
| 22:12:26 | | Arcorann quits [Remote host closed the connection] |
| 22:12:48 | | Arcorann (Arcorann) joins |