HomeSearchPrevious dayNext day

00:00:38dm4v quits [Read error: Connection reset by peer]
00:03:10dm4v joins
00:03:12dm4v quits [Changing host]
00:03:12dm4v (dm4v) joins
00:05:52<nicolas17>anarcat: https://wiki.archiveteam.org/index.php/URLs
00:45:26<pabs>anarcat: you can has MR! (possibly broken, untested, especially the parameter thing)
01:03:25dm4v quits [Ping timeout: 252 seconds]
01:03:34dm4v joins
01:03:37dm4v quits [Changing host]
01:03:37dm4v (dm4v) joins
01:50:31qwertyasdfuiopghjkl94 joins
01:53:05qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
01:54:37Arcorann (Arcorann) joins
01:58:03qwertyasdfuiopghjkl94 is now known as qwertyasdfuiopghjkl
02:09:56Jake3 (Jake) joins
02:11:10Jake quits [Ping timeout: 250 seconds]
02:11:10Jake3 is now known as Jake
02:22:52ThreeHM quits [Ping timeout: 250 seconds]
02:24:56ThreeHM (ThreeHeadedMonkey) joins
02:42:36xkey quits [Client Quit]
02:43:07xkey (eyo) joins
02:56:38qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
03:07:12KiyoshiWJ joins
03:40:12Megame (Megame) joins
03:41:46qw3rty__ joins
03:45:12qw3rty_ quits [Ping timeout: 250 seconds]
03:50:54qwertyasdfuiopghjkl joins
04:27:32qwertyasdfuiopghjkl quits [Client Quit]
04:28:46qwertyasdfuiopghjkl joins
04:38:56nicolas17 quits [Ping timeout: 250 seconds]
04:45:14<KiyoshiWJ>Hi! Super new here, I wanted to ask what would be the best way to archive a site/section of a site that isn't a current project? To be specific Niconico is shutting down its Blomaga service on October 7th and I wanted to try and archive as many posts and user pages related to a community I am a part of before then.
04:49:59<KiyoshiWJ>Sorry if this is a silly question, I just figured that since you guys are pretty much professionals at this I would ask before painfully going through and adding every page to the wayback machine one by one. lol.
04:50:32<Jake>We've run some projects on other parts of niconico, let me check if we have anything for that one.
04:51:04<@OrIdow6>There has npot been a project, maybe an AB job
04:51:20<@OrIdow6>KiyoshiWJ: We intend to do it, it's just far enough in the future that no one has yet
04:52:52DogsRNice quits [Read error: Connection reset by peer]
04:58:38<Jake>well there's the answer :) we also have #niconino if you want to stick around.
05:15:44madsci joins
05:21:54<madsci>It looks like the gitorious.org archive has been offline since March 2020. I'm trying to clone a repo that never got migrated to GitLab, so the gitorious archive is my only hope. Is that archive still kicking around somewhere?
05:24:18<@OrIdow6>madsci: Try https://archive.softwareheritage.org/ ?
05:26:40<KiyoshiWJ>OrIdow6: Oh my bad, didn't realize it was planned to be done '=D
05:26:59madsci quits [Ping timeout: 244 seconds]
05:27:32<KiyoshiWJ>Jake: Yeah I am definitely going to try and stick around there, I have a pretty slow internet but I do really want to try and help
05:27:48<@OrIdow6>We'll probably start 2 weeks out or so
05:27:53<@OrIdow6>I don't think it's too big
05:28:29madsci joins
05:28:36<@OrIdow6>madsci: Try https://archive.softwareheritage.org/ ?
05:30:18<madsci>OrIdow6 found it! Thanks!
05:30:25<@OrIdow6>Np
05:54:41monoxane (monoxane) joins
06:02:07madsci quits [Ping timeout: 244 seconds]
06:08:46atphoenix_ (atphoenix) joins
06:11:25atphoenix quits [Ping timeout: 252 seconds]
06:18:13KiyoshiWJ quits [Remote host closed the connection]
06:32:04<@OrIdow6>AWS going to "enforce its removal" of "content [that] violate[s] its cloud service policies" starting "[o]ver the coming months", with more non-details - https://www.reuters.com/technology/exclusive-amazon-proactively-remove-more-content-that-violates-rules-cloud-2021-09-02/
07:29:34sonick quits [Client Quit]
08:17:46Muad-Dib quits [Ping timeout: 250 seconds]
08:22:05jspiros quits []
08:22:41<mgrandi>https://github.com/GTAmodding/re3 this repo is in danger, i have a copy of the git repo but i dunno if we have the github info scraping thing still set up
08:22:49igloo222255 joins
08:23:12Muad-Dib joins
08:23:13<mgrandi>https://wololo.net/2021/09/03/take-two-have-filed-a-lawsuit-against-the-creators-of-re3-gta-reverse-engineering-open-source-project/
08:23:33wyatt8750 joins
08:23:50wyatt8740 quits [Ping timeout: 250 seconds]
08:24:16igloo22225 quits [Ping timeout: 250 seconds]
08:24:16igloo222255 is now known as igloo22225
08:24:16jspiros (jspiros) joins
08:26:00lun4 quits [Ping timeout: 250 seconds]
08:26:00ave quits [Ping timeout: 250 seconds]
08:30:07ave (ave) joins
08:33:15Mateon2 joins
08:34:58Mateon1 quits [Ping timeout: 252 seconds]
08:34:58Mateon2 is now known as Mateon1
08:36:39lun4 (lun4) joins
08:37:20sonick (sonick) joins
08:41:46benjins quits [Ping timeout: 244 seconds]
08:52:27BlueMaxima quits [Read error: Connection reset by peer]
08:52:41BlueMaxima joins
09:47:48Ctrl-S quits []
09:47:56Ctrl-S joins
09:58:09qwertyasdfuiopghjkl65 joins
09:58:45qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
10:01:22@hook54321 quits []
10:02:39hook54321 (hook54321) joins
10:02:39@ChanServ sets mode: +o hook54321
10:09:11<duce1337>https://anime.thehylia.com/ is shutting down
10:09:44IDK (IDK) joins
10:18:01benjins joins
10:18:46<AK>JAA arkiver, https://anime.thehylia.com/ Total Archive Size: 6284 GB Total Album Size: 98 GB
10:18:53<AK>Worth putting in a project instead of AB?
10:33:25<IDK>6.2TB...
10:33:56<IDK>I don't think there is a pipeline who have over 2TB of remaining storage
10:34:32<IDK>When will the site shutdown
11:18:11qwertyasdfuiopghjkl65 is now known as qwertyasdfuiopghjkl
11:21:56wizards quits [Ping timeout: 250 seconds]
11:23:40wizards joins
11:37:06<anarcat>pabs: woot
13:09:24qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
13:17:01qwertyasdfuiopghjkl joins
13:38:49qwertyasdfuiopghjkl quits [Client Quit]
13:40:13qwertyasdfuiopghjkl joins
13:44:45Atom joins
13:46:31BlueMaxima quits [Client Quit]
13:47:55Atom-- quits [Ping timeout: 252 seconds]
14:21:30<@JAA>pabs: SPN2 API documentation exists but isn't public, as I understand it. You'd need to contact info@archive.org for details. You'd also need a secure way to include an API key, which is kind of not really possible in an open-source code without revealing the key to everyone.
14:22:23<@JAA>(Unless you do it in a 'the user needs to supply their own API key' way, but since API keys are given out manually, that may not be a good option in this case.)
14:24:40<IDK>JAA: is large site like https://anime.thehylia.com/ allowed on AB
14:24:47<IDK>Like 6.2TB
14:26:35<@JAA>IDK: I'm looking at it. By the way, disk space doesn't matter in that sense because things are uploaded continuously in chunks of about 5 GiB.
14:29:04<@JAA>AK: Downloads are limited to 10 files per 24 hours per IP unless you donate.
14:31:56<@JAA>That's for the anime section; the albums can be downloaded without limit as far as I can tell.
14:36:48<AK>Oh damn
14:37:24<@JAA>Yep. Anyone got ~2900 IPs?
14:37:42<@JAA>It'd be helpful to know when they're shutting down as well.
14:53:31<IDK>JAA: the community
14:53:38<IDK>The project community
14:54:21<IDK>If you change the Priority task on the Warrior
14:54:28<IDK>We could get some of it
14:54:55<@JAA>I know that. I don't think we have nearly 3k IPs though.
14:55:10<IDK>Atleast it would do better than AB
14:55:39<IDK>Also tor network
14:55:57<IDK>They do not have cloudfare
15:20:52Arcorann quits [Ping timeout: 252 seconds]
15:29:36xkey quits [Client Quit]
15:30:28xkey (eyo) joins
15:33:11masterX244 quits [Quit: No Ping reply in 180 seconds.]
15:34:45masterX244 (masterX244) joins
15:40:29<TastyWiener95>What is AB short for?
15:44:54<@JAA>ArchiveBot
16:28:50qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
16:28:56qwertyasdfuiopghjkl74 joins
16:39:34sonick quits [Client Quit]
16:55:11Iki quits [Ping timeout: 244 seconds]
17:19:45<themadpro>About 10 more days before the Google Drive link-killer kicks on September 13
17:20:11<themadpro>It's by no means conventional, but I've actually made a little tool
17:20:18<themadpro>https://github.com/Data-Horde/gdrivac
17:20:52<themadpro>Rather than bulk-downloading files, it allows you to associate a particular Google Account with a list of drive URLs
17:21:40<themadpro>Why? Because the entire affair is absolutely unconventional, accounts which HAVE accessed a particular shared-link at a date prior to Sep 13 will retain access beyond that point.
17:22:20<themadpro>Not seeing any interest in a GD archiving project elsewhere, I made my own "vaccine" Google-Drivac
17:22:49<themadpro>It doesn't have a lot of assurance, it comes with absolutely no guarantee...
17:22:59<themadpro>But it is what it is, so I thought that I might share it here
17:23:35<themadpro>Testers and Feedback would be greatly appreciated
17:41:10qwertyasdfuiopghjkl74 quits [Ping timeout: 244 seconds]
17:44:25katocala quits [Ping timeout: 252 seconds]
17:58:15<@JAA>themadpro: #googlecrash
18:18:43HackMii quits [Ping timeout: 258 seconds]
18:19:38HackMii (hacktheplanet) joins
18:21:12Megame quits [Client Quit]
18:53:23nicolas17 joins
19:56:50<rewby>Apparently gm.town is shutting down. Found on Twitter: https://twitter.com/gmtheapp/status/1433840472577957891?s=19
20:33:33LeGoupil joins
20:34:05<Frogging101>What was this?
20:57:26LeGoupil quits [Client Quit]
21:00:09gido5731 (gido5731) joins
21:07:44<gido5731>Hey I'm someone who has been contributing to the a-team warriors for a while and was just cruising up the archiveteam tracker sites/wiki and it occurred to me there might be a better use for some of my idle network by you guys directly, so (and tell me if this is the wrong place to ask) is there a use you guys have for a few TB or storage, a few 1G connections (though the one I use for my archiveteam stuff rn is a spare comcast r
21:07:44<gido5731>esidential one which is something like a 200/20mb connection), all of which with ipv6 support and a *few* public IPv4 addresses I can also play with. I don't have a ton compute-wise but I do have a bit of CPU resources for basic processing. Anyway, @ me if any of that would be useful
22:13:46sonick (sonick) joins
22:45:52katocala joins
22:49:36AntiLiberal joins
22:56:08AntiLiberal quits [Ping timeout: 250 seconds]
23:36:41BlueMaxima joins
23:55:45wickedplayer494 quits [Ping timeout: 244 seconds]
23:57:17wickedplayer494 joins

HomeSearchPrevious dayNext day