00:12:38 | | IDK quits [Client Quit] |
00:20:00 | <Ryz> | Okay, it's a new day; time to log into the Internet Archive and do some testing, mainly whether the problems have been cleared up o#o; |
00:20:29 | <Ryz> | Nice to see that just typing https://archive.org/login redirects to https://archive.org/account/login |
00:21:28 | <Ryz> | Daily captures has been reset back to 0, nice~ |
00:22:05 | <Ryz> | Time to do the https://web.archive.org/save/somerandomURLhere thing while logged in, if it works |
00:22:51 | <Ryz> | It's going through, although oddly it doesn't seem to reflect that there's slots being used...? |
00:23:23 | <Ryz> | I just did 3 because that's the usual limit when doing it without an Internet Archive account |
00:24:22 | <Ryz> | One of the captures through that way is successful, although it doesn't reflect the number counting at all? Wha? |
00:24:56 | <Ryz> | JAA? Help...? |
00:25:16 | <@JAA> | No idea, I've never used SPN with an account. |
00:25:57 | <Ryz> | Anyone else...? |
00:26:16 | <Ryz> | nicolas17? pokechu22? Since you two queued me on the details and thoughts |
00:26:44 | <pokechu22> | I don't really use it without an account either |
00:29:54 | <Ryz> | Mmm, I did more than 3, like 4, and it hit the limit as if I was logged out... :/ |
00:31:23 | <Ryz> | Sorry, not limit, but concurrency of saves~ |
00:34:43 | | pabs quits [Remote host closed the connection] |
00:35:04 | <Ryz> | Ugh, this is actually pretty disappointing... :c |
00:35:41 | <pokechu22> | Yeah, the account doesn't give you a higher concurrency limit, just a higher per-day limit IIRC |
00:36:34 | <Ryz> | But, the saves via https://web.archive.org/save/somerandomURLhere do not count towards the number when checking https://web.archive.org/save/status/user |
00:36:36 | | pabs (pabs) joins |
00:36:53 | <Ryz> | Also, instead of 3, it's 7 per minute~ |
00:42:11 | <Ryz> | Checking that I can archive 7 links in a moment |
00:42:16 | <Ryz> | Via logged in account |
00:42:44 | <Ryz> | Yes I can archive 7 links per minute~ |
00:43:19 | <Ryz> | That might be dangerous though for websites that are too sensitive to do that...which is one of the reasons why I'm unlikely to use outlinks |
01:03:09 | | nicolas17 quits [Client Quit] |
01:04:51 | | nicolas17 joins |
01:12:44 | <Ryz> | I guess I could readjust with the additional concurrency when logged in, but I would want the convenience of tossing it in if possible :c |
01:38:02 | <@JAA> | My poor item's server still has no mate. :-( |
01:43:05 | <fireonlive> | :( |
01:43:23 | <fireonlive> | fireonlive 🤝🏻 JAA’s item’s server |
01:47:55 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
01:48:49 | | Nulo|m joins |
01:49:10 | <Nulo|m> | hi, how can i download all archives of a set of pages (searching by prefix) off of the wayback machine? is this the right place to ask? |
01:49:30 | <fireonlive> | Nulo|m: ive used this before, not sure if it’s still good though: https://github.com/hartator/wayback-machine-downloader |
01:50:00 | <fireonlive> | (originally via ruby directly then later via docker) |
01:50:45 | <Nulo|m> | fireonlive: sick, thanks |
01:50:50 | <fireonlive> | :) |
01:52:06 | <Nulo|m> | this is just what i wanted \o/ |
01:54:18 | <fireonlive> | sweet! hope it works well |
03:38:01 | <pabs> | Ryz: an account with IA SPN2 also lets you save outlinks, which is very useful sometimes |
03:39:02 | <Ryz> | It can be useful, I don't wanna use too much of it because of making those websites get annoyed by the WBM SPN stuff if that makes sense ><; |
03:39:06 | <pabs> | oh, already discussed |
03:39:16 | <pabs> | ack |
03:39:49 | <pabs> | I tend to only use SPN2 for saving linkedin front pages of dead companies/people |
03:39:58 | <pabs> | (since AB can't do linkedin) |
03:40:50 | <pabs> | wayback-machine-downloader is definitely the best IA CDX client, after I fixed some things :) |
03:40:52 | | qwertyasdfuiopghjkl quits [Client Quit] |
03:41:26 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
03:43:27 | <Ryz> | Oh, huh, you can do that? Okay that is some neat information, yay~ |
03:44:08 | <Ryz> | ...Anyway, I still can't really do my thing that I usually do when it comes to archiving countless pages via WBM SPN :C |
04:00:44 | <pabs> | whats the reason for that? |
04:09:27 | | Justin[home] is now known as DopefishJustin |
04:15:05 | <qwertyasdfuiopghjkl> | (replying to https://irclogs.archivete.am/internetarchive/2024-03-09#l8cf17971 ) Ryz: Directly going to https://web.archive.org/save/https://example.com/ and using the form at https://web.archive.org/save/ have separate rate limits, https://web.archive.org/save/status/user only shows the latter. |
04:30:08 | <@JAA> | 1184/6112 [42:37<3:50:56, 2.81s/MiB] |
04:30:10 | <@JAA> | IA pls |
04:50:19 | <Ryz> | ...There's separate limits? Uuuuuugh <#>; |
05:37:41 | | pabs lol |
06:50:11 | | pabs quits [Remote host closed the connection] |
06:55:02 | | pabs (pabs) joins |
07:23:45 | <@JAA> | Hmm, I'm actually seeing other tasks running just fine on this server. |
07:24:40 | <@JAA> | Including the backup server sync and all. |
07:35:37 | <@JAA> | I poked it with a stick, and everything's fine now. It was only a VirusCheck task anyway. :-P |
07:42:02 | <fireonlive> | :P |
13:24:09 | | Arcorann quits [Ping timeout: 272 seconds] |
13:52:39 | | f_ quits [Ping timeout: 272 seconds] |
14:44:49 | | f_ (funderscore) joins |
15:13:32 | | HP_Archivist (HP_Archivist) joins |
15:37:35 | <Ryz> | It's a bit curious that when accessing https://web.archive.org/save/status/user while logged in, and while doing an archive via WBM SPN, that it hangs in the middle of it sometimes |
15:41:01 | <Ryz> | Oh yeah, I'm not sure on my feelings on the Internet Archive using Google reCAPTCHA when creating an account there; I wonder if it would be possible for them to switch to hCaptcha instead, a bit more thinking out loud kind of feeling~ |
15:42:37 | <Ryz> | For those that use IA for archiving links via WBM SPN, is there a limit on how many outlinks it would grab? |
15:44:18 | <Ryz> | Because it looks like it's 40 max? |
16:20:09 | | IDK (IDK) joins |
16:32:10 | <qwertyasdfuiopghjkl> | According to https://docs.google.com/document/d/1Nsv52MvSjbLb2PCpHlat0gkzw0EvtSgpKHu4mk0MnrA/edit#heading=h.4rhr4a7v6a1q it's 100 |
16:51:04 | | HP_Archivist quits [Client Quit] |
17:14:23 | | f_ quits [Remote host closed the connection] |
17:14:36 | | f_ (funderscore) joins |
17:55:59 | <pokechu22> | I think it might depend on the load; it definitely used to be 100 but then I've seen it be 70 or 50 |
18:08:38 | | DogsRNice joins |
18:11:09 | | DogsRNice_ joins |
18:15:04 | | DogsRNice quits [Ping timeout: 255 seconds] |
19:13:45 | | rewby quits [Ping timeout: 272 seconds] |
19:24:36 | <nicolas17> | 3737/4458 [5:01:19<1:13:57, 6.16s/MiB] |
19:24:39 | <nicolas17> | ia pls |
20:33:28 | | DopefishJustin quits [Remote host closed the connection] |
20:45:19 | | DopefishJustin joins |
20:45:19 | | DopefishJustin is now authenticated as DopefishJustin |
20:55:43 | | systwi quits [Ping timeout: 272 seconds] |
21:06:01 | | driib quits [Client Quit] |
21:06:40 | | Sanqui quits [Quit: .] |
21:16:01 | | driib (driib) joins |
21:21:21 | | systwi (systwi) joins |
21:26:09 | <nicolas17> | 4458/4458 [5:45:26<00:00, 4.65s/MiB] |
21:26:14 | <nicolas17> | yay |
21:30:16 | | Sanqui joins |
21:30:18 | | Sanqui is now authenticated as Sanqui |
21:30:18 | | Sanqui quits [Changing host] |
21:30:18 | | Sanqui (Sanqui) joins |
22:38:22 | | Arcorann (Arcorann) joins |