| 03:55:12 | | AlsoHP_Archivist joins |
| 03:58:17 | | HP_Archivist quits [Ping timeout: 272 seconds] |
| 04:52:39 | | DogsRNice quits [Read error: Connection reset by peer] |
| 05:02:53 | | nicolas17 quits [Ping timeout: 272 seconds] |
| 07:35:53 | | Arcorann (Arcorann) joins |
| 11:39:34 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
| 11:41:20 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
| 12:41:50 | | Arcorann quits [Ping timeout: 240 seconds] |
| 14:41:14 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
| 14:42:03 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
| 17:52:55 | | DopefishJustin quits [Remote host closed the connection] |
| 17:53:11 | | DopefishJustin joins |
| 17:53:11 | | DopefishJustin is now authenticated as DopefishJustin |
| 17:57:40 | | magmaus3 quits [Client Quit] |
| 18:08:44 | | Doranwen quits [Remote host closed the connection] |
| 18:10:18 | | Doranwen (Doranwen) joins |
| 18:15:42 | | nicolas17 joins |
| 18:25:23 | | imer quits [Killed (NickServ (GHOST command used by imer1))] |
| 18:25:47 | | imer (imer) joins |
| 20:50:09 | <nicolas17> | JAA: is the SPN API public or does it need special permissions/approval? |
| 20:50:56 | <@JAA> | nicolas17: Not sure, never used it. |
| 20:51:30 | <nicolas17> | I was considering it, but maybe I should make my script join IRC and talk to archivebot instead :p |
| 21:00:51 | <pokechu22> | Pretty sure it is public (at least I was able to save a few pages using it); I think I copied my normal IA session cookie though |
| 21:01:15 | <pokechu22> | AB might still be better for that purpose though |
| 21:02:40 | <pokechu22> | (I used the SPN API to save a page that required cookies) |
| 21:03:19 | <nicolas17> | I'm grabbing a few hundred Apple URLs every hour and putting the results in a git repo, I want to submit them to archive.org *somehow* if I detect they changed |
| 21:04:04 | <nicolas17> | they change quite infrequently but it's *possible* that there's nothing for a few days and then suddenly 20 pages change, so if I use SPN I'll need my own queueing, since they limit to 12/minute |
| 21:05:38 | <pokechu22> | Yeah, if you don't need JS or cookies or anything AB is probably preferable for that |
| 21:06:53 | <@JAA> | 12/minute? I want those numbers... |
| 21:07:05 | <nicolas17> | JAA: source https://docs.google.com/document/d/1Nsv52MvSjbLb2PCpHlat0gkzw0EvtSgpKHu4mk0MnrA/edit |
| 21:07:09 | <@JAA> | I occasionally get 429s on 2/min. |
| 21:07:12 | <nicolas17> | "Max captures per minute for authenticated users = 12 and for anonymous users = 4." |
| 21:07:29 | <@JAA> | Well <2/min, sleeping 30s between attempts. |
| 21:07:54 | <@JAA> | Maybe the POST has different rate limits than a simple GET. |
| 21:08:02 | <nicolas17> | pokechu22: there's basically two groups |
| 21:08:10 | <nicolas17> | https://mesu.apple.com/assets/com_apple_MobileAsset_UARP_A2868/com_apple_MobileAsset_UARP_A2868.xml static non-HTML files |
| 21:09:33 | <nicolas17> | https://support.apple.com/en-us/HT213781 HTML files that may have images and may have JSx |
| 21:09:38 | <nicolas17> | JS* |
| 21:09:50 | <nicolas17> | but I don't think that JS fetches other stuff |
| 21:10:00 | <nicolas17> | so we may need to grab referenced JS but not execute it |
| 21:25:10 | <nicolas17> | IRC isn't the most convenient to automatically submit things from scripts running in different places... |
| 21:27:58 | | magmaus3 (magmaus3) joins |
| 21:28:55 | <@JAA> | Rumour has it that's why I wrote http2irc. |
| 21:42:57 | <TheTechRobo> | That's just an urban legend I'm sure |
| 22:25:47 | | BearFortress__ quits [Client Quit] |
| 22:33:25 | | tbc1887 quits [Client Quit] |
| 22:34:27 | | tbc1887 (tbc1887) joins |
| 22:34:37 | <fireonlive> | ;) |
| 23:05:05 | | BearFortress joins |