00:02:19DopefishJustin quits [Remote host closed the connection]
00:07:01DopefishJustin joins
00:22:46IDK quits [Client Quit]
01:52:43monika quits [Quit: Zzz]
01:55:47monika (boom) joins
02:56:11qwertyasdfuiopghjkl quits [Client Quit]
03:35:45Arcorann_ quits [Ping timeout: 258 seconds]
03:37:40TheTechRobo quits [Ping timeout: 258 seconds]
04:30:35qwertyasdfuiopghjkl joins
04:31:22pabs quits [Remote host closed the connection]
04:33:11pabs (pabs) joins
04:49:59qw3rty__ joins
04:53:42qw3rty_ quits [Ping timeout: 244 seconds]
06:04:52pabs quits [Ping timeout: 258 seconds]
06:07:53pabs (pabs) joins
06:14:27HP_Archivist quits [Ping timeout: 258 seconds]
06:57:00<@JAA>Hmm, does anyone have experience with multipart uploads to IA S3? I'm getting an HTTP 500 trying to initiate one, though I may well be reading the docs incorrectly. This is what I'm doing: `curl -X POST -H 'Authorization: LOW <access>:<secret>' -sv https://s3.us.archive.org/<identifier>?uploads`
06:59:19<@JAA>Uh yeah, nevermind, it's <identifier>/<path>?uploads I think.
07:00:43<@JAA>Yup, that works better. :-)
07:27:36Arcorann_ joins
07:30:40<@JAA>When you request a list of active multipart uploads, you get a redirect to a plaintext HTTP URL. Gross.
07:33:31<@JAA>And although the server also accepts HTTPS connections, the certificate is invalid for that domain...
07:44:06<@JAA>In case anyone needs this in the future, the documentation isn't very clear, but it looks like the metadata headers (at least collection and mediatype since they can't be changed later) need to be in the multipart upload initiation request while the x-archive-queue-derive and x-archive-keep-old-version headers must be in the completion request to have an effect. (Only the keep-old-version part is
07:44:12<@JAA>documented.)
07:48:24<@JAA>x-archive-size-hint probably belongs in the initiation request (assuming you also do x-amz-auto-make-bucket:1 to create the item at the same time), but I didn't test that.
09:58:17Fusl quits [Excess Flood]
09:58:37Fusl (Fusl) joins
10:33:35G4te_Keep3r quits [Ping timeout: 258 seconds]
10:43:56pabs quits [Ping timeout: 258 seconds]
11:22:15Sluggs quits [Ping timeout: 244 seconds]
11:38:08pabs (pabs) joins
11:46:57G4te_Keep3r joins
13:24:41Arcorann_ quits [Ping timeout: 244 seconds]
13:58:40G4te_Keep3r quits [Ping timeout: 258 seconds]
14:02:31G4te_Keep3r joins
14:33:28<@JAA>There is now an ia-upload-stream Python script in my little-things repo for uploading a stream of data to a file in an IA item using multipart uploads. It reads a chunk from stdin, buffers it in memory, uploads, and eventually completes the upload when stdin is exhausted. Resumption after errors is possible (but it's on you to ensure the data matches), as is aborting an upload. The only external
14:33:34<@JAA>dependency is requests, and it reads the ia CLI config file for auth.
14:37:39HP_Archivist (HP_Archivist) joins
14:37:48<@JAA>It appears that an empty __ia_spool dir remains in the item after an abort, FWIW. That'd be IA's job to fix.
14:55:25Sluggs joins
15:16:54qwertyasdfuiopghjkl quits [Client Quit]
15:24:01qwertyasdfuiopghjkl joins
15:47:44balrog_ is now known as balrog
16:21:47qwertyasdfuiopghjkl47 joins
16:22:56qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
18:45:35IDK (IDK) joins
18:46:47qwertyasdfuiopghjkl joins
18:48:38qwertyasdfuiopghjkl47 quits [Ping timeout: 244 seconds]
19:57:32Matthww7 joins
19:58:36Matthww quits [Ping timeout: 265 seconds]
19:58:36Matthww7 is now known as Matthww
20:52:27TheTechRobo joins
21:39:39pabs quits [Ping timeout: 244 seconds]
21:43:20pabs (pabs) joins
22:16:20z80inside joins
22:16:43<z80inside>hello, is there a way to filter adult content when searching on archive.org? (Books, videos, etc.)
22:39:46Arcorann_ joins
22:53:32pabs quits [Ping timeout: 244 seconds]
23:51:41HP_Archivist quits [Ping timeout: 258 seconds]