00:54:52qw3rty quits [Ping timeout: 252 seconds]
02:26:03DiscantX quits [Ping timeout: 265 seconds]
02:48:19DiscantX joins
02:59:51qwertyasdfuiopghjkl quits [Ping timeout: 317 seconds]
03:00:12qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
03:07:10qwertyasdfuiopghjkl quits [Ping timeout: 380 seconds]
03:10:23qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
03:10:32DiscantX quits [Ping timeout: 252 seconds]
04:33:08qwertyasdfuiopghjkl61 (qwertyasdfuiopghjkl) joins
04:33:10qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds]
04:33:51qwertyasdfuiopghjkl61 quits [Remote host closed the connection]
04:33:55DiscantX joins
04:34:59qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
05:00:15DiscantX quits [Ping timeout: 266 seconds]
05:19:50qwertyasdfuiopghjkl quits [Client Quit]
05:38:25qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
06:07:33erenrich joins
06:07:50<erenrich>anyone aware of known issue with archive.org? I have a ~10GB WARC archive of a forum that I'm trying to upload but it keeps failing with "there is a network problem" i've had this issue several days running
06:12:53<@JAA>I have successfully uploaded files last night myself, and I haven't seen major issues in our automated uploading either.
06:13:13<@JAA>I suspect you use the browser thingy?
06:14:08<pokechu22>I haven't uploaded anything big in the past few days but michaelblob was able to upload https://archive.org/details/wiki-theiphonewikicom_w-20230322 (333MB) yesterday
06:15:28<erenrich>i can get it to upload ~900MB but nothing larger
06:15:55<erenrich>@JAA i tried both the web browser thingy and the python library
06:16:17<erenrich>python library gives me "Connection aborted" errors
06:18:27<erenrich> in december i uploaded an archive of the same forum that was >50GB or so and it worked just fine
06:18:39<@JAA>The things I mentioned used custom tooling, but it all goes to the IA S3 anyway (well, not sure what the browser thing does, but the `ia` tool does upload there), and everything seems fine on the S3 stats.
06:19:19<@JAA>I can think of two things: either there is indeed a network issue between you and IA (wherever and whatever that may be exactly), or it's a content issue.
06:19:37<erenrich>content issue? i mean the content i'm uploading is vile
06:19:51<erenrich>afaik it's legal
06:20:04<@JAA>The server is scanning for some things as you upload, and IIRC, that can cause 'Connection aborted' errors in the ia CLI.
06:20:20<erenrich>i can try routing the upload through GCP to rule out network
06:20:44<@JAA>(The background being that the server sends an error response before the client has finished uploading, and so the client never sees the response but just the connection closure.)
06:21:11<erenrich>does it scan the contents of comrpessed files for banned content?
06:21:24<@JAA>No idea, the details aren't public I think.
06:21:30<erenrich>ok
06:21:35<@JAA>I know that malware scanning happens later.
06:21:47<erenrich>well thanks this is helpful context
06:22:02<erenrich>i'll try doing subsets to see if there's some block that's problematic
06:27:11<erenrich>nah just the images crapped out too
06:48:30qwertyasdfuiopghjkl quits [Client Quit]
06:49:04pabs quits [Ping timeout: 252 seconds]
07:54:10pabs (pabs) joins
08:18:33schwarzkatz|m quits [*.net *.split]
08:18:33thermospheric quits [*.net *.split]
08:18:33tomodachi94 quits [*.net *.split]
08:18:33theblazehen|m quits [*.net *.split]
08:18:33britmob|m quits [*.net *.split]
08:18:33mattwright324|m quits [*.net *.split]
08:18:33DigitalDragon quits [*.net *.split]
08:18:33Sanqui|m quits [*.net *.split]
08:18:33igneousx quits [*.net *.split]
08:25:03Sanqui|m joins
08:25:03britmob|m joins
08:25:03schwarzkatz|m joins
08:25:03tomodachi94 joins
08:25:03DigitalDragon joins
08:25:03thermospheric joins
08:25:03theblazehen|m joins
08:25:03igneousx joins
08:25:03mattwright324|m joins
08:46:42qw3rty joins
09:12:48OrIdow6^2 (OrIdow6) joins
09:20:57OrIdow6 quits [*.net *.split]
12:06:05OrIdow6^2 quits [Client Quit]
12:06:23OrIdow6 (OrIdow6) joins
13:00:45qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
13:22:52Arcorann quits [Ping timeout: 252 seconds]
13:33:09pabs quits [Client Quit]
13:37:06pabs (pabs) joins
13:44:43HP_Archivist quits [Client Quit]
14:08:23<@kaz>erenrich: got an item ID? wonder if the logs will show anything
15:41:03qwertyasdfuiopghjkl quits [Remote host closed the connection]
15:45:41qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
15:58:42OrIdow6 quits [Client Quit]
19:17:39OrIdow6 (OrIdow6) joins
19:42:49HP_Archivist (HP_Archivist) joins
19:49:37HP_Archivist quits [Client Quit]
20:54:54qwertyasdfuiopghjkl quits [Remote host closed the connection]
20:58:37qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
22:41:58<erenrich>kaz: scored.co-2023-03 got the error from ia tool "Connection aborted"
22:43:37<@JAA>Yeah, the item was never created, so no insight there.
23:50:50Sanqui_ joins
23:50:58Sanqui quits [Ping timeout: 252 seconds]