HomeSearchPrevious dayNext day

00:24:22<Pedrosso>So, I tried to see if I could archive all of valve's portal 2 workshop items. So I made a, hopefully extensive, list of IDs https://archive.org/details/portal2_workshopIDs_20231212 which is already huge (10^7 ids). Doing the maths, the total would be like 6 TB getting every item. Compressed that'd be like 1 TB. It's not terrible but it's still
00:24:22<Pedrosso>quite big. At that size, is it worth it / okay to attempt to download & upload it to IA via multiple items?
00:43:01Doranwen quits [Client Quit]
00:50:44Doranwen (Doranwen) joins
03:09:32qyxojzh|m quits [*.net *.split]
03:09:32thermospheric quits [*.net *.split]
03:09:32hlgs|m quits [*.net *.split]
03:09:32schwarzkatz|m quits [*.net *.split]
03:09:33yzqzss quits [*.net *.split]
03:09:33x9fff00 quits [*.net *.split]
03:09:33Exorcism quits [*.net *.split]
03:09:33s-crypt|m|m quits [*.net *.split]
03:09:33Thibaultmol quits [*.net *.split]
03:09:33theblazehen|m quits [*.net *.split]
03:09:33tomodachi94 quits [*.net *.split]
03:09:33Vokun quits [*.net *.split]
03:09:34audrooku|m quits [*.net *.split]
03:09:34britmob|m quits [*.net *.split]
03:09:34mattwright324|m quits [*.net *.split]
03:09:34DigitalDragon quits [*.net *.split]
03:09:34Sanqui|m quits [*.net *.split]
03:09:34igneousx quits [*.net *.split]
03:25:22mattwright324|m joins
03:25:54mattwright324|m quits [*.net *.split]
03:27:18mattwright324|m joins
03:27:50igneousx (igneousx) joins
03:27:50theblazehen|m joins
03:27:50Exorcism (exorcism) joins
03:27:50audrooku|m joins
03:27:50schwarzkatz|m joins
03:27:50DigitalDragon (DigitalDragon) joins
03:27:50tomodachi94 (tomodachi94) joins
03:27:50Sanqui|m (Sanqui) joins
03:27:50britmob|m joins
03:27:50Thibaultmol joins
03:27:50x9fff00 (x9fff00) joins
03:27:50Vokun (Vokun) joins
03:27:50s-crypt|m|m joins
03:27:50yzqzss (yzqzss) joins
03:27:59thermospheric (Thermospheric) joins
03:27:59hlgs|m joins
03:27:59qyxojzh|m joins
03:31:12<nicolas17> uploading Xcode_13_beta_3.xip: 100%|████████████| 10056/10056 [3:17:45<00:00, 1.18s/MiB]
03:31:13<nicolas17> error uploading Xcode_13_beta_3.xip: Please reduce your request rate. - total_tasks_queued exceeds global_limit
03:31:23<nicolas17>wtf
03:33:17<@JAA>Oof
03:47:33<nicolas17>trying again
03:47:34<nicolas17>it's slower
03:48:12yzqzss quits [Client Quit]
03:48:21yzqzss (yzqzss) joins
03:59:07<@JAA>Yeah, I've been getting 2-3 s/MiB for the past couple hours.
03:59:42<nicolas17>ok... this is not urgent, I'll wait until IA is feeling better >.>
04:16:48<yzqzss>> IA S3: 2175 tasks in queue, Load avg: 0.18.
04:16:59<yzqzss>uploading is very fast now
04:21:07<@JAA>> 941/1640 [44:03<52:25, 4.50s/MiB]
04:21:11<@JAA>Very fast, much wow.
04:26:21<yzqzss>6.50MiB/s
04:26:48<yzqzss>better than you ~
04:49:31<nicolas17> [26:40<5:16:41, 2.07s/MiB]
06:47:28<fireonlive>arkiver: dark mode for archive.org soon? :3
07:06:47Arcorann (Arcorann) joins
07:09:24<@arkiver>fireonlive: absolutely no idea :P
07:09:41<fireonlive>:P
08:32:43DopefishJustin quits [Ping timeout: 272 seconds]
13:15:50Arcorann quits [Ping timeout: 240 seconds]
14:19:50tbc1887 quits [Ping timeout: 240 seconds]
14:43:39qwertyasdfuiopghjkl quits [Client Quit]
15:38:18DopefishJustin joins
15:57:55qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
16:20:04DogsRNice joins
16:42:17qw3rty__ quits [Ping timeout: 272 seconds]
16:42:45qw3rty__ joins
16:57:24<nicolas17> 10056/10056 [5:22:46<00:00, 1.93s/MiB]
16:57:28<nicolas17>finally
17:49:42<@JAA>Finally indeed. Uploading three items of 12 GB total took over 9 hours here.
17:49:57<nicolas17>at least it was from my VPS
17:50:19<nicolas17>otherwise it would have taken 10 hours and caused heat+noise in my room throughout the process
18:20:15tbc1887 (tbc1887) joins
18:29:11<fireonlive>sounds desirable
19:15:30Lord_Nightmare quits [Quit: ZNC - http://znc.in]
19:19:11Lord_Nightmare (Lord_Nightmare) joins
21:00:03systwi quits [Ping timeout: 272 seconds]
21:17:23<@JAA>Getting 520s ('Job failed') from SPN since about 17:15.
21:20:18systwi (systwi) joins
23:06:23<pokechu22>Trying to SPN youtube currently gives "This host has been already captured 60,056.0 times today. Please try again tomorrow." I get why the cap exists (it's annoying but makes sense) but the .0 is kinda funny (and I'm guessing the extra 56 comes from several jobs being in flight before they started blocking them due to the cap)
23:22:13<OrIdow6>The trick to SPNing is to submit hundreds of thousands of requests within a single second, got it
23:28:38Arcorann (Arcorann) joins

HomeSearchPrevious dayNext day