01:24:43 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
01:33:37 | | nicolas17 quits [Quit: Konversation terminated!] |
01:45:53 | | nicolas17 joins |
02:43:37 | | tzt quits [Ping timeout: 272 seconds] |
02:44:43 | | tzt (tzt) joins |
03:12:25 | <nicolas17> | if you upload a giant file to IA, I assume it looks for a storage server that will actually have enough space to hold it |
03:12:48 | <nicolas17> | but what happens if you upload a 2MB file to IA, the item gets assigned to a storage server, and then you upload a few terabytes more into the same item? is it possible that at some point the storage server will fill up and IA will have to move the whole item to a different one? |
03:15:06 | <@JAA> | Well, 'a few terabytes' is impossible due to the hard item size limit. But yes, that can happen. It's recommended to give a size hint on item creation for this reason. |
03:15:42 | <nicolas17> | (what is the item size limit?) |
03:15:51 | <@JAA> | 1 TiB |
03:16:06 | <@JAA> | But it's best not to go too close to that. |
03:16:19 | <nicolas17> | I doubt every server has 1TB free at all times |
03:16:24 | <nicolas17> | hence the question :) |
03:16:38 | <@JAA> | Hence the size hint. :-) |
03:16:57 | <nicolas17> | what happens if you don't do that? will it move the item? |
03:17:04 | <@JAA> | It tells the system how much space the item will eventually need, assigns a suitable server, and (I assume) temporarily reserves that space. |
03:17:49 | <@JAA> | Yeah, it will eventually stall tasks and move either your or other items away with a shuffle task. |
03:17:59 | <@JAA> | Avoid that if you can. |
03:18:57 | <@JAA> | The size hint doesn't need to be very accurate. IA can tolerate some deviations. |
03:19:20 | <TheTechRobo> | Do you need a size hint if you're uploading a directory? |
03:19:23 | <@JAA> | The size hint for AB items used to be hardcoded, for example. |
03:19:31 | <TheTechRobo> | Or does ia CLI handle that? |
03:19:36 | <@JAA> | The CLI handles it. |
03:20:18 | <@JAA> | But yeah, a size hint is always a good idea, regardless of what the data looks like. |
03:20:45 | <@JAA> | It must be included in the upload creating the item though, afterwards it's useless as far as I know. |
03:21:16 | <@JAA> | Could be that it still triggers the shuffling early if necessary though. |
03:40:05 | <pokechu22> | I assume the web uploader gives a size hint automatically too? |
03:40:37 | <pokechu22> | it at least does show the file sizes before you start the upload and has an accurate progress bar so I'd assume they're making full use of that information |
04:42:20 | | atphoenix quits [Ping timeout: 240 seconds] |
04:43:57 | | DogsRNice quits [Read error: Connection reset by peer] |
04:44:09 | | atphoenix (atphoenix) joins |
08:11:59 | | fireonlive quits [Client Quit] |
08:12:41 | | fireonlive (fireonlive) joins |
08:47:47 | | systwi quits [Ping timeout: 272 seconds] |
08:56:19 | | systwi (systwi) joins |
10:21:13 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
10:50:11 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
12:45:17 | | Arcorann quits [Ping timeout: 272 seconds] |
15:50:33 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
15:59:26 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
18:00:54 | | DogsRNice joins |
19:47:33 | | HP_Archivist quits [Quit: Leaving] |
21:02:05 | | datechnoman quits [Quit: The Lounge - https://thelounge.chat] |
21:09:38 | | datechnoman (datechnoman) joins |
21:28:55 | | magmaus3 quits [Quit: :3] |
22:12:22 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |